Afrowave.AJIS.Streaming 1.1.0

Afrowave.AJIS.Streaming

Low-memory streaming parser for the AJIS (.NET) framework. Produces AJIS segments with memory-bounded parsing and single-pass streaming for processing large datasets efficiently.

Overview

The Streaming library provides the low-level streaming infrastructure for the AJIS ecosystem:

• UTF-8 streaming parser - Single-pass parsing with zero-copy token delivery
• Segment production - AjisSegment model for streaming token stream
• Memory-bounded parsing - Bounded memory usage regardless of input size
• Zero-allocation - Optimized for high-throughput, low-latency scenarios
• Async support - Non-blocking async streaming with IAsyncEnumerable

Features

• Streaming reader primitives - IAjisReader, AjisSpanReader, AjisStreamReader
• UTF-8 text scanning - Strings, numbers, comments (lexer)
• Segment parser - ParseSegments implementation mapping streams to AjisSegment
• AjisSegment model - Token stream representation with value and kind
• Single-pass algorithms - No random access, streaming forward only
• Bounded memory - No full document materialization
• Memory-mapped support - Files larger than available memory

Installation

dotnet add package Afrowave.AJIS.Streaming

API

See the API Reference for complete documentation.

Key Types

Dependencies

• Afrowave.AJIS.Core - Core contracts and settings

Usage

Basic streaming parsing

using System.Text;
using Afrowave.AJIS.Core;
using Afrowave.AJIS.Streaming;

string ajisText = """
{
    name: "John Doe"
    age: 35
    email: "john@example.com"
}
""";

var bytes = Encoding.UTF8.GetBytes(ajisText);
using var ms = new MemoryStream(bytes);
using var reader = new StreamReader(ms);

var parser = new AjisLexerParserStreamingAsync(reader);
await foreach (var segment in parser.ParseAsync())
{
    Console.WriteLine($"{segment.Kind}: {segment.Value}");
}

Segment transformations

// Map transformation
var mapped = segments.Map(segment => new AjisSegment(segment.Kind, Transform(segment.Value)));

// Filter transformation
var filtered = segments.Where(segment => segment.Kind == AjisSegmentKind.Property);

// Select transformation
var selected = segments.Select(segment => segment.Value);

Large file processing

// Memory-efficient processing of large files
await foreach (var segment in ParseSegmentsAsync(largeFileStream))
{
    ProcessSegment(segment);
}

Documentation

• API Reference - Complete API documentation
• Segment Contract - Segment model details
• Streaming Model - Streaming architecture
• Getting Started - Quick start guide
• API Reader Contract - Reader interface
• Streaming API - Streaming docs

Compatibility

• .NET 10.0+
• Nullable reference types enabled
• Requires AllowUnsafeBlocks for optimized memory operations

License

MIT