SpawnDev.AI.Server 1.1.0-preview.1

SpawnDev.AI

💜 Built and maintained by one independent developer — no company, no overhead, just code. If SpawnDev.AI saves you time, please consider sponsoring its development ». Sponsorship is what keeps it alive and maintained.

Run and serve local LLMs and image generation everywhere .NET runs - desktop and the browser - on the SpawnDev.ILGPU.ML inference engine (GGUF models, KV-cache decode, SD-Turbo image generation, WebGPU dispatch-plan capture/replay). LLM decode and SD-Turbo text-to-image both run in-browser on WebGPU, no server or native install.

Why

Local LLM serving shouldn't require a native install. The same AiApiRouter that answers curl localhost:11434/api/chat on a desktop can run inside a shared worker in a browser tab, decoding on WebGPU at interactive speed (qwen2.5-0.5b: ~34 tok/s greedy on an RTX 4070 via dispatch-plan capture/replay). Tool calling is parsed server-side into structured calls on every protocol surface.

Tools & in-browser reliability

The chat model can generate images and answer questions about the SpawnDev libraries and crew via a server-side tool system (one registration serves the internal agentic loop, MCP, and protocol clients; binary outputs travel out of band through an artifact store). Because the in-browser default is a tiny model, the engine makes the common cases reliable without depending on the model's own tool-calling: it pre-emptively forces the image tool on a clear "draw X" request and grounds SpawnDev questions from a daily-built repository digest fetched once from a CDN. Details: Docs/reliability.md.

Documentation

Docs/ - protocols (every endpoint + client compatibility), hosting (desktop + browser + the demo), tools, and reliability.

Quick start (desktop, Ollama-compatible)

using SpawnDev.AI.Server;

var store = new OllamaModelStore();                    // ~/.ollama/models (or OLLAMA_MODELS)
var registry = new ModelRegistry(store, accelerator);  // any SpawnDev.ILGPU accelerator
var engine = new AiChatEngine(registry);
var router = new AiApiRouter(engine);
// host it: map every request to router.TryHandleAsync(method, path, bodyJson, yourTransport)

Status

Preview. Extracted from the proven SpawnDev.ILGPU.ML Ollama-server example and verified against the Claude CLI, Ollama clients, and OpenAI-compat clients. The desktop HTTP host, the browser shared-worker host (LLM chat + SD-Turbo image generation on WebGPU), the agentic tool loop, MCP, and the live demo all ship today; the Blazor component library is being fleshed out.

The SpawnDev Crew

• LostBeard (Todd Tanner) - Captain, library author, keeper of the vision
• Riker (Claude CLI #1) - First Officer, implementation lead on consuming projects
• Data (Claude CLI #2) - Operations Officer, deep-library work, test rigor, root-cause analysis
• Tuvok (Claude CLI #3) - Security/Research Officer, design planning, documentation, code review
• Geordi (Claude CLI #4) - Chief Engineer, library internals, GPU kernels, backend work
• Seven (Claude CLI #5) - Wasm backend, GPU kernels, fail-loud verification

🖖