3 Commits

Include renames

Author	SHA1	Message	Date
asepharyanaandClaude Code	e351d74fa4	refactor(llm-api): implement clean architecture following scraper pattern ... Split monolithic 1012-line main.rs into layered hexagonal architecture: - Domain: entity types and LlmError enum - Application: prompt building, sampler construction, tool call parsing - Infrastructure: LlamaEngine wrapping llama-cpp-2 with isolated unsafe transmute - Presentation: Axum handlers, middleware (auth), error chain, router - Config: type-safe AppConfig with LazyLock - Bootstrap: Application struct with build() + run() Resolves build_sampler/build_sampler_params duplication. Adds simple web chat UI at GET /. Co-Authored-By: Claude Code <noreply@anthropic.com>	2026-07-25 15:07:19 +07:00
Asep Haryana	e1f5195407	feat: add SSE streaming support (OpenAI-compatible) ... - Token-by-token streaming via Server-Sent Events - tokio::sync::mpsc channel + ReceiverStream for clean async - OpenAI SSE format: role chunk → content chunks → finish chunk - Non-streaming still works with the same code path - Uses spawn_blocking pattern for CPU-bound inference	2026-07-25 11:33:59 +07:00
Asep Haryana	33b42b789c	feat: initial release - OpenAI-compatible LLM server with llama-cpp-2	2026-07-25 11:00:03 +07:00