 Asep Haryana
|
9a63ff1601
|
feat: use GGUF chat template via apply_chat_template
- Replaced manual prompt building with LlamaModel::apply_chat_template
- Uses model's baked-in Jinja template (system/user/assistant/tool format)
- Added <think> trigger after template for thinking mode
- Clean_text strips only <|im_end|>, <|im_start|>, <think>, </think>
|
2026-07-26 17:10:42 +07:00 |
|
|
asepharyanaandClaude Code
|
e351d74fa4
|
refactor(llm-api): implement clean architecture following scraper pattern
Split monolithic 1012-line main.rs into layered hexagonal architecture:
- Domain: entity types and LlmError enum
- Application: prompt building, sampler construction, tool call parsing
- Infrastructure: LlamaEngine wrapping llama-cpp-2 with isolated unsafe transmute
- Presentation: Axum handlers, middleware (auth), error chain, router
- Config: type-safe AppConfig with LazyLock
- Bootstrap: Application struct with build() + run()
Resolves build_sampler/build_sampler_params duplication.
Adds simple web chat UI at GET /.
Co-Authored-By: Claude Code <noreply@anthropic.com>
|
2026-07-25 15:07:19 +07:00 |
|