- llm-api uses llm-chain instead of common-chain - llm-chain excludes buffer & compress middlewares - Prevents Traefik from buffering streaming SSE responses - Each token is now flushed immediately
- llm-api uses llm-chain instead of common-chain - llm-chain excludes buffer & compress middlewares - Prevents Traefik from buffering streaming SSE responses - Each token is now flushed immediately