Compare commits
1
Commits
main
...
deploy-llm-api
| Author | SHA1 | Date | |
|---|---|---|---|
|
|
5319971bfd |
@@ -10,7 +10,7 @@ services:
|
|||||||
env_file:
|
env_file:
|
||||||
- ../../.env
|
- ../../.env
|
||||||
environment:
|
environment:
|
||||||
- MODEL_PATH=/models/MiniCPM-V-4.6-Q4_K_M.gguf
|
- MODEL_PATH=/models/MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking-Q8_0.gguf
|
||||||
- API_KEY=${LLM_API_KEY:-}
|
- API_KEY=${LLM_API_KEY:-}
|
||||||
volumes:
|
volumes:
|
||||||
- /root/models/gguf:/models:ro
|
- /root/models/gguf:/models:ro
|
||||||
|
|||||||
Reference in New Issue
Block a user