Docker-Compose/AI_Containers/llama

1. Download model
   cd /srv/docker/llama/models

wget https://huggingface.co/bartowski/Qwen_Qwen3.5-4B-GGUF/resolve/main/Qwen_Qwen3.5-4B-Q4_K_M.gguf \
  -O Qwen_Qwen3.5-4B-Q4_K_M.gguf

2. Create API key

  openssl rand -hex 32