ab/homelab
1
1 Fork 1
Code Issues Pull Requests 171 Actions Packages Wiki Activity

Changed llama model unsloth/Qwen3.8-27B-GGUF:UD-Q6_K -> unsloth/Qwen3.6-35B-A3B-GGUF:UD-Q6_K
Update Kubernetes Services Wiki / Generate and Update K8s Wiki (push) Successful in 19s
Details

Browse Source
This commit is contained in:
Aleksandr Bogomiakov committed 2026-10-15 01:19:37 +01:00
1 parent aaa1e9ae7e
commit 04610cc6e2
1 file changed
+2 -1
Download Patch File Download Diff File Expand all files Collapse all files
k8s-ng/apps/llamacpp/configmap.yaml
+2 -1
View File
@@ -8,7 +8,8 @@ data:
LLAMA_ARG_PORT: "8080"
# The model is chosen here: <hf-user>/<repo>:<quant>. It is downloaded into
# /models on first start; changing it restarts the pod (reloader).
LLAMA_ARG_HF_REPO: "unsloth/Qwen3.8-27B-GGUF:UD-Q6_K"
#LLAMA_ARG_HF_REPO: "unsloth/Qwen3.8-27B-GGUF:UD-Q6_K"
LLAMA_ARG_HF_REPO: "unsloth/Qwen3.6-35B-A3B-GGUF:UD-Q6_K"
LLAMA_ARG_CTX_SIZE: "131072"
LLAMA_ARG_N_GPU_LAYERS: all
LLAMA_ARG_FLASH_ATTN: "on"