cd127a23e0c27bfeb0c82ab7cc4f1fa4f7a1fe0c
obico's own comment already notes its :cuda tag falls back to CPU inference on this driver/GPU combo, but it was still reserving 826MB of VRAM it never used productively. That squeeze was forcing ollama to offload only 20/29 model layers to GPU, pushing the rest onto CPU and causing severe latency (multi-minute LLM calls) that stalled SUB/WAVE's track picking. Claude-Session: https://claude.ai/code/session_01L7Rwa6guD5wK8F8tWQwcJX
docker-infrastructure
Languages
Shell
58.2%
Python
28%
JavaScript
10.5%
HTML
2.3%
DIGITAL Command Language
0.6%
Other
0.4%