Not really, llama.cpp can download for quite some time, not as elegant as ollama... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		trissi1996 10 months ago \| parent \| context \| favorite \| on: Llama.cpp supports Vulkan. why doesn't Ollama? Not really, llama.cpp can download for quite some time, not as elegant as ollama but: `llama-server --model-url "https://huggingface.co/bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF/resolve/main/DeepSeek-R1-Distill-Qwen-32B-IQ4_XS.gguf"` Will get you up and running in one single command.

yencabulator 10 months ago [–]

And now you need a server per model? Ollama loads models on-demand, and terminates them after idle, all accessible over the same HTTP API.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact