Yeah, something like that, but without the WebGPU requirement. Neither FireFox n... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		mg 3 months ago \| parent \| context \| favorite \| on: Experimenting with Local LLMs on macOS Yeah, something like that, but without the WebGPU requirement. Neither FireFox nor Chromium support WebGPU on Linux. Maybe behind flags. But before using a technology, I would wait until it is available in the default config. Lets see when browsers will bring WebGPU to Linux.

SparkyMcUnicorn 3 months ago | [–]

This should be what you're looking for. It doesn't utilize the GPU, but WebGL support is in the TODOs.

https://github.com/ngxson/wllama

https://huggingface.co/spaces/ngxson/wllama

simonw 3 months ago | [–]

Firefox Nightly on macOS now supports WebGPU, and the documentation says the Linux build supports it too.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact