Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Good to know. I've only been running LLMs at home and most of the open-source ones have been more than small enough to fit in my measly 12GB. But I guess most workloads want so much that 24GB won't fit them at all.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: