Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

How are you running r1 on 64mb of ram? I’m guessing you’re running a distill which is not r1


The 70b distill at 4bit quantize fits, so yes, and performance and quality seem pretty good. I can't run the gigantic one.


Ok but that’s not deepseek-r1. Lots of people keep saying this for distills and it’s getting very confusing.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: