Running the Deepseek-R1 671B Model at FP16 Fidelity on AMD EPYC CPUs | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		Running the Deepseek-R1 671B Model at FP16 Fidelity on AMD EPYC CPUs (servethehome.com)
		5 points by tanelpoder on April 4, 2025 \| hide \| past \| favorite \| 2 comments

sgt on April 4, 2025 | [–]

Mac Mini with Ultra might be 10-20x faster in terms of tokens/sec on the same model.

sleepingreset on April 4, 2025 | [–]

nice

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact