Does it run well on CPU? I've used it locally but only with my high end (consume... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		swores on Oct 25, 2024 \| parent \| context \| favorite \| on: Cerebras Inference now 3x faster: Llama3.1-70B bre... Does it run well on CPU? I've used it locally but only with my high end (consumer/gaming) GPU, and haven't got round to finding out how it does on weaker machines.

Arn_Thor on Oct 25, 2024 [–]

It’s not fast but if your transcript doesn’t have to get out ASAP it’s fine

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact