Or Groq. They can do 1250 tokens/s with Llama 3 8B.

		hmottestad on June 10, 2024 \| parent \| context \| favorite \| on: Apple Intelligence for iPhone, iPad, and Mac Or Groq. They can do 1250 tokens/s with Llama 3 8B.