This looks like absolute trash - every single graph is about FAST FAST FAST. 5x ... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		daguava on Sept 16, 2023 \| parent \| context \| favorite \| on: Faster Than Llama 2: DeciLM LLM with Variable GQA This looks like absolute trash - every single graph is about FAST FAST FAST. 5x FASTER, 15x FASTER FAST FAST FAST!!!! How about accuracy? Are the results good? I can shit out a blank string at gigabits per second easily... Searching for the string "accu" yields no results. "acc" only yields "acceleration". This is stupidity and should be ignored. EDIT: HOLY KEK - they have a "carbon emissions" chart showing them saving 95%. Jesus christ, ignore everything they say, they are blind deaf and dumb.

WithinReason on Sept 16, 2023 [–]

Search for the string "metric"

natsucks on Sept 16, 2023 | [–]

curiously, they don't mention MMLU, which is one of the most commonly reported metrics for comparison.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact