Benchmarks are not real so 2% is meaningless. | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		ipaddr on Feb 28, 2025 \| parent \| context \| favorite \| on: GPT-4.5 Benchmarks are not real so 2% is meaningless.

fn-mote on Feb 28, 2025 [–]

Of course not. The point is that the cost difference between the two things being compared is huge, right? Same performance, but not the same cost.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact