OP's point is that the hardware specs are 2-3x higher in many places, but all th... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		shaklee3 on Dec 7, 2023 \| parent \| context \| favorite \| on: AMD MI300 performance – Faster than H100, but how ... OP's point is that the hardware specs are 2-3x higher in many places, but all their benchmarks are 20-30% higher. The article mentions this as well. It means AMD couldn't even utilize their own hardware very well at this point.

zaptrem on Dec 7, 2023 [–]

Transformers are heavily memory bandwidth bound on modern hardware, and these chips only have 60% higher memory bandwidth.

shaklee3 on Dec 7, 2023 | [–]

Their own slides show a 20-30% speedup on attention tasks.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact