A bunch of 128x128 systolic arrays at its heart. More details:

https://newsletter.semianalysis.com/p/amazons-ai-self-suffic...

Nice article; I hate to think what the DC bus bars look like! ~50v at ~25kW/rack; 500A bus bars - I guess split, but still!

Training. It's in the name.

Ironically these chips are being targeted at inference as well (the AWS CEO acknowledged the difficulties in naming things during the announcement).

Perhaps they should do their training on their Inferentia chips and see how that works out?

The same thing happened to AMD and Gaudi. They couldn't get training to work so they pivoted to inference.

The I stands for Inference then?

Vector math

Probably because the only task this chip has to perform is to please shareholders hence there is no need to explain anything to us peasant developers.