Because it involved scaling in chip area needed for FP8. AI community realized that FP8 training is possible few years back so the transistors given for FP8 was scaled. Overall I think transistors grow just by ~50% per generation so most of the gains comes from removing FP32/FP64 share which were dominant 10 years back, but there is only some point it could go to.
I'd have expected a lot of OpenAI employees to join whatever initiative Sam and gdb started next, but the profile of someone who joined OpenAI this past year and a Microsoft employee are...quite different.
Isn't this expected? Nearly everyone who joined post ChatGPT was primarily financially motivated. What is more interesting is how many of the core research team stays.
This is actually pretty surprising to me, since a financially motivated person would normally wait until a better deal, and just collect their paycheck in the meantime.
There's also no guarantee that Altman will really start a new company, or be able to collect funding to hire everyone quickly. I wonder if these people are just very loyal to Sam.
> This is actually pretty surprising to me, since a financially motivated person would normally wait until a better deal, and just collect their paycheck in the meantime.
I imagine you need to signal that you want in on the deal by departing. Get founder equity.
This. Very accurate. At the end of they day this is a battle between academics and capitalists and what they stand for. We generally know how this typically goes…
I don't see many academics indulge in sensationalist doomsaying. That's the real difference here. SETI wouldn't and couldn't seek grants by proposing to contact murderous aliens.
I think academics have a general faith in goodwill of intelligence.Benevolence may be a convergent phenomenon. Maybe the mechanisms of reason themselves require empathy and goodness