You have to wonder if Giannandrea is what's been holding Siri back all these years. What can you point to that he's significantly improved at Apple since coming from Google in 2018? And now he's luke-warm on LLMs? Seems like someone we should be seeing present Apple's AI strategy at this year's WWDC keynote, no?
True. Seems like now would be his moment to take center stage (literally at WWDC in about a week). His title is "Senior Vice President Machine Learning and AI Strategy". We've seen Ternus present. Srouji too. Sure would instill some confidence to hear directly from the AI Strategy SVP on what they've been working on and what they have planned. Turning Siri over to OpenAI sounds like a defeat for him.
Apple, in 2024, is still unable to implement a functioning autocorrect, which is a primitive version of LLM's, in the iOS keyboard. Why anyone has any faith in Apple in the new age of LLM's is beyond me.
Ben Thompson of Stratechery raised a good question - why isn't Apple partnering with Microsoft instead of OpenAI? Microsoft has the weights, can provide the requisite infra, is in the process of derisking the OpenAI collaboration via defacto aquihires...
OpenAI is losing people, has a CEO with a mixed reputation, irritates a famous actress who beat Disney in court...
You're looking at it the wrong way: Altman really wants this deal. For a long time, accelerated by the OA coup, he has been searching for ways out of the MS trap, where OA becomes an appendix to MS, dependent on MS infrastructure completely. ('Above you, below you, around you...') Apple is one of the few viable alternatives to play off against MS. (This is the same as why Anthropic gets investment from Google & Amazon, as their anti-OA.) The mere fact of any Apple deal at all is a lot of leverage against Nadella. Think of it as like North Korea playing off China and Russia against each other; it is bad to have only 1 patron, but it is good to have 2.
I understand the motivation from the OAI side. what does apple gain though?
The purported google deal made a lot more sense to me. OAI is terrified of google, and Apple could mitigate Pixel differentiating against iPhone. Google would get a bunch of training data as well.
Apple's AI strategy is edge computing, which is very smart given their processor advantage.
But edge LLMs for general purpose aren't there yet and won't be for some time, so a partnership with a leading centralized LLM provider makes a lot of sense.
Do simple low hanging fruit LLM work like actual autocomplete at the edge on the device, and kick more difficult workloads to the AI partnership.
If the tech plateaus your edge computing will eventually catch up and you won't need the partnership but won't have lost market share in the meantime, and if it doesn't you'll continue to split the workloads.
> Apple will deliver some of its upcoming artificial intelligence features this year through data centers powered by its own in-house chips
Emphasis mine. I don't think there's any chance that means ChatGPT will run on Apple Silicon. It seems more likely that they will use it to power their internal CoreML/MLX-based research, anything more would kinda be a waste of money and electricity.
They don’t need to if they can process a significant chunk of the queries on-device. Llama3-level inference works fine on M2-level chips today and the M4 is already in a mobile device.
Maybe branding/brand recognition? Outside of tech circles, it's likely that very few people know anything bad about Altman, compared to the hundreds of millions who know about "ChatGPT."
I think this is more strategic than about whether or not apple could make an AI if they wanted to. OpenAI plays MS off Apple, Apple plays Google off OpenAI. Apple probably gets very favorable terms from OpenAI due to the market they're opening up to them.
sorry to interrupt your comment thread, this is completely unrelated. are you the tracerbulletx that used to go by davey on an old forum called ultio? i know it's a long shot. i've been trying to get back in touch with him over the years, but all the forms of the internet that we used to communicate over are now dead. anyway, hope you're having a good day either way. if you're not davey, disregard this. if you are, let your pal cass know you're alive? cheers.
“Apple has been working on a deal with OpenAI to integrate OpenAI's ChatGPT technology into iOS 18, […] but Siri functionality likely relies on Apple's own LLM work.”
Stock didn't really move on this, but IMO this is a bearish signal for Apple--they're sitting on a ton of cash and can't catch up to OpenAI? Not even via acquisition? How far behind are their internal efforts?
To be fair, launching their own ChatGPT wouldn't be that much more interesting than leveraging OpenAI. What would be amazing is if they get a high-quality GPT model running locally on the device and integrate that with their services.
> high-quality GPT model running locally on the device and integrate that with their services.
Unfortunately very few Macs would be able to run anything like that since 8GB is still the base config for consumer models and I wouldn't be too surprised if 80-90% of all Macs sold in the last couple of years only have 16 GB or less.
So they are going to rises prices by $200 across the board? Or take a non-insignificant cut to their margins (RAM and storage upgrades are basically free money for them)?
Apple has never been about moving fast in response to hype. Think about 3G, VR, foldable screens (apparently coming to iPads in a few years). They do things in their own time and somehow it works.
Why exactly does Apple need to make their own AI? I would prefer if they focused their efforts on what they're already good at - making hardware and operating systems to run on top of it.
> Another is a change to OpenAI's structure as a corporation. OpenAI has an unusual structure, with a for-profit corporation beholden to a nonprofit organization. The Information claims that Altman and his allies are seeking to convert it into either a traditional for-profit corporation or a benefit corporation known as a B-Corp. B-Corps allow corporations to have additional goals beyond shareholder interest, protecting them from certain kinds of shareholder lawsuits if they act for reasons beyond profits.
Obviously, openAI is a cheaper and better option for Apple to use AI in their devices for the time being. Once they have their own AI, or the AI hype subsides, they'll kick openAI.
