Apple is in talks to build Google’s Gemini artificial intelligence engine into the iPhone, sources say, setting the stage for a blockbuster agreement that would shake up the AI industry.
The two companies are in active negotiations to let Apple license Gemini, Google’s set of generative AI models, to power some new features coming to the iPhone software this year, sources said.
I was hoping they were building something in house that was optimized to run locally (with an API devs could use). Then have the local AI model identify more advanced queries itself and only send those to a larger remote model.
Quantized versions of Llama 7b and Mistral 7b can already run on (even slightly older A14) iPhones. So with precise tuning (and a specialized dedicated memory module to keep a few models loaded at all times) I’m sure they could get decent 7 billion parameter models running locally fast. Make multiple, one optimized for each language. One focused just on translation (like Meta’s open source M2M-100 model) etc.
If they do partner with someone I suppose it’s still possible they could build this type of thing out in collaboration.
But yah, Apple. Do this and you’ll be considered an innovator in AI. Despite being late to the game.
Ok_Zombie_8307 on
That’s disappointing, was hoping they had something in development in house that was specialized for their purpose (and optimized for their architecture). Not a good sign if they have to outsource and weld it on to iOS.
yepsayorte on
Oh good. My phone can be super racist. I’m sure that’s a feature everyone wants.
DizzyExpedience on
Apple starting to fall apart:
Missed the AI train
Given up the car project to shift people to work on AI
Still can’t get it to work
Features of iOS are two years behind Android
Lost their mojo it seems
monospaceman on
God I hope this isn’t true. Gemini is significantly inferior to ChatGPT.
I wish Apple would just release their own. Siri needs to die.
Sushrit_Lawliet on
Huge L. The whole appeal of Apple is that they’re able to and have pushed to run a lot of their AI magic on device, which is why we’ve all the neural engine stuff. There’s no way Google enables that behaviour.
Leave A Reply
Du musst angemeldet sein, um einen Kommentar abzugeben.
7 Kommentare
*From Bloomberg reporter Mark Gurman:*
Apple is in talks to build Google’s Gemini artificial intelligence engine into the iPhone, sources say, setting the stage for a blockbuster agreement that would shake up the AI industry.
The two companies are in active negotiations to let Apple license Gemini, Google’s set of generative AI models, to power some new features coming to the iPhone software this year, sources said.
Apple also recently held discussions with OpenAI and has considered using its model, the sources added. More [here](https://www.bloomberg.com/news/articles/2024-03-18/apple-in-talks-to-license-google-gemini-for-iphone-ios-18-generative-ai-tools) on what this could mean for the two companies.
I was hoping they were building something in house that was optimized to run locally (with an API devs could use). Then have the local AI model identify more advanced queries itself and only send those to a larger remote model.
Quantized versions of Llama 7b and Mistral 7b can already run on (even slightly older A14) iPhones. So with precise tuning (and a specialized dedicated memory module to keep a few models loaded at all times) I’m sure they could get decent 7 billion parameter models running locally fast. Make multiple, one optimized for each language. One focused just on translation (like Meta’s open source M2M-100 model) etc.
If they do partner with someone I suppose it’s still possible they could build this type of thing out in collaboration.
But yah, Apple. Do this and you’ll be considered an innovator in AI. Despite being late to the game.
That’s disappointing, was hoping they had something in development in house that was specialized for their purpose (and optimized for their architecture). Not a good sign if they have to outsource and weld it on to iOS.
Oh good. My phone can be super racist. I’m sure that’s a feature everyone wants.
Apple starting to fall apart:
Missed the AI train
Given up the car project to shift people to work on AI
Still can’t get it to work
Features of iOS are two years behind Android
Lost their mojo it seems
God I hope this isn’t true. Gemini is significantly inferior to ChatGPT.
I wish Apple would just release their own. Siri needs to die.
Huge L. The whole appeal of Apple is that they’re able to and have pushed to run a lot of their AI magic on device, which is why we’ve all the neural engine stuff. There’s no way Google enables that behaviour.