Source: as part of its Google deal, Apple has full access to the Gemini model in its own data centers and can use distillation to produce smaller models
Before we get to today's column, we wanted to flag OpenAI CEO Sam Altman's major reorg, the company's new “Spud” model and its decision …
Huh. I am not sure distilling Gemini models to run on phones is going to result in the generally capable agents that people will soon expect, but we shall see.
Apple's local AFM model is insanely stable and handles multiple languages really well, even though it's tiny. The only company this good is Google, but AFM is way smaller than their Gemma The problem is the safeguard is so heavy it's basically unusable