Discussion

• @chockenberry@mastodon.social Craig Hockenberry on mastodon

  I'm surprised this wasn't mentioned in the keynote or State of the Union, but Apple's model training data is either licensed or publicly available on the Internet.  No personal information is used.  —  You can opt out of the web based training here: https://support.apple.com/... …

• @maxwinebach Max Weinbach on x

  This is from Apple's State of the Union The local model is a 3B parameter SLM that uses adapters trained for each specific feature. Diffusion model does the same thing, adapter for each style. Anything running locally or Apple's Secure Cloud is an Apple model, not OpenAI. [video]

• @bzamayo Benjamin Mayo on x

  Like other LLMs, you will be able to get Siri to say bad things if you try hard enough. Apple's published benchmarking say its models respond poorly to adversarial requests about 7% of the time, significantly lower than that of rivals. [image]

• @jorilallo Jori Lallo on x

  Big mistake from Apple to go all normie on keynote and leaving all the LLM details to SOTU. This is highly impressive and paints Apple in innovative light vs keynote which leads to believe models weren't theirs and that they dropped all privacy promises. I'm kinda blown away by

• @a_musingcat Cat on x

  i wonder what training data apple used for its models

• @harper @harper on x

  [1] We compared against the following model versions: gpt-3.5-turbo-0125, gpt-4-0125-preview, Phi-3-mini-4k-instruct, Mistral-7B-Instruct-v0.2, Mixtral-8x22B-Instruct-v0.1, Gemma-1.1-2B, and Gemma-1.1-7B. The open-source and Apple models are evaluated in bfloat16 precision.

• @nickadobos Nick Dobos on x

  @a_musingcat some vague details here: https://machinelearning.apple.com/ ... [image]

• @emollick Ethan Mollick on x

  Apple on device is equivalent to other tiny models. Apple Server is equivalent to GPT-3.5ish. Frontier models they are not, but will still give you supercharged Siri & okay-ish writing help. I don't think this has much to do with high-end use cases. https://machinelearning.apple.…

• @drjwrae Jack Rae on x

  Apple's on-device models are built with JAX and XLA 💘 https://machinelearning.apple.com/ ...

• @malwrhunterteam @malwrhunterteam on x

  “this is the world we're moving to” If that will be the case, the only single reason for that happening is that people are accepting it. If no one would accept that, no brain needed to understand Apple would forget the whole idea within a fraction of a second. 🤷‍♂️

• @cfgeek Charles Foster on x

  More info than I was expecting from Apple. Even includes a couple bits about architecture. I'm a little surprised at their benchmarks for their on-device and server models, & that they didn't merely license/white-label OpenAI models. https://machinelearning.apple.com/ ...

• @bonuelphotog Miguel J on x

  Great research summary and overview of Apple's foundation models. Good job to them! Great read, and quite a thorough overview and analysis. https://machinelearning.apple.com/ ...

• @nickadobos Nick Dobos on x

  Apple intelligence benchmarks are out Looks really strong Apple server (I guess that's what we call it?) Seems competitive vs GPT4 & Mixtral tho not many comparisons, cherry picking? On device seems strong, but surprisingly loses to Gemma-7B & Mistral 7B. Wonder if it is a 3B? [i…

• @rmhrisk Ryan Hurst on x

  I am super excited to see the work Apple has been doing with Private Cloud Compute. One thing you can say about Apple is when they do something, they go big. I have been pushing for models like this for ages; it requires a significant platform investment to deliver on these

• @dgueraco David Güera on x

  For a deeper dive, check out our latest post on the Machine Learning Research blog. https://machinelearning.apple.com/ ...

• @kaepora Nadim Kobeissi on x

  “Private Cloud Compute” definitely sounds suspicious at first glance. What is the “verifiable privacy promise”, multi-party computation? Zero-knowledge attestations? If it's just TLS, obviously not a privacy win. Isn't Apple Intelligence supposed to be entirely on-device? [image]

• @arvidkahl Arvid Kahl on x

  Apple just dropped a 3B parameter on-device language model! This model adapts on-the-fly for everyday tasks, supposedly doesn't use private data in training, and has 0.6ms token latency on iOS. Outperforms GPT-3.5 and Mistral 7B. Impressive for v1. https://machinelearning.apple.c…

• @kepano @kepano on x

  More details from Apple about Private Cloud — they basically made cloud compute out of iPhones unclear if your “semantic index” gets synced to this infrastructure, and/or if this a glimpse at what will eventually be used to replace the ChatGPT band-aid [image]

• @harper @harper on x

  this is a fascinating set of graphs [image]

• @eric_seufert Eric Seufert on x

  Helpful thread about Apple's Private Cloud Compute (PCC) system that was announced today at WWDC. PCC will process AI tasks that are too complex to be handled on-device.

• @matthew_d_green Matthew Green on x

  In any case, this is the world we're moving to. Your phone might seem to be in your pocket, but a part of it lives 2,000 miles away in a data center. As security folks we probably need to get used to that fact, and do the best we can to make sure all parts are secure. //fin

• @simonw Simon Willison on x

  @sansyrox They've published details of their local AI model now, it looks like the on-device LLM is a 3B model that's optimized for summaries and rephrasing, not for Q&A against knowledge stored in the model https://machinelearning.apple.com/ ...

• @svpino @svpino on x

  Many people are mocking Apple's “Private Cloud Compute” as any other cloud service with the same guarantees and privacy concerns. Please, read a bit before you make yourself a clown before everyone else. Some notes about Apple's Private Cloud Compute: 1. Apple can't access

• @benbajarin Ben Bajarin on x

  Good details here on Apple's foundational models. https://machinelearning.apple.com/ ...

• @lukolejnik Lukasz Olejnik on x

  Apple AI announcement is interesting. In this thread, I analyze the security and privacy of Private Cloud Compute (PCC). Preliminary summary: trust is necessary. It is not pure on-device processing. Transparency is unclear now. [image]

• @jillrgunter Jill Gunter on x

  Everybody wanna have hot takes on Apple x OpenAI. Few want to read beneath the fold. https://machinelearning.apple.com/ ...

• r/singularity r on reddit

  Introducing Apple's On-Device and Server Foundation Models

• @gwestr Greg Wester on threads

  This is next level

• @bitinn@mastodon.gamedev.place David Frank on mastodon

  I think the key part I am curious about Apple Intelligence is how they will make it a “verifiable privacy promise”.  —  So far no company has managed to do that.  I don't think verifying some server code (which obviously doesn't include the model itself) will be sufficient. …

• @justindross JD Ross on x

  Apple using Apple Silicon in its own data centers (not nVidia chips) to power Apple Intelligence Very interesting, and getting little attention so far

• @elonmusk Elon Musk on x

  @matthew_d_green This is essential

• @matthew_d_green Matthew Green on x

  As best I can tell, Apple does not have explicit plans to announce when your data is going off-device for to Private Compute. You won't opt into this, you won't necessarily even be told it's happening. It will just happen. Magically. I don't love that part. 17/

• @matthew_d_green Matthew Green on x

  So Apple has introduced a new system called “Private Cloud Compute” that allows your phone to offload complex (typically AI) tasks to specialized secure devices in the cloud. I'm still trying to work out what I think about this. So here's a thread. 1/

• @radian Ivan Krstić on x

  🔺New on the Apple Security Research blog: introducing Private Cloud Compute! We believe this is the most advanced security architecture ever deployed for cloud AI compute at scale. https://security.apple.com/...

• @matthew_d_green Matthew Green on x

  The problem is that while modern phone “neural” hardware is improving, it's not improving fast enough to take advantage of all the crazy features Silicon Valley wants from modern AI, including generative AI and its ilk. This fundamentally requires servers. 3/

• @matthew_d_green Matthew Green on x

  TL;DR: it is not easy. Building trustworthy computers is literally the hardest problem in computer security. Honestly it's almost the only problem in computer security. But while it remains a challenging problem, we've made a lot of advances. Apple is using almost all of them. 6/

• @simonw Simon Willison on x

  Here's a whole lot more detail on the Private Cloud Compute system and WOW that really is some cutting edge computer science! https://security.apple.com/...

• @mysk_co @mysk_co on x

  I'm reading Apple's blogpost on Private Cloud Compute, their new cloud-based environment and infrastructure for running Apple Intelligence LLM models, and this paragraph really stood out: “Private Cloud Compute hardware security starts at manufacturing, where we inventory and

• @matthew_d_green Matthew Green on x

  Finally, there are so many invisible sharp edges that could exist in a system like this. Hardware flaws. Issues with the cryptographic attenuation framework. Clever software exploits. Many of these will be hard for security researchers to detect. That worries me too. 18/

• @bilawalsidhu Bilawal Sidhu on x

  Ok I take it back. Apple's ‘Private Cloud Computing’ actually takes ‘Confidential Computing’ to the next level. It's SO secure that they can't even comply with law enforcement requests. > No data retention (unlike every other cloud provider) > No privileged access (even Apple [im…

• @matthew_d_green Matthew Green on x

  But if you send your tasks out to servers in “the cloud” (god using quotes makes me feel 80), this means sending incredibly private data off your phone and out over the Internet. That exposes you to spying, hacking, and the data hungry business model of Silicon Valley. 4/

• @matthew_d_green Matthew Green on x

  The solution Apple has come up with is to try to build secure and trustworthy hardware in their own data centers. Your phone can then “outsource” heavy tasks to this hardware. Seems easy, right? Well: here's the blog post. https://security.apple.com/... 5/

• @sweis Steve Weis on x

  Apple announced a Private Cloud Compute using RSA blind signatures for pseudonymized access, publishing all software images for research, and publishing a transparency log of all running, attested code: https://security.apple.com/...

• @benedictevans Benedict Evans on threads

  Why would anyone have thought that all of Apple's new LLM features would be powered by Open AI (or Gemini) when Apple has been publishing papers about its own models, to run on its own devices and silicon, for most of the this year, if not longer?

• @panzer @panzer on threads

  Apple Intelligence castling “AI” is going to go down as one of the most diabolically slick marketing moves of all time.

• @eric.young310 Eric Young on threads

  I think the best way I'd describe what Apple announced today was that Apple brought AI to the GUI world Like they did with the Mac from command line days AI before Apple, was a command prompt that users would enter an infinite and arbitrary request... and the AI would perform App…

• @mgsiegler M.G. Siegler on threads

  Interesting that it doesn't sound like Apple is going to have a way to upsell to the premium version of ChatGPT.  You can use it, but it's bring your own?  WWDC24

• @parkert Parker Thompson on threads

  Makes sense.  They can push on-device “free” features, OpenAI can pay for lead gen in return for making iOS a bit better, and power users can pay for 3rd party subscriptions.  Then later they can just turn down/off that traffic as they want to own more of that experience (maybe w…

• @sama Sam Altman on x

  very happy to be partnering with apple to integrate chatgpt into their devices later this year! think you will really like it.

• @gdb Greg Brockman on x

  We're partnering with Apple to integrate ChatGPT right into iOS, iPadOS, and macOS. Will be available later this year, very excited!

• @elder_plinius @elder_plinius on x

  HOLY MOLY @APPLE IS MAKING IT RAIN ATTACK VECTORS 💦 I DON'T KNOW WHAT TO DO WITH MY HANDS 🫨

• @bindureddy Bindu Reddy on x

  Honestly, I don't understand why Apple has to send anything to ChatGPT? It's just bizarre. Why not just get Meta to give them a license and host the 400B Llama? Starting with 70B is fine... They are so hung up on privacy and security and even alleged that you shouldn't trust [ima…

• @simonw Simon Willison on x

  Some of the backlash I'm seeing against Apple AI is reinforcing my opinion: The hardest problem in computer science continues to be convincing an AI skeptic that you're not going to steal their data and train an AI model on it

• @mingchikuo @mingchikuo on x

  There's a lot to discuss about Apple Intelligence, and let's start with a quick overview. Apple Intelligence fully showcases Apple's strengths in ecosystem integration and interface design, mainly emphasizing convenience (through in-app & between-app integration) and enhancing

• @mikebutcher Mike Butcher on x

  The upshot of Apple's announcements from a security expert: part of your phone now lives 2,000 miles away in a data center. [Edit: Apple is having to jump through a LOT of hoops so as not to turn your private queries of AI services into training data for OpenAI.]

• @johnwilson @johnwilson on x

  Apple Intelligence will also put pressure on automakers to keep supporting CarPlay. Some have started supporting ChatGPT directly, but I don't think they will be the dominant path.

• @sullyomarr @sullyomarr on x

  The apple event was great. They focused on the important things that consumers care about (privacy, easy to use etc) If anyone else had launched an on device, OS level LLM this place would of lost their mind Were the emojis cringe? Sure. Everything else was exciting

• @jessicalessin Jessica Lessin on x

  The legacy of today's Apple news will be that AI is a feature not a product.

• @carnage4life Dare Obasanjo on x

  Apple is a company that believes very deeply in creating a narrative about how technology makes people's lives richer and then builds products that match that narrative. Google is good at shipping technology while Microsoft is good at creating such narratives for CIOs & CTOs.

• @markgurman Mark Gurman on x

  Apple needs to put 25% of the vigor into iPadOS that it just put into Apple Intelligence because this is getting ridiculous. The iPad Pro gets incredible new hardware and an M4 chip and then iPadOS essentially gets nothing of substance.

• @simonw Simon Willison on x

  Their on-device language model was apparently trained on “licensed data, including data selected to enhance specific features, as well as publicly available data collected by our web-crawler, AppleBot” https://machinelearning.apple.com/ ...

• @emollick Ethan Mollick on x

  I wonder how much Apple AI is going to cause people to underestimate LLMs A 3B quantized model running on local silicon will be good for some stuff but not agentic reasoning. The cloud model doesn't seem to maintain state or history & isn't frontier. Is GPT-4 just for questions?

• @simonw Simon Willison on x

  Have Apple made any statements specifically about the training data they used for their new on-device image generation model? They licensed a ton of images a few months ago: Apple Signs Deal For AI Training Data from Image Service Shutterstock https://www.inc.com/...

• @simonw Simon Willison on x

  I think the product design instincts Apple displayed here are extraordinary Every single person involved appears to have had a deep understanding of AI ethics and privacy, and a hyper-realistic understanding of what these models are capable of and what responsible AI looks like

• @snazzylabs @snazzylabs on x

  I want to know the percentage of Apple employees that are—quietly—deeply disgusted by the image and text generation features shown off today.

• @diegousdz Diego Aguirre on x

  @elder_plinius @Apple Hey what is your stake of Apple Intelligence how difficult do you think it is to bypass his security and reverse engineer the tech to tell you every single detail from user?

• @simonw Simon Willison on x

  ... though I'll reserve full judgement until I see how well they have designed against the threat of prompt injection!

• @ianzelbo Ian Zelbo on x

  RIP Grammarly

• @altryne Alex Volkov on x

  is this a reaction to Apple not going with Grok? Because that's not what apple announced today 🤔 They said that they will support other models when on device is not cutting it, and announced a partnership with OpenAI

• @elder_plinius @elder_plinius on x

  @DiegoUSDZ @Apple time will tell! bold move integrating to this extent, given the current state of llm security

• @simonw Simon Willison on x

  Was Apple's emphasis today that they were running their Private Cloud Compute AI accelerators on Apple Silicon a veiled dig at NVIDIA?

• @kelseyhightower Kelsey Hightower on x

  Apple Intelligence might have me switching back to Apple's native apps such as Mail, Calendar, and Pages.

• @dylanmcd8 Dylan on x

  I must say, Apple Intelligence is another example of Apple doing what they do: being a little late to the game, but them absolutely blowing everyone else out of the water. Apple Intelligence is incredible and so exciting. [image]

• @javi @javi on x

  Apple's ability to tell a clear story about how they will help normal people like you get stuff done is night and day compared to Google.

• @snazzylabs @snazzylabs on x

  @elonmusk @MKBHD Apple doesn't hand over any data; you do, as the user, explicitly. Every time. But that would require you to spend 35 seconds researching before going on a temper-tantrum tirade.

• @stevesi Steven Sinofsky on x

  The contrast between what Apple is showing and what Google and Microsoft have shown is a stark as ever. This is really important. Apple brings their point of view to the newest technologies, again.

• @samfbiddle Sam Biddle on x

  Pretty bleak to me that Apple envisions a Journalism and Mass Communication major, of all people, using an iOS LLM to write their emails for them. [image]

• @mkbhd Marques Brownlee on x

  Basic summary of Apple Intelligence so far: On-device large language and diffusion models that deliver helpful features across iPhone and other devices with on-device symantic index that can bring in information across your devices and apps Private cloud compute allows it to draw…

• @kelseyhightower Kelsey Hightower on x

  Apple Private Cloud! I always thought Apple would do something like this. I thought the use case would be serverless compute to support mobile applications but these ML use cases make more sense.

• @benbajarin Ben Bajarin on x

  In our post WWDC QA, Apple confirming they built a host of their own foundational models and used a host of licensed content to train and fine tune their models. Essentially 99% of Apple Intelligence is powered by Apple's own proprietary FMs.

• @benbajarin Ben Bajarin on x

  Apple making some points about Apple Secure Cloud being 100% Apple's own data centers (not hosted at a hyper scaler), powered by Apple Silicon, 100% powered by renewable energy.

• @kantrowitz Alex Kantrowitz on x

  This is why we need AI [Image: Play the podcast that my wife sent the other day]

• @autismcapital @autismcapital on x

  Imagine texting your mom an AI photo of her looking terrified. [image]

• @karpathy Andrej Karpathy on x

  Actually, really liked the Apple Intelligence announcement.  It must be a very exciting time at Apple as they layer AI on top of the entire OS.  A few of the major themes.  Step 1 Multimodal I/O. Enable text/audio/image/video capability, both read and write.  These are the native…

• @hshaban Hamza Shaban on x

  Another interpretation of Apple Intelligence = more elaborate forms of green bubble shaming

• @stevesi Steven Sinofsky on x

  Excellent. Today was super high on “vision” for Apple with tons of future tense. At the same time their strong point of view is abundantly clear. This is not just privacy and on device, but how they see integration at the platform level. The idea for example of building on top of

• @zollotech Aaron Zollo on x

  Apple Intelligence Compatible devices. [image]

• @deliprao @deliprao on x

  coming out of my self-imposed social media break to observe a moment of silence to mourn for thousands of consumer gen AI builders and their investors who did not listen to me. sorry to be that guy but the beatings will continue until the morale is improved.

• @petersterne Peter Sterne on x

  It is impossible to overstate how much this will improve journalists' lives. https://www.theverge.com/... [image]

• @snazzylabs @snazzylabs on x

  yyyyyyyyyyyyyyyyyyyikes don't like that [Mom in cape genmoji]

• @munster_gene Gene Munster on x

  Apple Intelligence's critical advantage is the personalization. They can use your personal data without giving it to the cloud. The personalization is done on device. Something only Apple can delivery. From a feature perspective you can use generative AI in Mail, Messages,

• @gartenberg Michael Gartenberg on x

  Apple Intelligence is free... next word is but

• @maxwinebach Max Weinbach on x

  Language, Images, Action, Personal Context The LLMs in Apple Intelligence will now prioritize notifications based on what's important New writing tools system wide to rewrite, proofread, and summarize. Automatically available everywhere

• @loudmouthjulia Julia Alexander on x

  Apple Intelligence: most of these features will likely be less good than individual AI applications and LLMs from competitors, but the fact that it's in one device and touches all parts of the ecosystem on widely available phones is a major AI experimentation and adoption moment.

• @emostaque Emad on x

  Hey @google, some free branding for you Awesome Google Intelligence Get that AGI inside

• @munster_gene Gene Munster on x

  They're making it clear that Apple Intelligence is personalized, which means it is trained on your data. Because of Apple's position on privacy, I believe consumers will be ok with the model training.

• @richontech Rich DeMuro on x

  Did Apple really just say you'll only be able to get Apple Intelligence on the iPhone 15 Pro and later?

• @autismcapital @autismcapital on x

  The logical conclusion of this Apple Intelligence is to just create an artificial instance of ourselves that lives a whole life automated and independent of us. Wait — but then what would be the point of us existing? Uh oh!

• @mgsiegler M.G. Siegler on x

  “AI for the rest of us” is the first time they've said “AI” I think?! #wwdc24

• @alexstyl Alex Styl on x

  Did Apple just invent Android's Intents API?

• @zollotech Aaron Zollo on x

  Apple has a new webpage just for Apple Intelligence. https://www.apple.com/...

• @panzer @panzer on x

  Apple Intelligence castling “AI” is going to go down as one of the most diabolically slick marketing moves of all time.

• @mgsiegler M.G. Siegler on x

  Undoubtedly hard to read into it THIS closely, but Wall Street still digesting. Seemed to hate it at first. Then started to warm up with iOS. Then really not like the obvious AI announcements until the OpenAI partnership was announced. But even that not enough so far... #WWDC24 […

• @eric_seufert Eric Seufert on x

  It seems that Apple discarded the “Web Eraser” tool visible in the iOS 18 developer version of Safari that potentially could have been used as an ad blocker.

• @stevesi Steven Sinofsky on x

  “AI for the rest of us” This was awesome. It is a lot of vision. So much of this will be available later. It isn't worth making a list of the specifics in this presentation to track to this summer beta. Instead what matters is the direction and overall framework/pillars.

• @dariuszdziuk Dariusz Dziuk on x

  This is exactly the integration everyone thought Apple will do, nicely executed. If it works well they will own a big LLM powered AI marketshare given their distribution. But that ChatGPT button is anything but “seamless.” #wwdc2024

• @loudmouthjulia Julia Alexander on x

  Which isn't to say Apple wins or that genAI is actually where the hype thinks it is. The overall presentation was meh — but the opportunity Apple has from a central hardware and ecosystem perspective, and access to top developers, will be a momentous next step for potential usage

• @maxwinebach Max Weinbach on x

  “AI for the rest of us”

• @stevesi Steven Sinofsky on x

  This is why it is so important to use the native capabilities of an OS. Use text view and just pick up all these features. Cross platform means you fall behind right away. [image]

• @benbajarin Ben Bajarin on x

  Apple frames Apple Intelligence as AI for the rest of us. Very Apple way to say it.

• @austen Austen Allred on x

  Apple Intelligence but for connecting my Airpods to the right device

• @mattbinder Matt Binder on x

  Apple is announcing its AI product “Apple Intelligence” and gave an example of how you can wish you friend Happy Birthday with an AI generated image of them then they threw this up on the screen why would i do my friend dirty like this on her birthday [image]

• @adamsinger Adam Singer on x

  Apple intelligence is going to help you figure out how to get to the airport on time. Because you're a complete moron and couldn't do that before

• @ijustine @ijustine on x

  For more AI processing power that can't be done on device Apple created specific servers with privacy at top of mind called Private Cloud Compute. [video]

• @benbajarin Ben Bajarin on x

  Federighi, just prior to showing the ChatGPT integration said “we want you to access external models” which makes it sound like most of Apple Intelligence is powered by Apple's own proprietary models. Seems GPT is just for web searches and composing fresh writing.

• @zollotech Aaron Zollo on x

  Apple Intelligence - Capabilities - Create images in 3 styles when sending in messages and other apps - Understands what you are doing to find what you're looking for Architecture - On device - Private Cloud Compute [image]

• @snazzylabs @snazzylabs on x

  Apple is promising the same crap Humane and Rabbit have promised, except, I think Apple Intelligence will actually mostly work.

• @jon_prosser Jon Prosser on x

  APPLE INTELLIGENCE IS ON-DEVICE PROCESSING?! WTF BROOOOO WHAT HOLY SHITT

• @jetscott Scott Stein on x

  Apple AI-generated memory albums... [video]

• @panzer @panzer on x

  hooooooo boy [image]

• @zollotech Aaron Zollo on x

  More about Apple Intelligence - Rewrite to get suggestions - Proofread with suggested edits - Summarize key points - New Smart Reply Suggestions in Mail - Email Summaries based on email content - Priority Notifications on Lock Screen - New Reduce Interruptions Focus [image]

• @vadimyuryev Vadim Yuryev on x

  Apple Intelligence in iOS 18 can rewrite, proofread, and summarize text system-wide. RIP Grammarly! #wwdc24 [image]

• @trungtphan Trung Phan on x

  The AI industry competitive landscape after Apple launches Apple Intelligence [image]

• @autismcapital @autismcapital on x

  So Apple Intelligence basically reads every single aspect of your life and sends it to Apple. Got it.

• @vadimyuryev Vadim Yuryev on x

  Honestly, Apple Intelligence is WAY better than CoPilot+ #wwdc24 [image]

• @vadimyuryev Vadim Yuryev on x

  HOLY SMOKES! You can rewrite your email in different tones with Apple Intelligence!!! And it works system-wide, even third party apps!! This is by far the BEST feature in iOS 18 and all the other softwares! #wwdc24 [image]

• @raywongy Ray Wong on x

  Apple really demoing how Apple Intelligence can help write an email for someone from a “Dept of Journalism and Mass Communication 2024” Bruhhhh #wwdc [image]

• @ijustine @ijustine on x

  Personal context is key to Apple Intelligence with on device processing keeping your data private. I love this example of cross referencing all these different things on your device to get the info you're looking for. #WWDC [video]

• @ijustine @ijustine on x

  Apple Intelligence using image generation and your personal context. Haha I can't wait to make images of all my friends. No one is safe! #WWDC [video]

• @snazzylabs @snazzylabs on x

  It's weird how awesome and terrible this is at the same time. Some features (like hyper-specific image search) are AMAZING! And others are... unsettling and depressing.

• @loudmouthjulia Julia Alexander on x

  I don't know man, I feel like all these AI-prompted images is just reiterating how important it is that we financially support real artists so we can have art that doesn't look like the same image in different shades defining what we look at every day, like, 20 years from now.

• @petersterne Peter Sterne on x

  Apple's implementation of AI seems really good. Summarizing notifications, proofreading emails and creating custom emoji all seem more useful and easy to use than just something like ChatGPT.

• @keshav_027 Keshav on x

  Apple has avoided the usage of “AI” but obliterated so many “AI” startups. Of course Apple incorporates AI across their ecosystem!

• @minimaxir Max Woolf on x

  “No need to engineer the prompt.” PROMPT ENGINEERING IS NOW MAINSTREAM

• @maxwinebach Max Weinbach on x

  Apple was never behind on AI, were they? This kills any other consumer AI product right now

• @manukumar Dr. Manu Kumar on x

  The economic value of AI will accrue mainly to the incumbents.

• @migueldeicaza Miguel de Icaza on x

  I am surprise that Google and Gmail did not do any of the features Apple just showed for Email.

• @stevesi Steven Sinofsky on x

  This integration is so exactly right. It shows that a “chat app” was a short term “demo” UI. Combine that with all the context on the OS and the privacy and this is all how AI can really come to life the right way.

• @eric_seufert Eric Seufert on x

  Writing Tools for App Intelligence address a core Grammarly use case.

• @chrissaad Chris Saad on x

  Answer wizard in email replies - sweet! #WWDC

• @mattlynley Matthew Lynley on x

  semantic index sounds a whole lot like a vector database tbh

• @stevesi Steven Sinofsky on x

  “over the next year” will get mocked (Apple “doesn't do that") but the architecture is right from the start and they won't need to back in. Much of this is clearly aspirational or early plans.

• @mgsiegler M.G. Siegler on x

  “Over the next year” Apple is finally fully shipping in iteration. #WWDC24

• @eric_seufert Eric Seufert on x

  Apple confirms that it will use servers to process certain AI tasks. The device determines whether the device is capable of processing a task and sends data to its “Private Cloud Compute” servers if it can't.

• @kelseyhightower Kelsey Hightower on x

  Apple is reading the room on AI/ML. Personal context is how I want to think about my data. The last thing I want to do is send my data anywhere.

• @benbajarin Ben Bajarin on x

  Apple device experience deepens in value the more Apple devices you use. Apple Intelligence will only deepen this and make the strongest case ever for customers to invest in more of the Apple ecosystem. Average devices per customers is just shy of 1.5 so a lot of upside here.

• @raywongy Ray Wong on x

  Craig is dunking on “AI clouds” and saying how Apple Intelligence uses on-device processing for privacy #wwdc [image]

• @anshelsag Anshel Sag on x

  This is a total no-brainer feature, customer support and user manuals are already saving big companies TONS of money. Just helping people use their iPhones and solve problems. #WWDC [image]

• @lexnfx Alexei Oreskovic on x

  the “original intelligent assistant”

• @stevesi Steven Sinofsky on x

  Exactly right.  This is how to add a semantic index and LLMs to a platform.  [Slide from presentation: “  • Your data is never stored  • Used only for your requests  • Verifiable privacy promise “]

• @dnvrsn Denver Sean on x

  CAVEAT! sometimes a request might require a larger generative model to achieve something (a cloud) — so for those tasks they've created Private Cloud Compute. [image]

• @munster_gene Gene Munster on x

  Apple is hitting Privacy hard. New Private Cloud Compute allows you do more advanced personalized AI with privacy in the cloud. Privacy and personalization is Apple's differentiator.

• @hopeking Hope King on x

  The moment Tim Cook uttered ‘artificial intelligence’ on the #WWDC YouTube livestream [image]

• @benbajarin Ben Bajarin on x

  Entirely as expected, Apple is leaning heavily into their privacy efforts/standards as it relates to how they implement Apple Intelligence.

• @mgsiegler M.G. Siegler on x

  Um, 3 whole styles for images. That will get old, fast. But I suppose limit IP/copying concerns? #WWDC24

• @benbajarin Ben Bajarin on x

  Apple Intelligence focusing on actions, assumes an underlying contextual action model.

• @simonw Simon Willison on x

  I wrote up some initial thoughts on the Apple Intelligence announcements from WWDC this morning https://simonwillison.net/...

• @minimaxir Max Woolf on x

  The workaround to this will likely be “prompt engineer harder.” [image]

• @simonw Simon Willison on x

  On-device models that can outsource to Apple's servers with cryptographic guarantees of privacy are really interesting. I can't wait to see how this works, which I expect to be published since the expert auditing is the whole point! Quoting from the keynote: [image]

• @carnage4life Dare Obasanjo on x

  With its WWDC announcements, Apple has gone from behind in AI to the industry leader. I'm struck by how the deep and thoughtful integration of AI in iOS makes the efforts from Microsoft and Google to build “AI PCs” look like gimmicks and bandwagon jumping https://simonwillison.ne…

• @robertyoder Robert Yoder on threads

  I knew it would happen and yet I'm still annoyed.  You just shut out so many customers. iPhone 14 Pro has the same number of cores and neural engine cores.  Literally a 0.3GHz slower processor.  We all know you do this on purpose, but this one stung more.

• @mishaalrahman Mishaal Rahman on x

  Google got a LOT of criticism for not supporting Gemini Nano on the Pixel 8 at launch. People were even using it as “evidence” that Google's 7 years of update pledge was already broken. Though Google later backtracked, the reason they skipped the device was due to its lower [imag…

• @bengeskin Ben Geskin on x

  Apple Vision Pro must have Apple Intelligence and iPhone mirroring❗️ #WWDC24

• @emollick Ethan Mollick on x

  Apple AI on device is equivalent to other tiny models. Apple AI Server is equivalent to GPT-3.5ish Frontier models they are not, but will still give you supercharged Siri & okay-ish writing help. I don't think this has much to do with high-end use cases. https://machinelearning.a…

• @munster_gene Gene Munster on x

  Finally, a new Siri, the interface of Apple Intelligence. They are keeping the name and changing the look. It now allows more natural language and follows the conversation.

• @maxwinebach Max Weinbach on x

  Siri now has a new look, no more orb just a glowing light around the display. Siri knows what you mean even if you mess up your words or mess up and correct yourself. It's... actually smart?

• @maxwinebach Max Weinbach on x

  Siri now knows about basically all Apple Products Now you don't have to be tech support for family, it knows and will help

• @tolmasky Francisco Tolmasky on x

  Most people are hoping AI will make Siri better, but personally I'm hoping generative AI will give us a more lifelike Tim Cook that will finally push him out of the uncanny valley. #wwdc24

• @mgsiegler M.G. Siegler on x

  Type-to-Siri, at last. #WWDC24

• @richontech Rich DeMuro on x

  Siri is now the worlds best tech support assistance for Apple Products [video]

• @maxwinebach Max Weinbach on x

  Siri can now find the photo of your licence, find your ID number, then input it when needed in a form Wild

• @munster_gene Gene Munster on x

  Developers will use the App Intents framework that tap into the new Siri.

• @_danielsinclair Daniel Sinclair on x

  The Apple Intelligence design style is a bit of a miss. The new Siri prompt animation is beautiful, but these AI prompts are almost identical to Meta AI. Quite obviously rushed. [image]

• @_danielsinclair Daniel Sinclair on x

  Apple only lists Siri actions with Apple's own ecosystem apps here when mentioning the App Intents upgrades, with exception of sending an email via Superhuman. That's not a great indicator, because App Intents types are very limiting for devs, & a yearly update cycle won't cut it…

• @benbajarin Ben Bajarin on x

  Type to Siri! Finally! Been asking Apple for this for many years!

• @mgsiegler M.G. Siegler on x

  I think I like the new Siri icon/brand, but it also sort of looks like a ninja. A very colorful ninja. #wwdc24

• @maxwinebach Max Weinbach on x

  “Siri when is my mom's flight landing” it knows her flight based on email then says “what's our lunch plan” it brings it up because it was mentioned over a text “how long will it take us to get there from the airport” knows and then does it automatically that's huge

• @nickadobos Nick Dobos on x

  Every app on the AppStore is now a LLm tool App intents means Siri can orchestrate EVERYTHING

• @packym Packy McCormick on x

  Amazing to see that the #1 use case for Siri is still checking the weather.

• @zollotech Aaron Zollo on x

  Siri - New animation - Understands context and if you made a mistake - understands context of what you were talking about before - Type to Siri - Can answer how to do something on your device - On-Screen Awareness - Can take action within apps based on context or request [image]

• @richontech Rich DeMuro on x

  Whereas Siri used to be promoted as an easy way to make a call to your Mom, Siri with AI is now being promoted as a way to save you from having to actually call your Mom [video]

• @sdw Sebastiaan de With on x

  Gorgeous new Siri effect. [video]

• @zollotech Aaron Zollo on x

  Siri has a new Look and can understand natural language even with mistakes [image]

• @panzer @panzer on x

  Siri with Personal Context is essentially the basic premise of about 40% of AI startups from the past 3 years. [image]

• @stalman Tyler Stalman on x

  This Siri demo is probably the most useful AI use case I've seen [video]

• @vadimyuryev Vadim Yuryev on x

  Siri just went from trash to top-tier voice assistant. Can't wait to try this! Siri can now take hundreds of actions inside of your apps! #wwdc24 [image]

• @mkbhd Marques Brownlee on x

  Now we get to the big Siri update [image]

• @shauseth Shaurya on x

  siri ask mom to pick me up from my location [image]

• @hshaban Hamza Shaban on x

  What struck me was the attempt, at every turn, to show how the AI tools would actually help you in your daily life. This had the affect of making Apple's effort seem like a beefed up Siri. But by clearly defining its uses, Apple made rival efforts seem absurd and far fetched

• @marvinvonhagen Marvin von Hagen on x

  some very cool stuff, but also super disappointing that siri is not powered by an omnimodel - it's still just siri

• @ijustine @ijustine on x

  New Siri updates look great.. being able to actually take action inside and across various apps. #WWDC [video]

• @rowancheung Rowan Cheung on x

  1B+ users just got an AI agent in their pocket with iOS 18. Apple just announced ‘Apple Intelligence’ that allows Siri to understand icons, widgets, and text on a screen and take actions via apps. You can ask Siri to summarize notifications, texts and emails, meeting notes, [vide…

• @eric_seufert Eric Seufert on x

  Siri will allow for deeper cross-app integration with improvements to App Intents.

• @kelseyhightower Kelsey Hightower on x

  Innovation without UX is just a bunch of features.

• @chrissaad Chris Saad on x

  Ok Siri is cool now. Inferences from all your personal data across apps. Gimme Gimme. #WWDC

• @saschasegan Sascha Segan on x

  Siri appears to me here to be uploading very sensitive personal data to cloud models with all of these sample requests, but Apple is banking on you trusting their cloud.

• @nirave @nirave on x

  I am ridiculously excited about the new Siri. It's just become a must-try AI assistant. #WWDC [image]

• @film_girl Christina Warren on x

  lol. Siri is going to give us a LAM before @rabbit_hmi #wwdc24

• @ianzelbo Ian Zelbo on x

  Is Siri... good now?

• @om @om on x

  But will Siri understand accents that are not “American?” #wwdc

• @jamesm James on x

  The new Siri glow around the edge of the screen is perfect.

• @panzer @panzer on x

  Siri not dead. That full screen border glow is hot. [image]

• @joannastern Joanna Stern on x

  You can now type to Siri in iOS 18. [image]

• @jowyang Jeremiah Owyang on x

  This is the new Siri. [image]

• @richontech Rich DeMuro on x

  Consumers make 1.5 billion Siri requests each day. [image]

• @benbajarin Ben Bajarin on x

  Apple framing their AI efforts as “personal intelligence” is how I've always framed the end goal of Siri and an underlying anticipation engine. Let's see how it gets integrated!