Microsoft unveils Copilot Vision, which analyzes text and images on webpages, Think Deeper, which reasons through more complex problems, Copilot Voice, and more
5 new features that are coming Dina Bass / Bloomberg : Microsoft Adds Voice, Vision Features to Consumer AI Assistant Will Knight / Wired : Microsoft's Copilot AI Gets a Voice, Vision, and a ‘Hype Man’ Persona Tom Warren / The Verge : Microsoft says it will start rolling out Click to Do, akin to Google's Circle to Search, and AI-enhanced Windows search improvements for Copilot+ PCs next month Kyle Wiggers / TechCrunch : Microsoft begins rolling out Bing Generative Search, its answer to Google's AI Overviews, to all US users, underpinned by a mix of AI models Devindra Hardawar / Engadget : Microsoft's new Windows 11 update adds generative AI-based fill and erase options to Paint and up to 8x picture resolution upscaling to Photos, for Copilot+ PCs X: Mustafa Suleyman / @mustafasuleyman : Today we're launching our new Copilot experience. I truly believe we can deliver a calmer, more helpful and supportive era of technology, with a Copilot that is now more intuitive, more personalized, and secure. Learn more, download, and enjoy. At Microsoft AI, we are creating [video] Satya Nadella / @satyanadella : This next phase of Copilot marks the beginning of a fundamental shift in the way we connect with technology, as we give people a more natural, conversational, and personal AI companion. Mustafa Suleyman / @mustafasuleyman : Such a great event today! Loved meeting everyone and explaining what's happening with our new Copilot. Here are a few thoughts from me. [video] @bloombergtv : “We're really moving from, what I think of as an AI tool, to an AI companion.” Microsoft EVP and Consumer Chief Marketing Officer @yusuf_i_mehdi details the next generation of their Copilot app which adds new voice and vision features https://www.bloomberg.com/... [video] @kimmonismus : Copilot vision lets the ai talk with you about everything both of you see on the screen Dominik Lukes / @techczech : I've been talking about the need for a semantic screen reader ever since vision models came out. Copilot Vision by @MicrosoftAI is the first step in that direction - small and timid step but definitely shows the future. [image] @msftcopilot : Read this blog all about the totally personalized new Copilot app. Or better yet, ask me to summarize it for you. https://blogs.microsoft.com/ ... Mark Kretschmann / @mark_k : Another AI that's not available in the EU 🇪🇺 The new Microsoft Copilot with voice Parker Ortolani / @parkerortolani : the new Copilot really doesn't feel like a Microsoft product and frankly, that's a good thing this is the best the product has looked so far and honestly, it's starting to look and feel better than vanilla ChatGPT and Gemini [image] Yusuf Mehdi / @yusuf_i_mehdi : To truly have a great AI Companion experience, you need to be able to speak with it as naturally as you would a friend or colleague. I have been using Copilot Voice for a while now and its game changing! Here is a demo: [video] Max Weinbach / @maxwinebach : Microsoft just announced a bunch of new Copilot+ experiences for Copilot+ PCs. This includes the revamped and far more secure Recall preview! For Recall, Snapdragon X Elite PCs this month, AMD/Intel next in insider builds. https://blogs.windows.com/... Andrew Curran / @andrewcurran_ : Microsoft is launching a new redesigned Copilot this morning. It incorporates the new Voice and Vision interface as well as ‘Think Deeper’ which uses Chain of Thought. The new version is more personable, and agentic. They are promising it will ultimately ‘act on your behalf’. [image] Tom Warren / @tomwarren : they fixed it, but it still refuses to answer this basic Q 😔 gonna miss my Dutch copilot 🫡 [image] Sascha Segan / @saschasegan : New Copilot+ features for your @Snapdragon powered Windows PC - including better search, better photos, and powerful contextual menus on images and text! @microsoft : Our refreshed Copilot will be more personalized with conversational interactions that create a continuous flow of understanding. Today, we're beginning to roll out the updated @MSFTCopilot with new and enhanced features. https://blogs.microsoft.com/ ... Steve Moser / @stevemoser : Whoa the new Copilot seems to match ChatGPT's advanced voice mode and it even sings. It's out now for iOS. I asked it to: - help calm my nerves - sing happy birthday to me as a cat - count to 100 without taking a breath - run a race - whisper a bedtime story Anything else I [video] @signal_65 : While @Windows is showing new Copilot+ PC features today, we at @Signal_65 worked with @Microsoft to build a set of technical lab reports looking at each silicon platform supporting Copilot+ PCs from @Qualcomm @intel and @AMD. https://signal65.com/... [image] Patrick Moorhead / @patrickmoorhead : A lot of people ask me, “what can I do differently with AI with Copilot+ PCs that I can't do with other PCs”. That answer got considerable easier with today's Microsoft announcements. I saw these demos, and I have to say, I'm impressed. These AI features are for everybody Yusuf Mehdi / @yusuf_i_mehdi : Copilot Vision is a new capability that lets you surf the web with your AI Companion so it can see what you see in your Edge browser and assist you in magical ways. Available to Copilot Pro subscribers via Copilot Labs, give it a try! [video] Nando de Freitas / @nandodf : I love the idea of calm, helpful and supportive AI. I like the long-term vision of designing fun AI tools to empower us to be more aware, better informed, and more knowledgeable. Tools that support us and expand what we can do when pursuing meaningful goals for us, our Dina Bass / @dinabass : so it's fluent in Pulp Fiction and Dutch is what you're telling me? Jez / @jezcorden : billions of tons of extra carbon per year so an AI can judge your porn habits, nice Satya Nadella / @satyanadella : We're introducing new AI-powered experiences for Copilot+ PCs that help streamline daily tasks and tackle complex challenges. Grady Booch / @grady_booch : CoPilot does not “think”; it calculates. Hey @TechCrunchPlus, please stop anthropomorphizing AI. https://techcrunch.com/... @tsarnick : Microsoft Copilot Vision can see what you see on your computer and can discuss both text and images with Voice [video] Steve Moser / @stevemoser : The new Microsoft Copilot is interesting in that it seemingly has more personality than ChatGPT. Also being able to use Voice and Visual feeds at the same time looks incredible. [video] Tom Warren / @tomwarren : Microsoft's Copilot integration into WhatsApp is going well 🥲 [image] @microsoftedge : The all-new Copilot experience is coming to Edge, which kinda makes us an all-new Edge too. We're excited. Read more in the blog ⬇️ https://blogs.microsoft.com/ ... Zac Bowden / @zacbowden : Copilot Vision is easily the craziest/weirdest new feature being announced today. When enabled, Copilot can see the same webpages you do, and chat with you about them! https://www.windowscentral.com/ ... [video] Daniel Rubino / @daniel_rubino : Microsoft's Copilot is getting a major overhaul with a new user experience, features, voice capabilities, and more. “Quite unlike anything we've seen before.” And it's available today. BREAKING Story: https://www.windowscentral.com/ ... #AI #Copilot @msftcopilot : The new Copilot app is like talking to your dog, except what it says back isn't just in your head. https://blogs.microsoft.com/ ... [video] Yusuf Mehdi / @yusuf_i_mehdi : Today, we introduced a refreshed personal Copilot, your AI Companion, and significant updates to Copilot+ PCs. With incredible new Voice, Vision, and the ability to Think Deeper, we're achieving AI experiences that are truly more personal, and trusted 👇 [video] Patrick Moorhead / @patrickmoorhead : The new Copilot experience update is huge. I will take some time to get through all the content, but it appears to be more like the AI assistant we always envisioned. Voice and vision, with what looks like a simpler interface and more personalization. I'm most excited about Vision and Personalized Discover if it's really personalized. The Vision restrictions aren't clear to me yet, but will as I start using it. Forums: r/bing : New content coming to copilot r/technews : Microsoft Copilot can now read your screen, think deeply, and speak aloud to you | TechCrunch r/technology : Microsoft Copilot can now read your screen, think deeply, and speak aloud to you r/singularity : An AI companion for everyone - The Official Microsoft Blog
Context & Ripple Effects
Microsoft had already positioned Copilot inside productivity software through its plan to bring GPT-4 to Microsoft 365 apps, including Word, Outlook, Excel and PowerPoint; that Microsoft 365 Copilot expansion established the assistant as more than a standalone chat interface.
This refresh extends that approach into the browser, voice interaction, search and Windows. It also follows Microsoft’s earlier commitment to a shared plugin standard with ChatGPT, signaling an effort to make Copilot a broader interaction layer rather than a single product feature.
First-order effects
- Copilot Pro subscribers gain early access to Vision through Copilot Labs, letting the assistant discuss webpage text and images in Edge; Copilot Voice adds a spoken interaction mode, with early availability reported on iOS.
- Microsoft is pairing the assistant refresh with planned Click to Do and AI-enhanced Windows search features for Copilot+ PCs, while rolling Bing Generative Search out to U.S. users.
Second-order effects
- Edge and Copilot+ PCs become more important distribution surfaces for Microsoft’s AI experience, because Vision and Windows actions depend on close browser and operating-system integration.
- Google and other assistant providers face pressure to match a combined browser, voice, visual-understanding and search workflow rather than competing on chat responses alone.
Third-order effects
- If these capabilities become routine, consumer AI competition will shift toward assistants that can act across the screen, browser and operating system—the practical work surface where users already spend time.
- That integration also makes governance of what an assistant can see, retain and act on a more central product constraint, especially as voice and visual context become default inputs.
The trend: This is one step in the shift from standalone chatbots to multimodal assistants embedded across the browser, search and operating system.