Anthropic releases a new Claude 3.5 Sonnet model that can interact with desktop apps by imitating mouse and keyboard input via a “computer use” API, now in beta
In a pitch to investors last spring, Anthropic said it intended to build AI to power virtual assistants that could perform research …
TechCrunch Kyle Wiggers
Related Coverage
- Anthropic says latest AI model can control users' computers Financial Times · Cristina Criddle
- Anthropic releases AI to automate mouse clicks for coders Reuters
- Amazon-backed Anthropic debuts AI agents that can do complex tasks, racing against OpenAI, Microsoft and Google CNBC · Hayden Field
- Anthropic Claude 3.5 Sonnet and Haiku Hacker News
- Anthropic's new AI can use computers like a human, redefining automation for enterprises VentureBeat · Michael Nuñez
- Anthropic's Claude 3.5 Sonnet model can use your computer Constellation Research · Larry Dignan
- Anthropic Wants Its AI Agent to Control Your Computer Wired · Will Knight
- Anthropic's New AI Tool Analyzes Your Screen and Acts on Your Behalf Bloomberg · Shirin Ghaffary
- Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku Hacker News
Discussion
-
@anthropicai
@anthropicai
on x
Introducing an upgraded Claude 3.5 Sonnet, and a new model, Claude 3.5 Haiku. We're also introducing a new capability in beta: computer use. Developers can now direct Claude to use computers the way people do—by looking at a screen, moving a cursor, clicking, and typing text. [im…
-
@kylebrussell
Kyle Russell
on x
Make sure to always have your adblocker running so Claude doesn't click some nasty download link
-
@aidan_mclau
Aidan McLau
on x
first contact [image]
-
@sammcallister
Sam Mcallister
on x
we're building an api for the world around us.
-
@mikeyk
Mike Krieger
on x
Beyond inspiring to see the different Anthropic teams come together for this launch — our upgraded Sonnet is even better at coding and other tasks, and we have a beta computer API for you to try as well.
-
@yacinemtb
Kache
on x
this is extremely huge for people who need accessibility. this is in line with what I said on primeagen's stream yesterday: AI should enable a large swathe of people that were previously disconnected, due to language or disability
-
@alexalbert__
Alex Albert
on x
Computer use API We've built an API that allows Claude to perceive and interact with computer interfaces. You feed in a screenshot to Claude, and Claude returns the next action to take on the computer (e.g. move mouse, click, type text, etc). [image]
-
@stevenhhb
Steven
on x
Claude can now operate your computer like human does.
-
@walthickey
Walter Hickey
on x
listen I think one reason lots of people are intrigued by prediction markets is there's a couple of scenarios where stuff like this means online polling is deeply screwed.
-
@alexalbert__
Alex Albert
on x
I'm excited to share what we've been working on lately at Anthropic. - Computer use API - New Claude 3.5 Sonnet - Claude 3.5 Haiku Let's walk through everything: [image]
-
@alexalbert__
Alex Albert
on x
This is a fundamentally new capability for AI models. Instead of developing bespoke tools for individual tasks, we're teaching Claude base computer skills—enabling it to naturally use the same everyday software and tools that people use.
-
@anthropicai
@anthropicai
on x
Claude 3.5 Sonnet's current ability to use computers is imperfect. Some actions that people perform effortlessly—scrolling, dragging, zooming—currently present challenges. So we encourage exploration with low-risk tasks. We expect this to rapidly improve in the coming months.
-
@anthropicai
@anthropicai
on x
We've built an API that allows Claude to perceive and interact with computer interfaces. This API enables Claude to translate prompts into computer commands. Developers can use it to automate repetitive tasks, conduct testing and QA, and perform open-ended research. [video]
-
@anthropicai
@anthropicai
on x
We're trying something fundamentally new. Instead of making specific tools to help Claude complete individual tasks, we're teaching it general computer skills—allowing it to use a wide range of standard tools and software programs designed for people. [video]
-
@minimaxir
Max Woolf
on x
Someone is 100% going to say “hey Claude, clean up my files” and then Claude will rm -rf * https://x.com/...
-
@anthropicai
@anthropicai
on x
The new Claude 3.5 Sonnet is the first frontier AI model to offer computer use in public beta. While groundbreaking, computer use is still experimental—at times error-prone. We're releasing it early for feedback from developers. [video]
-
@zck
Zak Kukoff
on x
The commodification of RPA can't come soon enough
-
@anthropicai
@anthropicai
on x
Beyond computer use, the new Claude 3.5 Sonnet delivers significant gains in coding—an area where it already led the field. Sonnet scores higher on SWE-bench Verified than all available models—including reasoning models like OpenAI o1-preview and specialized agentic systems. [ima…
-
@robertwiblin
Rob Wiblin
on x
My new RA just dropped: https://www.anthropic.com/... [image]
-
@anthropicai
@anthropicai
on x
Claude 3.5 Haiku is the next generation of our fastest model. Haiku now outperforms many state-of-the-art models on coding tasks—including the original Claude 3.5 Sonnet and GPT-4o—at the same cost as before. The new Claude 3.5 Haiku will be released later this month. [image]
-
r/LocalLLaMA
r
on reddit
Introducing computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku
-
r/singularity
r
on reddit
Introducing computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku