Microsoft adds a “computer use” tool in Copilot Studio to let AI agents use websites and desktop apps; the feature is designed to detect UI changes dynamically
Microsoft has its own ‘computer use’ feature for AI agents to automatically use websites and apps.
Context & Ripple Effects
Microsoft has been building Copilot Studio toward business task automation since its plan to let customers create custom Copilot agents for work tasks. This release extends that arc from defining agents to giving them a way to operate existing web and desktop interfaces.
It also follows Copilot Vision’s webpage understanding capabilities, including analysis of webpage text and images, but applies that interaction model to agents executing work rather than assisting an individual user.
First-order effects
- Copilot Studio customers can configure agents to carry out tasks through websites and desktop applications, including workflows that lack a direct integration.
- Dynamic detection of interface changes is intended to make those agents less dependent on fixed UI layouts as applications change.
Second-order effects
- More business processes become candidates for agent automation without requiring each software vendor to expose an API, expanding Copilot Studio’s reach into legacy and third-party tools.
- The value of agent deployments will hinge more directly on reliability across changing interfaces, pushing customers to test and govern automated actions before using them in consequential workflows.
Third-order effects
- If UI-operating agents prove dependable, enterprise AI competition shifts from standalone assistants toward workflow systems that can act across the software already installed in an organization.
- The pattern favors platforms that combine agent-building tools with broad workplace surfaces; Microsoft’s later addition of agents to Windows shows how that execution layer can spread beyond a single application.
The trend: This is part of the move from conversational copilots to embedded workplace agents that can execute multi-application tasks.