Anthropic has launched a new experimental API called „computer use“ that allows its AI model, Claude, to interact with computer screens and perform actions.
Alongside the launch of the updated Claude 3.5 Sonnet model and the new Claude 3.5 Haiku model, Anthropic today announced an experimental public beta API called „computer use“ that allows Claude to control PC screens and take actions on a user’s behalf. Through this API, developers can direct Claude to look at a screen, move the cursor, click buttons, and type text. Anthropic is releasing this API today to gather feedback and improve it rapidly over time.
The Anthropic team wrote the following about this new capability in their announcement blog post:
With computer use, we’re trying something fundamentally new.
