Scary: AI Robot Claude Can Now Control Your Computer And Do All Your Work For You
Imagine you are looking at your computer screen and suddenly your mouse starts moving on its own!
Well, that’s exactly what Anthropic, the developer of Claude , one of the best AI-powered chatbots on the market, is working on right now. After all, if a language model can read and understand written text, why not take advantage of that ability to interact with our computer and do all that heavy lifting we don’t like so much?
While the basic idea is good, the truth is that I feel they’ve crossed a big red line. If AI (Claude is no exception) can still hallucinate when we ask it a normal question, what will happen when we ask it to fill out an activity form, or do important tasks for us?
According to Claude’s creators, it now has a function simply called “Use Computer,” which allows it to see what you have on your computer screen. To do this, Claude takes a screenshot and analyzes what is in front of it. From there, and according to our instructions, the chatbot will be able to type text, press buttons, and use some of the commonly used tools and programs available on your computer.
Anthropic explains that this new feature is still in its early stages, and the AI is still having trouble doing simple tasks like scrolling, zooming, or dragging items from one place to another. But the functionality is on its way. Well, yes it is. In fact, it’s already available with the latest public beta of Claude 3.5.
“At this point, this feature is still experimental, sometimes cumbersome, and prone to errors,” Anthropic says. “We’ve released the ‘Computer Usage’ feature early to get developer feedback, and we expect the capability to improve rapidly over time before rolling it out to everyone.”
You can see an example of how this new tool works in the (X) post Anthropic published a couple of days ago. The goal is to be able to use AI to perform and automate repetitive tasks, thus giving it a broader use than just a simple chatbot.