Google added computer use to the Gemini app for Mac on November 19, letting the AI click and type inside desktop apps.
The rollout covers US English only, for adults with personal accounts on a paid Google AI plan.
You need an Apple silicon Mac running macOS Sequoia 15 or later, plus two macOS permissions.
Google's own help pages warn about signed-in accounts, hidden malicious instructions and changes that can't be undone.
Quick read · 2 min
Google's Gemini app for Mac can now operate other software for you. The feature, called computer use, arrived on November 19. You describe a job, add the @Computer use tag to your prompt, and the AI clicks and types through apps and websites in a background window while you keep working.
It is US only for now, in English, on paid Google AI plans.
You need an Apple silicon Mac on macOS Sequoia 15 or later and a personal account for an adult.
You pick which apps it can touch, and you can stop it with one click.
The catch is trust. Google's own help pages warn that Gemini can reach signed-in apps, see security codes on screen and be misled by malicious text hidden in documents or web pages. Some changes can't be undone, and its temporary backups expire after 24 hours at most. Google says sensitive actions need your confirmation first.
The latest Gemini Mac app update hands Google’s AI something it never had on Apple computers before: the ability to open your apps, click buttons and type for you while you carry on with something else. Google switched the feature on November 19 and calls it computer use.
That matters if you spend chunks of your day copying details from one window into another. It also matters if your Mac holds your email, your bank login and your work files, because an assistant that can press buttons can also press the wrong ones. Google’s own support pages list several ways that could go badly, and they are worth reading before you turn anything on.
01
What the Gemini Mac app update changes
Before this update, the Mac app’s task feature (once called Gemini Spark, now simply Task) could work with files on your computer and with connected Google services such as Gmail and Calendar. It could help you prepare a job. It could not operate other software.
Now it can. You describe what you want in plain language, and Gemini works through local desktop apps and websites to finish it, moving through menus, filling in forms and carrying information from one program to the next. It sees what is on screen by taking screenshots, then clicks, types and scrolls. The same ability has been available on PCs for a while.
The clever part is where the work happens. Gemini does not grab your pointer. It runs in a separate background window, which Google describes as isolated, and a live preview of that window appears inside your chat. Your main display and cursor stay yours, so you can write an email while the assistant grinds through a long chore.
Google’s own examples give a sense of the jobs it has in mind:
Pulling addresses, weights and dimensions out of PDFs stored on your Mac and entering them into shipping quote forms.
Editing photos in batches inside design software.
Going through clothing photos in a folder, researching prices, logging the details and staging listings on resale sites.
Collecting numbers and screenshots from live dashboards and building a Google Slides presentation from them.
Turning a pencil sketch into a 3D model.
The update also adds desktop connectors for Blender and Autodesk Fusion, which sit alongside the existing Git and Obsidian ones.
02
Who gets computer use, and which Macs can run it
Computer use is rolling out in English in the United States only. Google has not said when other countries will get it, and its announcement gave no date for Canada.
Even in the US, there is a checklist:
A paid plan. Google’s announcement names its AI Plus, Pro and Ultra subscriptions. Those plans start at $4.99 a month.
A personal Google account belonging to someone aged 18 or older. Work and school accounts are not supported at launch.
An Apple silicon Mac running macOS Sequoia 15 or later.
There is one wrinkle on plans. While the announcement lists all three tiers, Google’s support documentation currently mentions only Pro and Ultra for controlling desktop apps.
The rollout is also gradual. One outlet that tested the app soon after the announcement found the feature had not arrived in its version yet.
03
How to turn on computer use in Gemini for Mac
Based on Google’s instructions, the steps run like this:
Download the Gemini app for Mac from Google’s website if you don’t already have it, and sign in with an eligible personal account.
Enable computer use inside the Mac app.
Grant two macOS permissions if they aren’t already on: Accessibility, and the one that covers recording your screen and system audio. Gemini can’t drive other apps without both.
Open Task mode and write your request, including the tag @Computer use in the prompt.
When Gemini reaches for an app it hasn’t used before, it asks first. You can refuse, say yes for this one time, or say yes for good.
Watch the live preview in the chat. You can stop the task at any time with one click.
You can also build lists of apps Gemini may use and apps it must never touch.
What Gemini asks before it acts, and what it doesn’t
Gemini pauses for logins and payments and wants your confirmation before sensitive actions. Google says you approve key actions before they happen.
Read that wording carefully. Approving key actions is not the same as approving every click. Most of what the assistant does in that background window happens without a question, which is the whole point of the feature.
The standing permission deserves a second look too. If you pick the option that lets Gemini always use an app, it can come back to that app in later tasks without another app-level prompt. Google says sensitive actions still need a separate confirmation, but the door to the app itself stays open.
04
The risks Google itself warns about
A background window keeps Gemini out of your way. It does not wall your files and accounts off from mistakes. Google’s support documentation spells out several risks, and they are more serious than a chatbot giving a wrong answer.
Signed-in apps. Gemini can reach active sessions in native Mac apps. If your mail or messaging app is logged in, the assistant is working inside your account.
Security codes. It can read or interact with multifactor authentication codes that are visible in desktop or messaging apps.
Hidden instructions. In a prompt injection attack, malicious text tucked into an ordinary document or web page tricks an AI into doing something you never asked for. Google acknowledges that untrusted content in one app could push Gemini into acting in another app it is allowed to use.
Developer tools. Giving it code editors or similar tools could allow shell commands to run or lead to wider changes to your file system, reaching files that had nothing to do with the task.
Undo isn’t guaranteed. With the on-demand backup setting enabled, Gemini can try to make temporary backups. Some apps don’t support them, some changes can’t be reversed, and the copies expire after 24 hours or when you send your next prompt, whichever comes first.
These are risks Google documents, not proof that the feature is routinely wrecking files or exposing accounts. Still, they explain why some Apple-focused reviewers advise against giving any AI agent broad control of your main Mac, especially one that holds sensitive files or accounts.
Apple is tightening the same permissions Gemini relies on. Three days before Google’s announcement, on November 16, the second developer beta of macOS 27.3 added new controls for apps that ask for wide access to a Mac.
Under the new system, you can limit which apps an automation tool is allowed to control and which folders an app can open. You can also make an app ask every time, and an indicator shows when one app is controlling another. Apple will add screens that explain the dangers of handing apps unrestricted access to your data.
There is a timing catch. Permissions you grant now stay in effect after macOS 27.3 arrives, and you won’t be shown Apple’s new explanation screens for them. Apple’s changes aren’t a direct response to Google’s feature, and they won’t stop every mistake an AI agent could make.
06
What the cautious advice says
The controls Google describes are the ones already covered: you choose which apps Gemini can reach, you can watch the live preview, and you can interrupt a task if it goes off course. For its existing tasks that work with connected folders, the Gemini help page also warns people not to type sign-in or payment details into the task thread.
One reviewer’s advice is that anyone who gives an AI agent access to a Mac should keep an eye on the permissions in System Settings. Another points out that Gemini can still help plan and prepare a task without being allowed to make changes that may be impossible to reverse.
07
Quick answers
Is the Gemini Mac app update available outside the US?
Not yet. Computer use is limited to English in the United States, and Google has not said when other countries will get it.
Which Macs does Gemini computer use work on?
It needs an Apple silicon Mac running macOS Sequoia 15 or later.
Does Gemini take over my mouse while it works?
No. It works in a separate background window with a live preview in your chat, so your screen and cursor stay free.
Google just added four grocery stores, a tax tool and credit checks to Gemini and Search. Here is the list, who can use it, and one habit worth learning.
ChatGPT has a voice app on your car's screen, and OpenAI now lets Dot owners phone their assistant from the dashboard. Here is the setup, start to finish.
LinkedIn's new digital card lives in Apple Wallet or Google Wallet and swaps with one scan. Here is how to build yours, share it, and what it won't do.
7 min read
We use cookies to understand how readers use Talk With Tech, so we can make it better. Is that OK? Privacy policy
The Daily Brief
Today's biggest tech stories, in 5 minutes
Every morning, the news that matters from AI, phones, apps and the people shaping tech. Explained in plain English. Free.
One email a day. No spam, unsubscribe anytime. Privacy policy