Saturday, Nov 21 | --:--
Back to home

Gemini on Mac Can Now Operate Desktop Apps for US AI Plus, Pro and Ultra Subscribers

Google said on November 19 that the Gemini app for Mac can now use the computer: it navigates menus, types, clicks and fills forms across local files, desktop apps and websites in an isolated background window with a live preview, while users choose which apps it can reach and approve key actions. The feature is rolling out in English in the US to personal-account Google AI Plus, Pro and Ultra subscribers on Apple Silicon Macs running macOS Sequoia 15 or later.

3 min read Mountain View View as Markdown
A handmade editorial collage on torn ivory paper in oxblood and sage: a slender cut-paper conductor's baton, with no hand holding it, enters from the upper left and its tip nudges a large dense spread of blank rounded cream, sage and oxblood paper cards, the ones at the baton tip snapped into a neat evenly spaced fan and the rest further right still scattered at loose angles with faint charcoal motion arcs; no icons, no screens, no cursor arrow; an official Google logo is glued on a torn-paper clipping whose left end is tucked under the large torn paper layer at the upper left, the full logo visible.

Google is letting paying subscribers hand their Macs to an agent. The Gemini app for Mac can now operate the computer on a user's behalf, Google said on November 19, navigating menus, typing, clicking and filling in forms across local files, desktop apps and the web.

What it does#

Gemini works in an isolated background window with a live preview in the chat, so the user's own screen and cursor stay free, according to Google's post. Users choose which apps Gemini can access, can watch each step, pause at any time and approve key actions before they happen. Google's examples include batch colour-grading photos in design software, pulling weights and addresses from local PDFs into shipping-quote forms, building a Google Slides deck from live dashboards, and staging resale listings from a folder of clothing photos.

Who gets it#

The feature is rolling out in English in the US. It requires an Apple Silicon Mac running macOS Sequoia 15.0 or later and is limited to personal Google accounts of people 18 and over with Google AI Plus, Pro or Ultra subscriptions, Google says. The company gave no date for other countries, languages or Workspace accounts.

The developer version arrived first: Google made the Gemini API's Computer Use tool generally available at the start of the month.

The timing on macOS#

The Verge notes that the launch comes ahead of new Apple restrictions on apps that want "full disk access" on the Mac because of risks from AI agents with computer use, previewed in this week's macOS 27.3 beta. Desktop agents depend on exactly the deep permissions that Apple is now tightening.

Our read: the background-window design is Google's answer to the obvious objection, that an agent driving your Mac locks you out of it. The harder question, how much of the machine a user should let it see, is left to per-app permissions that Google describes but that we have not been able to test.

Limits#

  • The capabilities and safeguards are Google's description; we have not used the feature, and Google gives no success rates or task benchmarks.
  • Google does not say which model powers the feature.
  • The detail on Apple's new full-disk-access restrictions comes from The Verge's reporting on a beta, not from Apple.

Sources#

Prior Coverage

Earlier Times of AI reporting on this thread.

Scroll to continue reading