In 1968, computer scientist Douglas Engelbart introduced the world to a new species: the mouse, during a presentation later dubbed “The Mother of All Demos.” This was the first time humans publicly used a mouse to control a digital cursor on a screen. For decades, this small arrow has been ubiquitous, guiding us through office software, game interfaces, browser windows, and countless spreadsheets, becoming the most familiar yet silent guide into the digital world.

However, over the past fifty years, the computing power, form, and application scenarios of computers have dramatically changed, while the essence of the mouse cursor has remained almost unchanged: it knows its coordinates on the screen, knows X and Y, but does not understand whether you are pointing at a line of code, an invoice, or a scenic photo.

Faced with the constantly flickering pixels, its capabilities remain quite basic: clicking, dragging, and waiting for the next click.

Today, Google aims to reinvent the mouse cursor with Gemini.

At the recent Android Show, Google laid out its plans surrounding Android, AI, and hardware ecosystems. Among them, a new feature called “Magic Pointer” equips the old mouse cursor with “eyes” and “brain.”

Google’s intention is clear: future AI interactions should not rely on lengthy prompts but should allow users to simply point at the screen and say, “Move this there.” The question arises: when the mouse cursor finally learns to “understand” the screen, where will it take human-computer interaction?

What Can This AI-Powered Cursor Do?

To understand the significance of this technology, we must first recognize the awkward side of current AI tools: interaction costs.

In recent years, the capabilities of large language models have skyrocketed, yet the barriers to use remain high. To ensure AI accurately understands intent, users are forced to learn a complex set of “prompt engineering”: setting roles, providing background, and limiting output formats. Writing a few hundred words for a simple request has become commonplace.

Moreover, typical AI tools often run in separate web pages or application windows, frequently interrupting users’ workflows. For instance, when you want AI to summarize a chart while reading a 50-page PDF, you usually have to go through: screenshot -> save -> open browser -> go to AI webpage -> upload image -> input prompt.

Google refers to this cumbersome cross-application operation as “AI detours.” Such transitions are not only inefficient but also disrupt users’ focus during work, known as “flow.”

To address this, Google proposes the first interaction principle: “Maintain flow.” In their experimental AI cursor prototype, AI capabilities are no longer limited to a specific app or webpage but are attached to the mouse cursor, ready at all times.

The activation method is also designed to be minimal: no need to memorize any shortcuts; simply “shake” the mouse lightly, and the AI interface will automatically appear based on the currently hovered content, providing contextually relevant operation suggestions. If you hover over an image, it will ask if you want to “compare”; if you hover over a paragraph, it will proactively offer editing suggestions.

The entire process requires no learned commands, following intuition completely. Here are a few extremely intuitive scenarios:

First, the ultimate form of talking about images.

When browsing a cartoon cityscape, the traditional mouse can only click to enlarge the image. Now, you just need to hover the AI cursor over a building in the photo’s background and say into the microphone: “Move the elements of the image to this.”

No need to explain who “this” is or describe the appearance of the building. The AI cursor will directly understand the pixel you are pointing at, identify the corresponding element, and successfully move it.

Second, write fewer prompts and use natural references.

When you see an extremely complex baking recipe on a webpage, you don’t need to copy and paste or write, “Please double the quantities of all ingredients in the following recipe.” You just need to highlight that text with the cursor and casually say, “Double the quantities of ’these.'”

In an instant, AI rewrites a new recipe for you right there.

Third, turning pixels into interactive entities.

In the eyes of computers, the screen is merely millions of glowing pixels. But the AI cursor can transform these lifeless pixels into living entities.

For example, while watching a travel vlog, a restaurant that looks great flashes by. You pause the video, point the cursor at it, and the previously dull video frame instantly becomes a real, interactive location, popping up a reservation link for that restaurant.

Or, if you snap a photo of a note filled with scribbles, pointing the mouse at it will turn the ink into a checkable To-Do List. Notice that? Previously, you had to seek out AI; now, AI follows your mouse, obediently coming to your fingertips.

Killing AI Prompts, Returning to Human Intuition

Upon reflection, the most powerful communication tool for humans is actually pronouns.

When you and a colleague sit in front of a screen editing a design draft, you would never say, “Please move the blue rectangle at coordinates (X:120, Y:350) in the top left corner of the screen 50 pixels to the right.” You would simply point at the screen and say:

“Move this a little to the right, lighten it up.”

“That restaurant looks nice, how do I get there?”

“What does this error in the code mean?”

In daily life, we heavily rely on “this” and “that.” Gestures combined with simple spoken language form the most efficient communication code for humans. The reason is that we share the same physical space and visual context.

Google has keenly grasped this and distilled it into a product principle: embrace the power of “this” and “that.”

Rather than forcing humans to learn complex prompt frameworks, it is better to reverse the approach, stripping away the tedious work of expressing intent from us and letting machines adapt to our laziest, most instinctive pointing.

The good news is that this interaction method has already begun to be implemented. Gemini in the Chrome browser will support it starting today; Google’s newly launched laptop line, Googlebook, will directly integrate “Magic Pointer” at the operating system level, covering all applications.

Googlebook’s ambition extends beyond just the mouse. Google defines this product line as “the perfect companion for Android phones.”

Similar to Apple’s iPhone mirroring, users can seamlessly project Android apps onto the Googlebook desktop, running at native proportions, and freely navigate across devices in the file manager, completely breaking down the ecological barriers between phones, tablets, and laptops. Additionally, Gemini can generate custom dynamic widgets on the desktop as needed (for example, real-time flight cards for travelers).

In terms of hardware design, all Googlebook models will integrate a “Glowbar” light strip on the body, making it easy to distinguish from traditional Chromebooks or Windows laptops.

The first batch of Googlebooks will be manufactured by Acer, Asus, Dell, HP, and Lenovo, with an expected launch this fall.

Interestingly, Samsung is absent from this list. Recent news suggests that Samsung may be preparing a Galaxy laptop running Google’s new system, with its next Unpacked event rumored to be on July 22.

As for the underlying driving core, while Google has not explicitly named it, the repeated emphasis on a “modern operating system born for intelligence” and the deep integration of Android and ChromeOS all point to the long-rumored “Aluminum” system.

This means AI is becoming a foundational infrastructure at the operating system level. When AI truly embodies your mouse cursor, it gains the authority to intervene in everything—what you see is what you get, and what you point at is what you control.

AI-Human Interaction at a Crossroads

Looking back to 1968, the original mouse that amazed the world had a shockingly simple function: tracking position. Over the past fifty years, mice have added scroll wheels, side buttons, and even fans and weights, but their essence remains a blank slate: they accurately mark coordinates but can never understand the meaning behind those coordinates.

Google’s AI cursor has accomplished a rare evolution in interaction history: it not only knows where you are but also what that is.

In the past year, countless funded startups have scrambled to create the next “super entry point of the AI era.” Everyone is frantically competing over the realism of dialogue boxes and the complexity of agent workflows. But Google has given the entire industry a solid lesson with its actions this time:

What is the best technology? It is the kind that works silently and seamlessly. Chatboxes have never been the final form of AI; they are merely a compromise of a transitional period. The best AI should retreat to the background, becoming a fundamental infrastructure attached to your daily actions, rather than just an application that needs to be opened separately.

From command-line interfaces (CLI) with black backgrounds and white text, to graphical user interfaces (GUI) with mouse clicks, to touch-screen swipes (NUI) in the mobile era. In recent years, large language models have briefly taken us back to the era of typing communication, causing many to suffer from prompt anxiety.

But after today, we know that was just a detour before dawn. The truly useful AI must learn to think like humans: to understand your every glance and to comprehend every vague instruction of “move this here.”

Fifty-eight years ago, when Douglas Engelbart held that rudimentary wooden mouse, his ultimate dream was to “augment human intelligence.”

Fifty-eight years later, when AI attaches itself to this ancient pointer, machines finally begin to truly “understand” this world. The era of prompt engineers will eventually come to an end, and the ultimate closure of human-computer interaction will take a historic step forward through vague references of “this” and “that.”