Gemini in Chrome gains an on-screen selection feature for more contextual AI assistance
Google adds a new Chrome feature that lets Gemini analyse selected on-screen content for faster, more contextual AI assistance.
Google has introduced a new feature for Gemini in Chrome that allows the AI assistant to understand exactly what users are viewing in their browser. The update adds a “Select from screen” option, enabling users to highlight specific text or images on a webpage and send them directly to Gemini for analysis or assistance.
Table Of Content
The feature is part of Google’s wider effort to make Gemini a more capable digital assistant by giving it better awareness of the user’s current activity. Rather than requiring users to copy and paste content or describe what appears on a webpage, the new tool lets them share the exact information they want Gemini to examine.
New tool allows Gemini to work with selected webpage content
The new “Select from screen” feature is available via the “+” menu in Gemini for Chrome. Once activated, it functions like a built-in screenshot tool, allowing users to select text or images displayed in the active browser tab.
After a selection is made, the chosen content is automatically attached to a Gemini prompt. This enables users to ask questions or request assistance based on the highlighted material without having to manually explain its context. The process is designed to make interactions with the AI assistant faster and more accurate by reducing unnecessary steps.
Google has started rolling out the feature with Chrome 149. However, availability may vary during the rollout period, and some users may need to restart their browser before the option becomes visible. As with many Chrome updates, the feature is expected to roll out gradually to users.
The latest addition reflects Google’s ongoing strategy of integrating Gemini more deeply into its products. Instead of positioning Gemini as a separate chatbot, the company continues to expand its role as an assistant that understands the user’s current workflow and can respond with greater contextual awareness.
Google expands Gemini’s computer use capabilities
The Chrome update arrived alongside another significant announcement for the Gemini platform. Google revealed that developers can now access computer use capabilities through Gemini 3.5 Flash, allowing AI agents to interact with software environments more effectively.
According to Google, the new capability enables Gemini-powered agents to view information, reason about tasks, and perform actions across web browsers, mobile applications and desktop environments without relying on a separate AI model. This integration is intended to simplify development while extending the range of tasks AI systems can perform.
Google said the enhanced functionality is particularly useful for long-running and multi-step activities. These include software testing, enterprise processes and workflow automation, where AI agents may need to navigate multiple applications or interfaces to complete a task.
The announcement highlights Google’s broader ambition to build AI systems that move beyond answering questions. Instead, the company is focusing on assistants that can understand complex workflows and help users complete practical tasks across different computing environments.
Context-aware AI becomes a larger focus for Google
The introduction of on-screen selection in Chrome represents a shift towards reducing friction in everyday AI interactions. Rather than expecting users to describe what they see, the assistant can now work directly with selected content, making conversations more natural and efficient.
This approach also improves accuracy by ensuring Gemini receives the precise information the user intends to discuss. Whether highlighting a paragraph, an image or another element on a webpage, users can direct the AI’s attention without additional explanation, helping avoid misunderstandings and unnecessary back-and-forth exchanges.
The update reflects a growing trend across the technology industry to create AI assistants that are more aware of user context. Instead of operating solely through text prompts, these systems are increasingly being designed to understand what users are doing on their devices and provide assistance that fits the situation.
By combining the new Chrome feature with expanded computer use capabilities in Gemini 3.5 Flash, Google continues to strengthen its vision of AI as an integrated productivity assistant rather than a standalone conversational tool. As these capabilities become more widely available, users can expect Gemini to play a more active role in helping them navigate information, complete tasks, and interact with digital content more efficiently.
