Google has officially launched camera and screen sharing capabilities in Gemini Live for Android, initially available on Pixel 9 and Galaxy S25 devices. This enhancement, powered by Project Astra, allows users to interact with Gemini Live by sharing their screen or camera feed, enabling real-time assistance and information.
Screen Sharing Functionality
Users can now share their device’s screen with Gemini Live to receive contextual information and assistance. To activate this feature, open the Gemini overlay and select the Share screen with Live option. After confirming the screen-sharing request, users can navigate through their device while Gemini Live provides insights and answers related to the on-screen content. A call-style notification appears during the session, displaying a live count next to the time in the status bar. Tapping this notification opens the full-screen Gemini Live interface, where users can interact with the AI assistant. Additionally, a blue/purple Gemini waveform at the bottom of the screen indicates active listening. A subtle vibration signals that Gemini Live is ready to respond to queries.
Camera Sharing Capability
The new camera sharing feature enables users to share their rear camera feed with Gemini Live, facilitating real-time discussions about their surroundings. Upon activation, a live preview occupies most of the screen, with an option to switch to the front-facing camera located in the bottom-right corner of the viewfinder. For optimal performance, Google advises users to capture objects with steady movements. To interact with Gemini Live during a session, users can tap the screen or start speaking. It’s important to note that the screen must remain active for Gemini Live to process the video feed.
Background and Availability
Project Astra, unveiled at Google I/O 2024, aims to develop a universal AI agent capable of assisting users in everyday tasks. The integration of Astra-powered features into Gemini Live marks a significant step toward this goal. Initially, these new capabilities are being rolled out to all Gemini app users on Pixel 9 and Samsung Galaxy S25 devices. To access the features, users may need to force stop the Gemini or Google app. Google plans to extend availability to all Gemini Advanced subscribers on Android devices in the near future.
