Google’s Gemini Introduces Screen Automation for Seamless Task Management on Android
Google is advancing its Gemini assistant by introducing a screen automation feature designed to perform tasks such as placing orders and booking rides directly through Android devices. This development, identified in the Google app version 17.4 beta, is part of Google’s ongoing efforts to enhance user interaction with their devices.
The Get tasks done with Gemini feature, internally codenamed bonobo, enables Gemini to assist with various tasks by automating interactions within specific applications on the user’s device. This functionality is integrated into the Android 16 QPR3 update, laying the groundwork for more intuitive and efficient user experiences.
Users are advised to supervise Gemini’s actions closely, as the assistant may occasionally make errors. Google emphasizes user responsibility for tasks performed on their behalf and provides the option to halt the automation process at any time to regain manual control.
Regarding privacy, Google outlines that when Gemini interacts with an app, screenshots are reviewed by trained personnel to improve services, provided the Keep Activity setting is enabled. Users are cautioned against entering sensitive information, such as login credentials or payment details, into Gemini chats and are advised to avoid using screen automation for emergencies or tasks involving confidential data.
Additionally, the beta version reveals a Likeness feature, codenamed wasabi, which appears to involve 3D avatars similar to those used in Google Meet calls. This feature includes prompts indicating readiness and options to retake the avatar, with a privacy notice stating that the likeness can only be used by the individual user.
This initiative reflects Google’s commitment to integrating advanced AI capabilities into daily tasks, aiming to streamline user interactions and enhance productivity through intelligent automation.
