Android 16 QPR3 Introduces ‘Screen Automation’ for Enhanced Task Management on Pixel 10
In the latest Android 16 QPR3 Beta 2 update, Google has unveiled a new feature called Screen Automation, designed to enhance task management on Pixel 10 devices. This addition allows applications to interact with the content displayed by other apps, facilitating more efficient task completion.
To access this feature, users can navigate to Settings > Apps > Special App Access, where Screen Automation is now listed. The description reads: Allow apps to help you complete tasks by interacting with other apps’ screen content. Currently, this permission is exclusive to Pixel 10 devices, with no confirmation on its availability for earlier models.
The Google app, which powers the Gemini AI, is the primary application utilizing this feature. Users are presented with three permission options: Always allow, Ask every time (set as default), and Don’t allow. Granting this permission enables the app to view and interact with other applications’ screen content, even when they are running in the background.
This development aligns with Google’s broader Computer Use initiative, aiming to create agents capable of navigating web pages and applications similarly to human interactions—by clicking, typing, and scrolling. An earlier demonstration of this concept was seen in May with Project Astra, which showcased the ability to scroll through Chrome for Android and interact within the YouTube app.
While the Screen Automation feature lays the groundwork for these advanced capabilities, the full integration of Gemini’s functionalities into Android remains forthcoming. Users can anticipate more seamless and intuitive task management as these developments progress.
