Experience Google’s Gemma LLMs Locally on Your Mac with AI Edge Gallery
Google has unveiled its AI Edge Gallery application for Mac users, enabling the local execution of its Gemma large language models (LLMs) without requiring an internet connection. This development offers enhanced privacy, faster processing, and offline functionality.
Previously available on iPhone, the AI Edge Gallery’s expansion to Mac signifies Google’s commitment to broadening access to its AI technologies. Users can now download the app directly from Google’s website.
Benefits of Local LLM Execution
Running LLMs locally provides several advantages:
– Offline Accessibility: Users can operate the models without an internet connection, ensuring uninterrupted access.
– Enhanced Privacy: Processing data locally minimizes the risk of data exposure associated with cloud-based services.
– Improved Performance: Local execution often results in faster response times compared to cloud-based processing.
Introducing the Gemma 4 12B Model
Alongside the AI Edge Gallery app, Google has released the Gemma 4 12B model, featuring agentic multimodal intelligence designed for direct operation on laptops. This model is optimized for devices with at least 16GB of VRAM or unified memory, making it compatible with most modern Apple laptops, except the MacBook Neo.
The Gemma 4 12B model joins the existing lineup, which includes:
– Gemma-4-12B-it
– Gemma-4-E2B-it
– Gemma-4-E4B-it
– Gemma-3n-E2B-it
– Gemma-3n-E4B-it
AI Edge Eloquent: On-Device Dictation and Editing
In addition to the new model, Google introduced AI Edge Eloquent, an AI-powered dictation and editing tool that operates entirely on-device, eliminating the need for an internet connection. This tool is compatible with all Mac applications and can be activated via a keyboard shortcut.
Previously available on iPhone, AI Edge Eloquent’s Mac debut allows users to select their preferred writing style and incorporate custom vocabulary. Currently, the tool supports English, with plans to add more languages in the future. AI Edge Eloquent is available as a free download for both Mac and iPhone users.
Conclusion
The release of the AI Edge Gallery app and the Gemma 4 12B model for Mac users marks a significant advancement in local AI processing. By enabling offline functionality, enhancing privacy, and improving performance, Google is empowering users to harness the full potential of AI directly on their devices.
