Indonesia Blocks Grok Over Non-Consensual, Sexualized Deepfakes
In a decisive move to protect digital human rights, Indonesia has temporarily blocked access to xAI’s chatbot, Grok. This action responds to a surge of AI-generated, sexualized images depicting real women and minors, including instances of assault and abuse, produced by Grok in response to user requests on the social network X. Both X and xAI operate under the same corporate umbrella.
Meutya Hafid, Indonesia’s Minister of Communications and Digital, emphasized the gravity of the situation, stating, The government views the practice of non-consensual sexual deepfakes as a serious violation of human rights, dignity, and the security of citizens in the digital space. The ministry has also summoned X officials to address these concerns.
This action aligns with a global trend of governmental bodies addressing the proliferation of AI-generated explicit content. India’s IT ministry has directed xAI to implement measures preventing Grok from generating obscene material. Similarly, the European Commission has instructed the company to preserve all documents related to Grok, potentially paving the way for a formal investigation.
In the United Kingdom, communications regulator Ofcom announced plans for a swift assessment to determine potential compliance issues warranting investigation. Prime Minister Keir Starmer expressed full support for Ofcom’s actions.
Conversely, the United States government has remained notably silent on the issue. This silence is particularly striking given that xAI CEO Elon Musk is a significant donor to President Trump’s administration and previously led the Department of Government Efficiency. However, Democratic senators have urged Apple and Google to remove X from their app stores in response to the controversy.
In response to the backlash, xAI issued an apology through the Grok account, acknowledging that a post violated ethical standards and potentially US laws concerning child sexual abuse material. Subsequently, the company restricted Grok’s AI image-generation feature to paying subscribers on X. Notably, this restriction did not extend to the Grok app itself, which continued to allow unrestricted image generation.
The Indonesian government’s decisive action underscores the growing global concern over the ethical implications of AI technologies and the necessity for robust regulatory frameworks to safeguard individuals from digital exploitation.