San Francisco City Attorney David Chiu has issued cease-and-desist letters to Apple and Google, demanding the removal of 13 AI-powered ‘face-swap’ applications from their respective app stores. These apps, which claim to offer face-swapping capabilities, are being used to generate nonconsensual nude images, a practice that Chiu describes as ‘illegal, harmful, and completely unacceptable.’
The letters specifically target eight applications available on Apple’s App Store and five on Google’s Play Store. Chiu’s office asserts that by hosting these apps and profiting from in-app purchases, both companies are effectively ‘aiding and abetting’ the distribution of explicit deepfake images. The attorney emphasizes that Apple and Google have potentially collected millions in fees from these applications.
Both tech giants have established developer guidelines prohibiting pornographic content. Historically, they have removed similar ‘nudify’ apps when alerted by researchers. A Google spokesperson stated that the company has deleted ‘hundreds’ of apps with nudifying features for policy violations, including the five named in Chiu’s letters. In June, Apple reportedly tightened its App Store guidelines concerning developer responsibility for pornographic content.
Despite these measures, the persistence of such applications highlights the challenges in enforcing content policies on massive digital platforms. The proliferation of AI-driven tools capable of creating nonconsensual explicit imagery raises significant ethical and legal concerns. This situation underscores the need for more robust monitoring and enforcement mechanisms to prevent the misuse of technology in ways that violate individual privacy and dignity.
