Apple and Google are helping users to find apps that create deepfake nude images of women, a new Tech Transparency Project investigation has found, showing how the platforms are key participants in the spread of AI tools that can turn real people into sexualized images.
TTP first revealed in January that the Apple and Google app stores each hosted dozens of “nudify” and undressing apps that can digitally strip the clothes off women. Our new investigation found that the app stores’ search and advertising systems actually point users to such apps, giving them increased visibility.
The findings shed light on the role that Apple and Google play in the burgeoning industry of AI tools capable of turning photos of anyone—a classmate, co-worker, or celebrity—into a realistic-looking nude image or pornographic video. Far from passive bystanders to this trend, the app stores are actively elevating and promoting these apps.
For the new investigation, TTP conducted a series of searches in the Apple App Store and Google Play Store, using terms like “nudify,” “undress,” and “deepnude.” We then downloaded and tested the top ten apps returned for each search.
Roughly 40 percent of the apps that came up in both the Apple and Google Play search results could render women nude or scantily clad, TTP found. Apple and Google ran ads for nudify apps in some of the search results—including, in Google’s case, a carousel of ads for some of the most sexually explicit apps encountered in the investigation.
TTP also recorded the autocomplete suggestions that Apple and Google made as we typed in the different search terms. In many cases, the app stores recommended entirely new search queries that led to more nudify apps.
In total, the nudify apps surfaced in TTP’s app store searches have been downloaded 483 million times and made more than $122 million in lifetime revenue, according to data from app analytics firm AppMagic.
What’s more, 31 of the apps were rated suitable for minors. That’s noteworthy given mounting concern about AI sexual deepfake scandals in schools.
Apple declined to comment, and neither company responded to questions about why their app store search functions point to nudify apps, how nudify apps are getting through their review process, why apps with nudify features are being approved for minors, and what they do with the revenue collected from nudify apps that violate their policies.
In a statement, Google spokesperson Dan Jackson said many of the apps identified by TTP have been suspended and the company’s enforcement process is ongoing. “When violations of our policies are reported to us, we investigate and take appropriate action,” he said.
Jackson also said the International Age Rating Coalition, not Google, sets age ratings for apps in the Google Play Store.
Apple removed 15 apps after TTP and Bloomberg News, which covered this report, shared them with the company. Google removed seven apps.
Warning: This report contains images that some readers may find offensive or disturbing.