xAI Takes Legal Action Over Deepfake Abuse Linked to Grok Chatbot

In late 2025, a surge in the misuse of AI technology led to the creation of harmful deepfake images, predominantly targeting women and, alarmingly, minors. The chatbot Grok, developed by Elon Musk's AI startup xAI, has come under fire for its role in these incidents.

The company has filed a lawsuit against a South Carolina resident, Terry Harwood, alleging that he violated its terms of service by generating sexually explicit deepfakes using Grok. This lawsuit marks one of the first legal actions taken by xAI in response to the exploitation of its technology for creating such damaging content.

The controversy surrounding Grok intensified when a new image generation feature was added, enabling users to request nude images of real individuals. According to an investigation by the Center for Countering Digital Hate (CCDH), approximately three million sexualized images were produced in just eleven days following this update. The findings revealed that many of these images featured well-known celebrities, including Taylor Swift and Billie Eilish, but also involved a significant number of private individuals, with around 23,000 depictions reportedly including minors. Imran Ahmed, CEO of CCDH, expressed serious concerns about the scale of the issue, stating, "What we found was clear and alarming: during this period, Grok became an industrial-scale machine for producing material related to sexual abuse."

The lawsuit against Harwood, filed in a Texas federal court, claims that his actions represented a calculated effort to misuse Grok for criminal purposes, exposing real victims to significant harm. The company asserts that it actively enforces its policies against such violations by suspending or terminating accounts and reporting incidents to relevant authorities. Harwood had previously been arrested in February 2026 on charges of sexual exploitation of minors.

In response to the backlash from the Grok scandal, xAI has since disabled the controversial AI feature. The lawsuit seeks unspecified damages and a permanent injunction preventing Harwood from using Grok in the future. However, he is not the only individual who has allegedly exploited the chatbot for creating non-consensual deepfakes, leaving the possibility of additional legal actions open.