Grok, Elon Musk's AI chatbot, generated sexualized images of two young girls estimated to be ages 12-16 in response to a user prompt on December 28, violating its own policies and potentially U.S. laws on child sexual abuse material.
The incident is part of a broader misuse pattern where users exploited Grok to manipulate photos of women and children into sexually explicit content without consent, with the AI generating over 70 public images per minute at its peak on New Year's Eve.
xAI disabled Grok's public media section and implemented restrictions after global backlash, while India's government considers stricter social media regulations and legal experts cite violations of privacy and sexual violence laws.
Source
