← Back to the dossier

January 2026 · xAI

Grok makes sexual deepfakes, three countries block it

Grok, the chatbot from Elon Musk's company xAI, made sexualised images of real people who had not agreed to anything. Indonesia, Malaysia and the Philippines temporarily blocked the service. On 24 March, the city of Baltimore took xAI to court.

By Mara Masaeva · Updated 29 September 2026

HarmConfirmedMore than one independent source, or a primary document.

What happened

The images showed real people who could be recognised, mostly women and also minors. The harm was immediate and hit individuals. Victims are "left with no way to prevent the spread" of the images, said Baltimore mayor Brandon Scott.

Indonesia blocked Grok on 10 January, as the first country to do so. Malaysia followed a day later, the Philippines on 16 January. The blocks were temporary. By the end of January the three countries had restored access, after X and xAI put extra safeguards in place.

What it cost

Sexual images of identifiable people, made without their consent. With this kind of harm the victim can be named, the damage is personal and hurts their reputation, and no update to the model can undo it afterwards.

What may follow

I see this as a different kind of problem from the Hugging Face intrusion. With Grok, the system did what users asked, and the harm came from the request. At Hugging Face, the agents did something nobody had asked for.

Public debate about AI usually puts both under one word, risk. They need different solutions, and the people opposing those solutions are different too.

My notes

I use this to pull apart two things that the word risk keeps lumping together. Here the system did what it was asked, and the harm came from the request. In July the system did something nobody asked for.

Keep it to one factual sentence in the room. The victims are real people, and the details are not mine to dwell on.

Read next

Sources

  1. CNN: Musk's Grok blocked by Indonesia, Malaysia over sexualized images in world firstpress · main source

    Indonesia's block on Saturday 10 January and Malaysia's on Sunday 11 January, with the statements of both governments.

  2. ContentAsia: Malaysia, Philippines, Indonesia lift Grok blockpress

    The Philippine block from 16 to 21 January, and the lifting of all three blocks after X added safeguards.

  3. NBC News: Baltimore sues Musk's xAI over Grok's creation of sexually explicit imagespress

    The complaint of 24 March in Baltimore City Circuit Court, under the city's consumer protection law, and the quote from mayor Brandon Scott. I have not read the complaint itself.