Ofcom investigates Elon Musk’s X over Grok AI sexual deepfakes | EUROtoday

Ofcom has launched an investigation into Elon Musk’s X over considerations its AI software Grok is getting used to create sexualised photos.

In a press release, the UK watchdog mentioned there had been “deeply concerning reports” of the chatbot getting used to create and share undressed photos of individuals, in addition to “sexualised images of children”.

If discovered to have damaged the regulation, Ofcom can doubtlessly subject X with a advantageous of as much as 10% of its worldwide income or £18 million, whichever is larger.

X referred the BBC to a press release posted by its Safety account at the beginning of January: “Anyone using or prompting Grok to make illegal content will suffer the same consequences as if they upload illegal content.”.

Elon Musk later mentioned the UK authorities wished “any excuse for censorship” in response to a put up questioning why different AI platforms weren’t being checked out.

The BBC has seen a number of examples of digitally altered photos on X, through which girls had been undressed and put in sexual positions with out their consent. One lady mentioned greater than 100 sexualised photos have been created of her.

If X doesn’t comply, Ofcom can search a court docket order to power web service suppliers to dam entry to the positioning within the UK altogether.

Technology Secretary Liz Kendall advised the BBC she welcomed the physique’s investigation and urged it to finish it as quickly as potential.

“It is vital that Ofcom complete this investigation swiftly because the public – and most importantly the victims – will not accept any delay,” she mentioned.

Kendall’s predecessor Peter Kyle advised BBC Breakfast it was “appalling” that Grok had “not been tested appropriately”.

“The fact that I met just yesterday a Jewish woman who has found her image of herself in a bikini outside of Auschwitz being generated by AI and put online made me feel sick to my stomach,” he mentioned.

Other MPs who’ve raised considerations embrace Northern Ireland politician Cara Hunter, who mentioned she had determined to go away the platform.

Downing Street in the meantime mentioned the federal government stays targeted on “protecting children” however would maintain its presence on X “under review”.

“I think we’ve been clear that all options are on the table,” the Prime Minister’s official spokesperson mentioned.

Ofcom will now study whether or not X has did not take down unlawful content material rapidly when it turned conscious of it, and brought “appropriate steps” to stop individuals within the UK from seeing it.

It mentioned such unlawful content material included “non-consensual intimate images” and baby sexual imagery.

It can even test whether or not X has used “highly effective age assurance” measures to cease youngsters from seeing pornographic photos.

The resolution follows world backlash over Grok’s picture creation characteristic, with each Malaysia and Indonesia briefly blocking entry to the software over the weekend.

An Ofcom spokesperson didn’t give a sign on how lengthy the investigation would take however mentioned it might be a “matter of the highest priority”.

“Platforms must protect people in the UK from content that’s illegal in the UK,” they mentioned.

“We won’t hesitate to investigate where we suspect companies are failing in their duties, especially where there’s a risk of harm to children.”

Lorna Woods, professor of web regulation at Essex University, advised the BBC it was “hard to predict” how rapidly the investigation would transfer.

“Ofcom has a degree of choice in how fast – or slow – they take the investigation,” she mentioned.

She mentioned the regulator might apply for a enterprise disruption order – a court docket order to dam entry to X within the UK – immediately moderately than as a final resort, however solely in “rare circumstances” in response to an ongoing drawback.