UK regulator asks X about reviews its AI makes ‘sexualised photos of youngsters’ | EUROtoday

Ofcom has made “urgent contact” with Elon Musk’s firm xAI following reviews its AI instrument Grok can be utilized to make “sexualised images of children” and undress ladies.

A spokesperson for the regulator stated it was additionally investigating considerations Grok has been producing “undressed images” of individuals.

The BBC has seen a number of examples on the social media platform X of individuals asking the chatbot to change actual photos to make ladies seem in bikinis with out their consent, in addition to placing them in sexual conditions.

X has not responded to a request for remark. On Sunday, it issued a warning to customers to not use Grok to generate unlawful content material together with little one sexual abuse materials.

Elon Musk additionally posted to say anybody who asks the AI to generate unlawful content material would “suffer the same consequences” as in the event that they uploaded it themselves.

XAI’s personal acceptable use coverage prohibits “depicting likenesses of persons in a pornographic manner”.

But individuals have been utilizing Grok to digitally undress individuals with out their consent and with out notifying them.

It is a free digital assistant – with some paid for premium options – which responds to X customers’ prompts after they tag it in a put up.

Samantha Smith, a journalist who found customers had used the AI to create footage of her in a bikini, informed the BBC’s PM programme on Friday it had left her feeling “dehumanised and reduced into a sexual stereotype”.

“While it wasn’t me that was in states of undress, it looked like me and it felt like me and it felt as violating as if someone had actually posted a nude or a bikini picture of me,” she stated.

Under the Online Safety Act, Ofcom says it’s unlawful to create or share intimate or sexually express photos – together with “deepfakes” created with AI – of an individual with out their consent.

Tech corporations are additionally anticipated to take “appropriate steps” to cut back the dangers of UK customers encountering such content material, and take it down “quickly” when made conscious of it.

A Home Office spokesperson stated it was legislating to ban nudification instruments, and underneath a brand new legal offence, anybody who provided such tech would “face a prison sentence and substantial fines”.