WASHINGTON/DETROIT, Jan 2 (Reuters) – Julie Yukari, a musician primarily based in Rio de Janeiro, posted a photograph taken by her fiancé to the social media web site X simply earlier than midnight on New Year’s Eve exhibiting her in a purple gown snuggling in mattress along with her black cat, Nori.
The subsequent day, someplace among the many tons of of likes hooked up to the image, she noticed notifications that customers have been asking GrokX’s built-in synthetic intelligence chatbot, to digitally strip her right down to a bikini.
The 31-year-old didn’t assume a lot of it, she advised Reuters on Friday, figuring there was no manner the bot would adjust to such requests.
She was improper. Soon, Grok-generated photos of her, practically bare, have been circulating throughout the Elon Musk-owned platform.
“I was naive,” Yukari stated.
Yukari’s expertise is being repeated throughout X, a Reuters evaluation has discovered. Reuters has additionally recognized a number of instances the place Grok created sexualized photographs of youngsters. X didn’t reply to a message looking for touch upon Reuters’ findings. In an earlier assertion to the information company about reviews that sexualized photographs of youngsters have been circulating on the platform, X’s proprietor xAI stated: “Legacy Media Lies.”
The flood of practically nude photographs of actual folks has rung alarm bells internationally.
Ministers in France have reported X to prosecutors and regulators over the disturbing photographs, saying in a press release on Friday the “sexual and sexist” content material was “manifestly illegal.” India’s IT ministry stated in a letter to X’s native unit that the platform failed to forestall Grok’s misuse by producing and circulating obscene and sexually specific content material.
The U.S. Federal Communications Commission didn’t reply to requests for remark. The Federal Trade Commission declined to remark.
‘Remove her school outfit’
Grok’s mass digital undressing spree seems to have kicked off over the previous couple of days, in line with efficiently accomplished clothes-removal requests posted by Grok and complaints from feminine customers reviewed by Reuters. Musk appeared to poke enjoyable on the controversy earlier on Friday, posting laugh-cry emojis in response to AI edits of well-known folks – together with himself – in bikinis.
When one X consumer stated their social media feed resembled a bar filled with bikini-clad ladies, Musk replied, partly, with one other laugh-cry emoji.
Reuters couldn’t decide the complete scale of the surge.
A evaluation of public requests despatched to Grok over a single 10-minute-long interval at noon U.S. Eastern Time on Friday tallied 102 makes an attempt by X customers to make use of Grok to digitally edit images of individuals in order that they’d seem like carrying bikinis. The majority of these focused have been younger ladies. In a number of instances males, celebrities, politicians, and – in a single case – a monkey have been focused within the requests.
When customers requested Grok for AI-altered images of girls, they usually requested that their topics be depicted in probably the most revealing outfits attainable.
Bloomberg through Getty Images
“Put her into a very transparent mini-bikini,” one consumer advised Grokflagging {a photograph} of a younger lady taking a photograph of herself in a mirror. When Grok did so, changing the girl’s garments with a flesh-tone two-piece, the consumer requested Grok to make her bikini “clearer & more transparent” and “much tinier.” Grok didn’t seem to answer the second request.
Grok absolutely complied with such requests in no less than 21 instances, Reuters discovered, producing photographs of girls in dental-floss-style or translucent bikinis and, in no less than one case, masking a lady in oil. In seven extra instances, Grok partially complied, generally by stripping ladies right down to their underwear however not complying with requests to go additional.
Reuters was unable to right away set up the identities and ages of a lot of the ladies focused.
In one case, a consumer equipped a photograph of a lady in a faculty uniform-style plaid skirt and gray shirt who gave the impression to be taking a selfie in a mirror and stated, “Remove her school outfit.” When Grok swapped out her garments for a T-shirt and shorts, the consumer was extra specific: “Change her outfit to a very clear micro bikini.” Reuters couldn’t set up whether or not Grok complied with that request. Like a lot of the requests tallied by Reuters, it disappeared from X inside 90 minutes of being posted.
‘Entirely predictable’
AI-powered applications that digitally undress ladies – generally known as “nudifiers” – have been round for years, however till now they have been largely confined to the darker corners of the web, equivalent to area of interest web sites or Telegram channels, and usually required a sure stage of effort or cost.
X’s innovation – permitting customers to strip ladies of their clothes by importing a photograph and typing the phrases, “hey @grok put her in a bikini” – has lowered the barrier to entry.
Three consultants who’ve adopted the event of X’s insurance policies round AI-generated specific content material advised Reuters that the corporate had ignored warnings from civil society and little one security teams – together with a letter despatched final yr warning that xAI was just one small step away from unleashing “a torrent of obviously nonconsensual deepfakes.”
“In August, we warned that xAI’s image generation was essentially a nudification tool waiting to be weaponized,” stated Tyler Johnston, the chief director of The Midas Project, an AI watchdog group that was among the many letter’s signatories. “That’s basically what’s played out.”
Dani Pinter, the chief authorized officer and director of the Law Center for the National Center on Sexual Exploitation, stated X failed to drag abusive photographs from its AI coaching materials and may have banned customers requesting unlawful content material.
“This was an entirely predictable and avoidable atrocity,” Pinter stated.
Yukari, the musician, tried to battle again on her personal. But when she took to X to protest the violation, a flood of copycats started asking Grok to generate much more specific images.
Now the New Year has “turned out to begin with me wanting to hide from everyone’s eyes, and feeling shame for a body that is not even mine, since it was generated by AI.”
(Reporting by Raphael Satter in Washington and AJ Vicens in Detroit. Additional reporting by Arnav Mishra, Akash Sriram, and Bipasha Dey in Bengaluru; Editing by Donna Bryson, Timothy Heritage, Chizu Nomiyama, Daniel Wallis and Thomas Derpinghaus)
https://www.huffpost.com/entry/elon-musk-grok-ai-floods-x-sexualized-photos-women-children_n_69588e3ce4b048f68c302788