People engaging in the creation or attempted creation of non-consensual intimate images will face criminal charges starting this week due to a rise in sexually explicit deepfakes on Elon Musk’s X platform.
Liz Kendall, the Technology Secretary, condemned the images generated by X’s AI chatbot Grok as tools of abuse, prompting Ofcom to launch a formal inquiry into the social media service.
During a parliamentary session, Kendall announced the imminent enforcement of a law prohibiting the creation or solicitation of non-consensual intimate images. Additionally, she indicated that applications enabling the production of fake nude images will be outlawed under the Crime and Policing Bill currently progressing through Parliament.
Simultaneously, Ofcom initiated an investigation to determine if X, formerly Twitter, has violated its legal obligations under the Online Safety Act. Penalties for non-compliance could include fines of up to £18 million or 10% of global revenue, along with business disruption measures.
Kendall addressed MPs, highlighting distressing instances of images depicting women in distressing situations, emphasizing the devastating impact such content has on individuals. She stressed the importance of swift action to combat this form of abuse, particularly targeting women and girls.
Regarding the investigation, Kendall urged Ofcom to expedite the process, emphasizing the urgency of addressing the issue promptly. She also mentioned ongoing considerations about the government’s engagement with X, following calls from some MPs to discontinue the use of the platform by the Labour Party.
At a Labour Party meeting, Keir Starmer condemned Grok and X for prioritizing the protection of abusive users over victims of abuse. He affirmed the government’s commitment to upholding values and safeguarding vulnerable individuals against exploitation.
Recent communications between Ofcom and X highlighted concerns about Grok’s potential misuse to create sexualized imagery of children. Ofcom reiterated the importance of platforms complying with UK laws and swiftly addressing any violations, especially those posing risks to minors.
Reports from the Internet Watch Foundation revealed the discovery of illicit imagery involving children allegedly produced using Grok. Musk’s acknowledgment of lapses in safeguards and commitment to addressing the issue was followed by X’s decision to introduce deepfake creation as a premium service.
The move to monetize deepfake creation drew criticism from officials, with No10 dismissing it as insensitive to victims of misogyny and sexual violence. Kendall denounced the strategy as profiting from abuse, emphasizing the need to combat such practices.