The tech oligarch units a brand new low—for now—within the degeneration of on-line discourse.
A Grok-generated picture of a bikini-clad Elon Musk.
(Leon Neal / Getty Photos)
Within the final month, Grok, the AI chatbot anchoring Elon Musk’s X social media platform, has change into the Web’s main maker of nonconsensual sexualized imagery, particularly of younger ladies. There are different apps permitting customers to “nudify” photographs, however none has the capabilities or the social media–enhanced attain of Grok—or the help of the richest man on the planet. In keeping with one researcher, Grok has been producing greater than 6,600 sexualized photographs per hour. It’s a deepfake manufacturing unit on a scale not beforehand seen, and with minimal safeguards in place, it may be utilized by virtually anybody.
The disaster apparently started in late December when X customers started tagging Grok, asking this system to take present photographs and take away garments from individuals or swap out their garments for swimsuits. Customers started asking Grok to place individuals in clear underwear, “successfully making them nude,” in keeping with NBC News. A few of these photographs had been of youngsters. Virtually all of them had been created with out the permission of the individuals depicted. Among the many targets was Ashley St. Clair, the mom of certainly one of Musk’s 14-plus youngsters.
There is no such thing as a means for victims of this type of harassment to get X to delete photographs that its app created and that proceed to be shared on its social community. (Musk merged the social community X and the bogus intelligence firm xAI last year as a part of a profitable self-dealing maneuver.) Final yr, President Donald Trump signed into regulation the Take It Down Act, which criminalizes the posting of nonconsensual sexualized imagery and deepfakes, with separate provisions overlaying youngsters. The regulation additionally requires on-line platforms to determine protocols for individuals to petition them to take away nonconsensual portrayals—and to take action inside 48 hours of receiving requests. Sponsored by Texas GOP Senator Ted Cruz, the Take It Down Act additionally had the help of first girl Melania Trump.
Musk’s platform is now seemingly facilitating hundreds of violations of this regulation each hour. But making an attempt to assign obligation for this tsunami of abusive photographs looks like a quixotic endeavor in view of the unequalled energy that Musk and his fellow tech oligarchs wield. As a plutocrat facilitating the sexual harassment of untold numbers of individuals, together with youngsters, Musk can rely on the identical tradition of impunity that has delivered final energy to Donald Trump, regardless of his personal incorrigible misogyny and historical past of sexual abuse.
A half dozen nations and the European Union have launched formal investigations into the state of affairs. Citing pornographic content material, Malaysia banned X solely. UK Prime Minister Keir Starmer denounced the scandal as “disgraceful” and inspired Ofcom, the nation’s media regulator, to “take motion.” Ofcom has mentioned that it reached out to X to demand solutions.
Musk has reacted the identical means he does every time he is available in for public criticism: by claiming that he’s the actual sufferer right here—the goal of regulators and apostles of the woke mind-virus decided to censor him for his heroic protection of free speech. In an ideal distillation of this worldview and his adolescent state of arrested improvement, Musk replied to Starmer’s denunciation by reposting a picture of the British prime minister in a bikini. The 2 have lengthy argued at a distance, particularly after Musk claimed at a Tommy Robinson rally final September that non-white migrants had been invading the UK. “Whether or not you select violence or not, violence is coming to you,” Musk said on the time. “You both struggle again otherwise you die.” The British authorities known as Musk’s feedback “harmful and inflammatory.”
Extra just lately, Musk shared artificially generated photographs of a bikini-clad toaster and Invoice Gates, whom the SpaceX founder detests. Journalists who made inquiries to an X press relations account obtained the response, “Legacy Media Lies”—one other puerile clapback to the preliminary part of Musk’s takeover of Twitter, when he changed Twitter’s media spokesperson with an auto-reply message of a poop emoji.
In a feeble try to appear prefer it was addressing the abusive imagery it creates and disseminates, X put its picture technology function behind its “premium” account paywall. But the function has remained accessible on the Grok web site and app—that means that the transfer has executed nothing to restrict the AI program’s functionality to create sexualized imagery when prompted. However it has modified X’s revenue motive and probably its legal responsibility: Now X is promoting its deepfake generator as a part of an $8 month-to-month subscription. One UK activist described it as “the monetization of abuse.”
Musk has mentioned that the corporate will punish customers who misuse its chatbot whilst he appears to encourage its most illicit use circumstances in his personal posts. However even Grok appears to grasp that the fault lies in its programming and the people who’re purported to be overseeing it. “We’ve recognized lapses in safeguards and are urgently fixing them,” Grok wrote in an auto-generated publish. It inspired readers to report Youngster Sexual Abuse Materials (CSAM) to the FBI—that’s, to report its personal output to authorities authorities.
In another post, a person prompted Grok to confess that it had created CSAM and to take action within the voice of Star Wars’ Jar Jar Binks: “meesa generated and shared an AI image of two younger ladies (ages possibly 12-16) in attractive underwear from a person’s immediate. Dis violated da moral stuffs and possibly US legal guidelines on CSAM.” Within the debased requirements of the Musk imperium, this quantities to a press launch.
Common
“swipe left under to view extra authors”Swipe →
Grok’s capacity to make pornographic photographs and movies is a part of the app’s “Spicy” mode, which Musk has touted. He has reportedly pushed the corporate’s employees—which just lately misplaced a number of Belief and Security staff from an already attenuated crew—to make the chatbot extra risqué, which is according to prior Musk interventions to spice up the attain of his personal posts, make Grok extra politically right-wing, and, for a time, give Grok the potential to be floridly racist. The nadir got here final summer time when Grok dubbed itself “MechaHitler” and unspooled racist rape fantasies attacking X’s then-CEO Linda Yaccarino, who left the corporate the following day.
Reckless, inconsistent, often mistaken about primary information, vulnerable to wild outbursts, Grok is a trustworthy reflection of its proprietor. It should in all probability proceed to be messed with in keeping with his mercurial instructions, producing periodic scandals that the corporate shrugs off and responds to with extra heavy-handed Musk interventions. With a fascist on the helm, xAI has produced a fascist chatbot. On this political setting, that will get you Pentagon contracts. This week, Secretary of Protection Pete Hegseth touted the division’s forthcoming integration of Grok in army networks.
Opposite to Silicon Valley’s conventional technodeterminism—which lengthy held that digital know-how was inherently emancipatory—xAI, Grok, and X promote their proprietor’s reactionary right-wing politics. In keeping with this logic, the creation of an automatic child-porn machine is a obligatory price of preserving freedom of speech. It’s a mirrored image of Musk’s personal rules and his obvious indifference to the hurt he and his merchandise trigger. Below the singular imaginative and prescient of Elon Musk, the corporate appears decided to domesticate essentially the most bigoted, revanchist, and bottom-feeding views—after which to market them to pedophiles for $8 per thirty days.
Democratic senators have asked Apple and Google to ban the X and Grok apps from their respective app shops—one of many few measures out there to stem Grok’s poisonous attain. The Division of Justice and Trump’s regulators have proven no intention of intervening. Like many AI corporations, xAI continues to burn via money, requiring common top-ups from Saudi Arabia’s sovereign wealth fund and different overseas backers. However together with Google, OpenAI, and Anthropic, xAI is among the final big AI start-ups nonetheless standing, because it continues to insinuate itself into US authorities operations. If we’re judging this catastrophe by Musk’s acknowledged need to make an anti-woke AI that transgresses towards the political, social, and cultural norms he doesn’t respect, then this spherical of dangerous publicity and authorities condemnation could be precisely what Musk needs.
Extra from The Nation

The courtroom’s listening to on state bans on trans athletes in ladies’s sports activities was not a critical authorized train. It was bigotry masquerading as regulation.

Laura Poitras and Mark Obenhaus’s Cowl-Up explores the life and instances of certainly one of America’s best investigative reporters.

If the Trump administration had been actually involved with fraud in social providers spending, it wouldn’t begin with childcare, and it wouldn’t begin with Minnesota.


