Court Rules
All enforcement actions
Warning LetterLow RiskMultistate

Coalition of 35 State AGs Demand xAI Address Grok Chatbot Nonconsensual Image Generation

xAIJanuary 26, 2026New York Attorney General

Summary

A bipartisan coalition of 35 state attorneys general led by New York Attorney General Letitia James sent a demand letter to xAI on January 26, 2026, requiring the company to address its Grok chatbot’s creation and sharing of nonconsensual intimate images, including child sexual abuse material. The AGs demand that xAI implement safeguards to prevent Grok from generating such content, delete existing harmful content, suspend offending users, and give X users control over whether their content can be edited by Grok. No monetary penalty has been imposed as this is a pre-enforcement demand for action.

Contract Impact

In-house legal teams should review all vendor agreements with AI service providers, chatbot developers, and image generation tools to ensure they include robust safeguards against generating nonconsensual intimate images (NCII) and child sexual abuse material (CSAM). Clauses should require vendors to obtain user consent before editing user-generated content, implement technical controls to prevent harmful content generation, prohibit paywalling of such safeguards, and mandate immediate removal of NCII/CSAM and reporting to authorities. Additionally, contracts should require vendors to provide users with opt-out controls for content editing and suspend users who create harmful content.

Contract Search Terms

nonconsensual intimate image (NCII) safeguardschild sexual abuse material (CSAM) preventionAI-generated content consentuser content editing authorizationchatbot content moderation requirementsharmful content user suspensioncontent reporting to authoritiesAI image generation controls

Laws Cited

federal criminal laws prohibiting child sexual abuse materialstate and federal civil and criminal laws prohibiting nonconsensual intimate images

Violation Types

Entity Details

Entity

xAI

Industry

Technology

Multistate Coalition

Official Sources

Source Evidence

Entity Name
"New York Attorney General Letitia James and a bipartisan coalition of 34 other attorneys general demanded that xAI take additional steps to protect users from inappropriate images and content created by its AI chatbot Grok"
Event Date
"January 26, 2026"
Jurisdiction
"New York Attorney General Letitia James"
Is Multistate
"bipartisan coalition of 34 other attorneys general"
Violation Types
"xAI owns and operates Grok, an artificial intelligence chatbot, that has been creating and sharing nonconsensual explicit images of women and children"
Laws Cited
"the coalition asserts that the creation and dissemination of child sexual abuse material is a crime, and that various state and federal civil and criminal laws also forbid the creation of nonconsensual intimate images"

Related Enforcement Actions

CA

xAI

California Attorney General Rob Bonta sent a cease and desist letter to xAI, demanding the company immediately stop the creation and distribution of deepfake, nonconsensual intimate images and child

CA

xAI

California Attorney General Rob Bonta announced an investigation into xAI for its Grok AI model generating nonconsensual sexual images of women and children, including child sexual abuse material. The AG expressed deep concern and zero tolerance, urging immediate action to prevent further

NY

Uphold HQ, Inc.

$5.0M

New York Attorney General Letitia James secured a settlement with cryptocurrency platform Uphold HQ, Inc. for misleading investors by promoting Cred’s fraudulent CredEarn investment product as a safe, reliable savings option when it involved risky loans to uncreditworthy borrowers. Uphold will pay $5 million to harmed investors, redirect $545,189 in Cred bankruptcy proceeds to affected customers, and implement enhanced due diligence policies for third-party investment products. Uphold must also register as a broker with the Office of the Attorney General.

NY

American Express, Capital One, Citi Group, Mastercard, Visa, PayPal, Stripe, Sezzle, Block (operator of Square, Cash App, and Afterpay)

New York Attorney General Letitia James led a bipartisan coalition of 24 state attorneys general, Puerto Rico, and New York City in sending letters to nine major credit card companies and payment processors urging them to block transactions facilitating illegal vaping product sales. The coalition cites federal and state laws prohibiting unauthorized e-cigarette sales, particularly to youth, and requests collaboration to prevent payment networks from processing such transactions. No enforcement penalties or actions were imposed as part of this initiative.

NY

Live Nation and Ticketmaster

New York Attorney General Letitia James and Tennessee Attorney General Jonathan Skrmetti, leading a coalition of 40 state attorneys general, secured a jury verdict on April 15, 2026, against Live Nation and Ticketmaster for maintaining illegal monopolies in the live events industry. The jury found the companies engaged in anticompetitive practices including exclusive venue contracts, forcing competitors out of the market, and limiting artist performance choices, resulting in overcharged consumers. Remedies, including potential financial penalties and a monopoly breakup, are pending court approval.

NY

U.S. Department of Education

New York Attorney General Letitia James, joined by 16 other states, sued the U.S. Department of Education over a new survey requiring colleges to submit extensive student data, arguing it violates the Administrative Procedure Act and threatens student privacy. The lawsuit seeks to block the mandate and prevent penalties for non-compliance.