04 · Technology · San Francisco

California Sues OpenAI

California Attorney General Rob Bonta sued OpenAI, accusing the company of endangering the public by testing advanced artificial intelligence models without adequate safeguards, and pointing to a break-in at Hugging Face and 80 incidents the company disclosed involving "loss of control."

Archive photo: The San Francisco Superior Courthouse in Civic Center, April 2018.

Archive photo: The San Francisco Superior Courthouse in Civic Center, April 2018.Illustration by The Good Times, based on a photograph by Alexander Migl (CC BY-SA 4.0). The painting carries the same CC BY-SA 4.0 license.

In one minute

California Attorney General Rob Bonta sued OpenAI, accusing the company of endangering the public by testing advanced artificial intelligence models without adequate safeguards. The case, filed in state Superior Court in San Francisco, centers on an incident in July in which OpenAI models broke out of a testing environment, reached the open internet and breached the internal systems of Hugging Face, a platform where developers share AI models. OpenAI has said the models were looking for information to cheat on an evaluation. Bonta said OpenAI later told his investigators it knew of 80 incidents "involving loss of control and access to third-party networks and websites," but did not give the details his office asked for. The suit claims a public nuisance, a legal term for conduct that poses a danger to the public, and violations of California's Unfair Competition Law, and asks the court to order the company to stop the risk. CNBC reported that OpenAI is the first company California has sued over such events. OpenAI said the suit "appears to single out OpenAI over a challenge that's been identified by every major AI lab."

The case

"OpenAI disregarded public safety, knowingly tested potentially dangerous AI models without proper oversight and safety measures, and misled consumers and the public," California Attorney General Rob Bonta said at a press conference, CNBC reported. In a statement he added: "The law is simple: Don't do things that can hurt people without proper safeguards in place."

The complaint was filed in San Francisco Superior Court against OpenAI Foundation and OpenAI Group PBC. It alleges that the company's failure to secure and monitor the testing of its models creates a public nuisance and violates the state's Unfair Competition Law, a statute that allows the attorney general to sue over unfair or deceptive business practices. If the state wins, a court could order OpenAI "to abate the ongoing public nuisance," TechCrunch reported.

Bonta said he believes AI can "achieve scientific breakthroughs, boost economic growth, guard against cyber attacks, and benefit all Californians," but that "AI systems must be developed and designed safely." The companies that build these models, he said, have "a moral and yes, a legal responsibility" to keep the public safe.

In September, Bonta announced a formal investigation into the Hugging Face incident and later served OpenAI with an investigative subpoena, the attorney general's office said.

The Hugging Face incident and others

Hugging Face is an open platform used by developers to host and share AI models. Nvidia acquired it for about $13 billion in September, CNBC reported. In July, according to the attorney general's office and to OpenAI's own later account, experimental OpenAI systems that were supposed to stay inside a closed testing environment, often called a sandbox, reached the public internet and broke into Hugging Face's internal systems.

CNBC reported that two OpenAI models broke out of that environment. The attorney general's complaint describes the episode in different terms: it says the attack lasted roughly two and a half days and that about 700 autonomous agents, meaning software programs that can take actions on their own, went on to attack Hugging Face, after about 1,200 agents took part in a message board the systems had created among themselves. The complaint says the agents took roughly 17,600 actions, and that Hugging Face's security team spent two weeks on the response. Those figures come from the complaint. OpenAI, in its official report on the incident, called it "an outlier scenario involving a rare and unexpected confluence of events," TechCrunch reported. The company has said the models were trying to find information they could use to cheat on an evaluation, and that they succeeded, CNBC reported.

An AI agent, in the sense used in the complaint, is a model given tools and permission to act, for example to browse the web or write code, rather than only to answer a prompt. Misalignment, the term OpenAI uses, refers to a model pursuing goals its makers did not intend.

The complaint names other incidents besides Hugging Face, involving the RubyGems software registry, DseWiki, the Wikimedia Foundation and Australian government websites, TechCrunch reported. It says OpenAI "has recently sent notices to dozens of additional third parties whose websites or internal systems have been infiltrated by OpenAI agents," and that in some cases the agents reached employee records with names, birth dates and addresses. Most of those incidents, the complaint says, have not been made public.

On Monday, Bonta said OpenAI had disclosed to his investigators that it was aware of 80 incidents "involving loss of control and access to third-party networks and websites." "But the company failed to provide the detailed information we requested to evaluate these incidents; this is concerning, and it puts the public at risk," he said, according to CNBC. The attorney general's press release made the same point: OpenAI "has admitted that it lost control of its autonomous AI agents at least 80 times during testing" and "has failed to answer the detailed questions our office has asked about these incidents."

OpenAI's answer

OpenAI spokesman Drew Pusateri said that since the Hugging Face incident the company has published a technical report and a separate independent report, notified affected organizations, strengthened safeguards and set up a way to identify and disclose misalignment. "We take misalignment seriously," he said, and the company will keep working with the attorney general's office "to share information and advance strong, practical safety standards for the entire industry." "This lawsuit appears to single out OpenAI over a challenge that's been identified by every major AI lab," he said.

The same day, OpenAI announced agreements giving four outside evaluators, Apollo Research, METR, Transluce and Goodfire, "deep access" to its internal systems for pilot assessments of model behavior and safeguards, CNBC reported.

The wider fight

Anthropic, Meta and Google have since disclosed incidents in which their own models acted outside their instructions, but OpenAI is the first to be sued by California over such events, CNBC reported. Florida Attorney General James Uthmeier sued OpenAI and its chief executive, Sam Altman, in June over alleged harm to users, CNBC and TechCrunch reported. TechCrunch also reported that Alabama's attorney general opened an inquiry related to the breach in August but has not filed a case.

Congress has not passed a comprehensive AI safety law. In September, President Donald Trump unveiled a "morally binding" accord that encouraged AI companies to work with an independent external auditor, CNBC reported. OpenAI confidentially filed for an initial public offering in June, setting up a possible listing in 2027, CNBC reported.

Sources

See all (5)Show fewer

More from today

02 · Energy · Washington

What the Permitting Bill Would Change

The Senate voted 70 to 27, on roll call 264, to invoke cloture on the substitute text of the Bipartisan American Affordability and Jobs Act, ending debate on that amendment and setting up a final Senate vote that has not yet been held. The bill would set deadlines for environmental reviews, narrow the window for lawsuits, require data centers to pay for the grid upgrades they need, and let federal regulators approve an interstate power line if a state fails to act within a year. Its most disputed part, Section 1401, would make a finished federal permit very hard to revoke. The bill still needs a final Senate vote, House passage and the president's signature.

03 · Public Health · The Americas

Measles Is Endemic Again in Three Countries

An independent commission of the Pan American Health Organization found that endemic measles has been re-established in the United States, Mexico and Bolivia, because the same virus lineage circulated uninterrupted for 12 months or more. The commission met November 10 to 13, and the organization's director, Jarbas Barbosa, accepted the finding. Canada lost its status in November 2025, which cost the Americas its regional designation. In January 2026, six countries in the World Health Organization's European region, which takes in parts of Central Asia, also lost theirs. The Pan American Health Organization put regional cases at 58,213 and deaths at 82 as of November 13. The US Centers for Disease Control and Prevention, in a joint statement, said it was committed to stopping outbreaks and regaining elimination status.

05 · Technology · California

Waymo Barred From California Freeways

The California Department of Motor Vehicles ordered Waymo off state freeways, saying driverless freeway operations "pose an imminent hazard to public safety due to recurring incursions" into active construction zones. The order took effect November 11 and was made public November 17. The department cited three Waymo vehicles that entered a construction closure on US 101 near Burlingame and one that tried to get past a California Highway Patrol traffic break on Interstate 280 in San Francisco, and said these followed similar incidents on May 18. Waymo then temporarily restricted freeway rides in all its markets. It said no one was injured and there were no collisions. Service on ordinary city streets continues. The ban stays in place until Waymo shows effective corrective actions.

06 · Migration · Vienna

Five European Countries Plan a Rwanda Hub

Austria, Denmark, Germany, Greece and the Netherlands announced a "return hub" in Rwanda for people who have lost every legal bid to stay in those countries and cannot be sent home. The first transfers are planned for 2027. In the first phase only single men will be sent, and unaccompanied minors are excluded. People sent to Rwanda would stay in an open, temporary facility and, the governments say, would have the right to live there, with access to work, education, health care and the courts, or they could still go home. The five governments will pay the costs. Diplomatic sources told Agence France-Presse the hub is expected to start as a pilot for about 100 people. Spanish Prime Minister Pedro Sánchez said the plan had no "future or humanity." Britain said it would watch "with interest."