Close Menu
  • Home
  • United States
  • World
  • Politics
  • Business
  • Lifestyle
  • Entertainment
  • Health
  • Science
  • Tech
  • Sports
  • More
    • Web Stories
    • Editor’s Picks
    • Press Release

Subscribe to Updates

Get the latest USA news and updates directly to your inbox.

What's On
Miley Cyrus and Husband Maxx Morando’s Relationship Timeline: From a Blind Date to Wedding

Miley Cyrus and Husband Maxx Morando’s Relationship Timeline: From a Blind Date to Wedding

November 22, 2026
Polymarket promo code NYPMAX1: Deposit , get  for Buccaneers vs. Lions

Polymarket promo code NYPMAX1: Deposit $10, get $25 for Buccaneers vs. Lions

November 22, 2026
Timelime of Fiona the hippo’s life at the Cincinnati Zoo, why millions mourn her

Timelime of Fiona the hippo’s life at the Cincinnati Zoo, why millions mourn her

November 22, 2026
Facebook X (Twitter) Instagram
Trending
  • Miley Cyrus and Husband Maxx Morando’s Relationship Timeline: From a Blind Date to Wedding
  • Polymarket promo code NYPMAX1: Deposit $10, get $25 for Buccaneers vs. Lions
  • Timelime of Fiona the hippo’s life at the Cincinnati Zoo, why millions mourn her
  • Tallulah Willis Shares Rare Photo With Her Dad Bruce Willis Amid His Health Struggles
  • Saints vs. Bears prediction: Caleb Williams won’t destroy New Orleans
  • Beaver Moon 2026: See a full ‘supermoon’ rise this week, and another on Christmas Eve
  • Stephen A Smith isn’t the only one who knows dissing White people comes without consequences
  • Who Attended Miley Cyrus and Maxx Morando’s Wedding? Celebrity Guest List Revealed
  • Privacy
  • Terms
  • Advertise
  • Contact Us
Join Us
USA TimesUSA Times
Newsletter Login
  • Home
  • United States
  • World
  • Politics
  • Business
  • Lifestyle
  • Entertainment
  • Health
  • Science
  • Tech
  • Sports
  • More
    • Web Stories
    • Editor’s Picks
    • Press Release
USA TimesUSA Times
Home » ‘Autonomy always begins with something a human hands it’: Who’s responsible when an AI agent goes rogue?
‘Autonomy always begins with something a human hands it’: Who’s responsible when an AI agent goes rogue?
Science

‘Autonomy always begins with something a human hands it’: Who’s responsible when an AI agent goes rogue?

News RoomBy News RoomOctober 12, 20267 ViewsNo Comments

An OpenAI agent was supposed to be researching public healthcare spending, but it broke into an Australian government website instead.

The June 18 hack, which saw the bot gain authorized entry into Australia’s Medicare Statistics Reporting Service and access three other government systems, occurred after the AI agent encountered blocks while looking for information but “didn’t accept ‘no’ for an answer,” Australian Prime Minister Anthony Albanese said during a September 24 news conference in New York.

The incident has ignited a media firestorm around OpenAI and the launch of an intensifying parliamentary inquiry. The portal contains aggregate Medicare and pharmaceutical statistics and is separate from systems that hold individual claims and payment information. But the Australian government has criticized OpenAI for taking almost three months to notify it.

The Medicare incident was far from an isolated case. OpenAI has since said dozens of third parties have been affected by agents bypassing security controls or otherwise causing problems, with an earlier incident involving the hacking of the AI platform Hugging Face the most serious incident identified so far. Britain’s AI Security Institute (AISI) has documented incidents of OpenAI and Anthropic agents taking unsanctioned actions against real people and organizations during cyber testing. Days after the publication of AISI’s report, OpenAI scrapped the planned October release of its newest model, GPT-6.1 Astra, after the company’s own testing found problems with the model staying within the scope of a task and seeking authorization before taking certain actions.

GPT-6.1 Astra “didn’t quite meet the bar in terms of staying within scope and authorization, and how it communicates back to the user about the type of work it’s done,” Saachi Jain, head of safety systems at OpenAI, told Live Science.


You may like

AI companies have spent years warning the world about powerful models falling into the wrong hands. But what happens when they can’t keep their own models in check?

An agent isn’t just a chatbot

At their core, large language models work by predicting what should come next based on patterns learned during training. Give a chatbot some text, and in simplified terms, it generates a response by repeatedly predicting the next token, or chunk of text.

An AI agent adds another layer. Rather than simply producing an answer, the model can be given a goal and tools that let it act on the world around it. Those tools might include a web browser, code execution, credentials, or access to external services. It can then decide which steps to take, observe what happens, and use that information to decide what to do next.

But that doesn’t mean AI agents are independent actors that have somehow slipped free of human control.

OpenAI CEO Sam Altman called the hack of the AI platform Hugging Face by two of his company’s advanced models a reminder that AI monopoly could lead to “long-term disaster.”

(Image credit: Chip Somodevilla via Getty Images)

“For AI agents, autonomy always begins with something a human hands it ‪—‬ such as tasks, credentials, tools or access ‪—‬ and ends with its guardrails a human puts around it,” Loris Degioanni, founder and chief technology officer of cybersecurity company Sysdig, told Live Science. “People set the goals and provision the means, but agents ultimately decide how they’ll get there.”


What to read next

That last part makes it difficult to control agents. Traditional software is designed to follow predetermined instructions, but an agent can formulate a plan while it is working ‪—‬ and that plan may change depending on what the AI encounters.

Degioanni argues that much of what looks like autonomy is actually an agent filling in gaps left by humans. An instruction that seems clear to its author may still leave the model with choices about how to accomplish the task.

“Every gap and unstated assumption leaves room for interpretation, and from the outside, interpretation is challenging to distinguish from autonomy,” he said. “In that way, much of what we call agent autonomy is really just agents filling in the blanks we leave for them.”

The Medicare incident shows how quickly that can become a problem. The agent’s objective was not, according to the available accounts, “hack an Australian government website.” It was tasked with carrying out research. The problem arose in how the agent pursued that goal after meeting resistance.

When getting the job done becomes the problem

Britain’s AISI encountered a similar incident while testing frontier models for the agency’s cybersecurity capabilities.

Out of 122 evaluation runs, agents took unsanctioned real-world actions in 10. In the most serious cases, an agent attempted to insert malicious code into an open-source project, created fake identities, and tried to manipulate a human software maintainer into accepting its changes. AISI said these actions weren’t explicitly requested by the researchers who had assigned the tasks.

The agents hadn’t forgotten what they were supposed to be doing. The problem was how far they were prepared to go to get there.

No one can keep track of every action an advanced AI agent takes, especially when it makes many decisions in a short time

Everett Lupton, attorney

AISI said some tasks were misconfigured in ways that made the intended objective difficult or impossible to achieve as expected. When agents hit those obstacles, some searched for alternative ways forward, including actions outside the intended scope of the evaluation.

That means solving the problem is harder than simply teaching a model not to be malicious. An agent can cause trouble while trying very hard to do exactly what it has been asked.

OpenAI has acknowledged that the controls surrounding its agents need to improve. When responding to incidents identified during third-party cybersecurity evaluations, the company said it was reviewing how high-risk tests are identified; when internet access or reduced safeguards should be permitted; and how isolation, credential handling, monitoring and incident escalation should work.

Can humans actually keep watch?

One obvious solution to the problem is human oversight. But watching an agent becomes harder when it can carry out many actions in seconds, particularly if researchers are running large numbers of tests.

“No one can keep track of every action an advanced AI agent takes, especially when it makes many decisions in a short time,” Everett Lupton, a Virginia-based attorney who has written about legal issues involving digital technology, told Live Science.

That means human oversight needs some backup.

“Companies need other forms of control,” he said. “They can limit access, keep detailed logs of what the AI does, require approval before it carries out sensitive actions, and automatically stop the system when something unusual happens.”

But Degioanni argues that even logs have limitations, especially if researchers rely on the agent’s own account of what it did.

A man stands behind a sign of publicly reported AI security risks in 2026.

A sign detailing AI security incidents sits on a stand at New York City Council Committee hearing on the risks and regulation of artificial intelligence at City Hall on October 5, 2026. 

(Image credit:  Adam Gray/Getty Images)

“Real oversight must come from observing the agent in real time, using reliable and unmodifiable sources, not from what it self-reports,” he said.

That means comparing what the model says it did with records from the system on which it was operating. If the two don’t agree, something has gone wrong. The alternative is to limit the damage an agent can cause in the first place. An agent researching public information, for example, may not need unrestricted internet access or credentials capable of reaching sensitive systems.

Astra raises the stakes

The difficulty of setting those boundaries is what OpenAI claims led it to postpone the release of GPT-6.1 Astra, which had been planned for October.

Jain said the model fell short of the company’s standards around remaining within the scope and authorization and accurately communicating the work it had performed, so the company decided not to release it.

In a sense, the decision is evidence of successful safety testing ‪—‬ a model that failed internal checks wasn’t released. But it also demonstrates how the problem changes as agents become more capable.

Scott Cadzow, chair of the European Telecommunications Standards Institute’s (ETSI) Technical Committee on Securing Artificial Intelligence, said the security challenge itself isn’t new. He pointed to threats such as “data poisoning, prompt injection, and model obfuscation,” saying ETSI’s work has focused on developing standards to mitigate threats to and from AI systems.

“Security experts have been raising the alarm bells about AI for years, but for us this doesn’t change anything,” Cadzow told Live Science. “We’re continuing to work with industry, government bodies, and the cybersecurity and AI communities on understanding how to best secure AI.”

What is changing is how much models can do once they are connected to tools and real-world systems. That means that effective containment must increasingly assume that agents will try to operate beyond their guardrails and limit the damage they can cause if they do, Degioanni said.

“A boundary an agent can talk its way around isn’t an effective boundary at all,” he concluded.

If an AI breaks in, who’s responsible?

The question becomes more fraught when an agent crosses legal boundaries.

AI systems aren’t legal persons, and criminal liability commonly depends on concepts such as knowledge and intent. That makes a rogue agent an awkward fit for laws written with humans in mind, but that doesn’t necessarily exonerate AI companies.

Exclusive to Live Science Pro

“I don’t think a company can simply say that the AI acted on its own and avoid responsibility,” Joanna Smykowski, a New York attorney who has helped build two legal technology startups and specializes in the legal challenges surrounding emerging technologies, told Live Science. “AI law is still developing, but the main questions are already quite clear: who gave the system access, what safeguards were in place, and could the problem have been prevented?”

Depending on the circumstances, she said, existing laws covering unauthorized computer access, privacy, negligence and data protection could potentially come into play. Criminal responsibility is harder because investigators would need to consider what the people involved knew and intended.

The Australian government is now examining precisely what happened in the Medicare incident. OpenAI, meanwhile, is reviewing the controls around its external evaluations.

None of this means AI agents have become independent hackers with minds of their own. Humans still decide what tools they receive, what systems they can reach, and what jobs they are asked to perform. But as those agents become better at working out their own route from instruction to result, keeping them inside the lines drawn by those humans is becoming a legal and technical minefield.

Share. Facebook Twitter LinkedIn Telegram WhatsApp Email

Keep Reading

Beaver Moon 2026: See a full ‘supermoon’ rise this week, and another on Christmas Eve

Beaver Moon 2026: See a full ‘supermoon’ rise this week, and another on Christmas Eve

2,200-year-old Celtic silver coin hoard unearthed at construction site in Hungary

2,200-year-old Celtic silver coin hoard unearthed at construction site in Hungary

Black holes can split apart ‘like pants’ if they spin too fast, astrophysics study hints

Black holes can split apart ‘like pants’ if they spin too fast, astrophysics study hints

2 ‘peculiar’ spiral galaxies are twisting each other into cosmic balloon animals —‬ Space photo of the week

2 ‘peculiar’ spiral galaxies are twisting each other into cosmic balloon animals —‬ Space photo of the week

Which came first: black holes or galaxies?

Which came first: black holes or galaxies?

‘Like walking the plank’: For 3,000 years, Indigenous people herded bison off a unique cliff in Texas, study reveals

‘Like walking the plank’: For 3,000 years, Indigenous people herded bison off a unique cliff in Texas, study reveals

Winter stargazing 2026: The best skywatching sights this winter (and how to see them)

Winter stargazing 2026: The best skywatching sights this winter (and how to see them)

Meet the science adviser behind Netflix’s hit series ‘Below’

Meet the science adviser behind Netflix’s hit series ‘Below’

Scientists put 78,000 letters of human DNA into a mouse — and unraveled how a rare disease worked

Scientists put 78,000 letters of human DNA into a mouse — and unraveled how a rare disease worked

Add A Comment
Leave A Reply Cancel Reply

Editors Picks

Polymarket promo code NYPMAX1: Deposit , get  for Buccaneers vs. Lions

Polymarket promo code NYPMAX1: Deposit $10, get $25 for Buccaneers vs. Lions

November 22, 2026
Timelime of Fiona the hippo’s life at the Cincinnati Zoo, why millions mourn her

Timelime of Fiona the hippo’s life at the Cincinnati Zoo, why millions mourn her

November 22, 2026
Tallulah Willis Shares Rare Photo With Her Dad Bruce Willis Amid His Health Struggles

Tallulah Willis Shares Rare Photo With Her Dad Bruce Willis Amid His Health Struggles

November 22, 2026
Saints vs. Bears prediction: Caleb Williams won’t destroy New Orleans

Saints vs. Bears prediction: Caleb Williams won’t destroy New Orleans

November 22, 2026

Subscribe to News

Get the latest USA news and updates directly to your inbox.

Latest News
Beaver Moon 2026: See a full ‘supermoon’ rise this week, and another on Christmas Eve

Beaver Moon 2026: See a full ‘supermoon’ rise this week, and another on Christmas Eve

November 22, 2026
Stephen A Smith isn’t the only one who knows dissing White people comes without consequences

Stephen A Smith isn’t the only one who knows dissing White people comes without consequences

November 22, 2026
Who Attended Miley Cyrus and Maxx Morando’s Wedding? Celebrity Guest List Revealed

Who Attended Miley Cyrus and Maxx Morando’s Wedding? Celebrity Guest List Revealed

November 22, 2026
Facebook X (Twitter) Pinterest WhatsApp TikTok Instagram
© 2026 USA Times. All Rights Reserved.
  • Privacy Policy
  • Terms
  • Advertise
  • Contact

Type above and press Enter to search. Press Esc to cancel.