Bank of England considers an AI kill switch to stop market meltdowns

California thought about it, and now so too is the Bank of England who is exploring the use of kill switches that could halt trading in the event of Artificial Intelligence (AI) models going astray, as it accepts existing regulatory frameworks may not be adequate.

Speaking at the European Central Bank’s (ECB’s) annual Sintra Forum on central banking, the Bank of England’s deputy governor, Sarah Breeden, said the use of AI in commerce and trading means regulation must change.

“What these two examples – agentic commerce and agentic trading – both highlight is that, as AI capabilities increase, we must keep asking whether existing, technology-agnostic regulatory frameworks remain sufficient,” she told the audience.

Breeden said financial firms will not be able to rely on a guarantee of human oversight.

“Our frameworks were not built to contemplate autonomous agents, and relying on a human in the loop for all agent actions is unlikely to be realistic. More sophisticated governance and accountability frameworks may be needed,” she added.

Breeden said that, from late 2024, AI systems were trained to reason through requests, but today they can autonomously chain together sequences of actions.

This has huge implications for regulating trading and commerce, and protecting against cyber attacks.

The Future of AI Keynote: Dystopia, Utopia and Control, a keynote by futurist Matthew Griffin

“The financial system looks likely, therefore, to evolve quickly into one that operates more autonomously, at scale and speed: AI agents transacting on behalf of consumers and merchants; devising and executing trading strategies in financial markets; and identifying and chaining together cyber vulnerabilities,” she said.

In trading, Breeden said firms currently use autonomous AI for lower-risk operational tasks, such as research, but added that this could change quickly.

In a financial system that operates more autonomously, at scale and speed, she said AI agents could devise and execute trading strategies.

“If AI agents respond similarly to the same prompts or triggers, they could amplify volatility in stress – especially if their objectives drift from original goals or public policy objectives, in a manifestation of the misalignment problem that can arise with some AI models.”

She asked whether firms can “observe and contain their resulting behaviours” using methods such as Explainable AI.

“We are experimenting with the Bank of International Settlement Innovation Hub and the Bundesbank on simulation methods to understand which aspects of agent design could drive herding behaviour,” she added.

Breeden said the organisations are also considering whether there is a need for guardrails, similar to circuit breakers or kill switches, that would limit or stop trading market-wide if faulty AI models cause market meltdown or went rogue.

In April, the Bank of England and the Financial Conduct Authority (FCA) agreed to take steps following criticism from MPs on the Treasury Committee. In a January report, committee chair Meg Hillier said she did not believe the finance sector is prepared for a major AI-related incident.

MPs on the Treasury Committee reported that the position adopted by the Bank of England and the FCA, which they described as a “wait-and-see approach”, was exposing the public to “potential serious harm.”

Breeden’s most pressing stability concern is a step change in agentic AI’s cyber capabilities, which includes the ability to identify cyber vulnerabilities en masse as we’ve seen with the recent Anthropic Mythos problems. In April, major UK banks entered discussions with regulators as the model unearthed decades-old vulnerabilities.

“In the hands of defenders, these tools strengthen cyber resilience. But in malicious hands, they materially increase the chance of attacks that could harm financial stability,” Breeden warned.

She said the main challenge for regulators is maintaining the advantage of cyber defenders as malicious actor capabilities evolve. She added that this is particularly the case “in an increasingly severe cyber threat environment, including from geopolitics and ransomware.”

Breeden added that for financial stability, vulnerability patching must happen quickly – across the financial sector, key third-party technology providers and the wider national infrastructure.

With the increased risk of mass disruption in the sector, Breeden said the regulators should consider whether the firms they regulate require “enhanced recovery options for core systems”.

She said cooperation between financial services firms could be an option, with, for example, other banks providing basic functions to the customers of banks that are unable to provide them. “In a cyber context, do we need systems that allow one institution to pick up another’s basic functions during disruption, as in Ukraine’s Power Banking programme launched in 2022?” This initiative was created to guarantee financial resilience during blackouts and grid disruptions.

Breeden added that another consideration is whether “key firms” could be made to have completely separate failover capabilities, or to be able to rebuild compromised core systems quickly from “bare metal.”

First published on Fanatical Futurist on 30 June 2026.

311 Intelligence

What this means

Analysis by the 311 Strategic Intelligence Unit

The big shift is from human oversight to machine-speed guardrails. The Bank of England now accepts that a human in the loop for every AI agent action is unlikely to be realistic, and it is weighing circuit breakers or kill switches that could stop trading market-wide. We rate Agentic Artificial Intelligence a Prepare technology, with wide use expected by 2028, and we track Rising AI Failure Risk as an Act now trend.

What it means by sector.

• Banks and trading firms: firms use autonomous AI for lower-risk tasks such as research today, but Breeden expects that could change quickly. Agents that react alike to the same triggers could amplify volatility in stress.
• Payments and retail: AI agents transacting for consumers and merchants bring agentic commerce under the same regulatory questions as agentic trading.
• Cyber and infrastructure: Breeden's top concern is AI that finds vulnerabilities en masse. We track AI Cyberattacks as a Prepare trend and Robo-Hackers, AI that hacks on its own, as an Explore technology.

What to do now.

• List every AI agent that can act on your behalf, what it can trade, buy or change, and who can stop it.
• Build and test your own stop controls, so a faulty agent can be halted without shutting down core services.
• Speed up vulnerability patching and plan how core systems would be rebuilt if they were compromised.

The Starburst technologies behind this story

From the 311 Technology Starburst (first product, expected wide use and readiness):

Technology	Category	First product	Wide use	Action	TRL
Agentic Artificial Intelligence	Intelligence	2024	2028	Prepare	8
Explainable Artificial Intelligence	Intelligence	2022	2037	Watch	7
Robo-Hackers	Security	2018	2032	Explore	7
Autonomous Cyber Reasoning Systems	Security	2025	2032	Explore	7

And the trends they feed, from the 311 Trends Starburst:

Trend	Wide use	Action
Rising AI Failure Risk	2027	Act now
AI Cyberattacks	2028	Prepare
AI Agent Payments	2030	Prepare
Operational Resilience Laws	2028	Prepare

How this moves the trend

The idea is not new. In 2016 researchers built a kill switch for rogue AI agents, and in 2018 the UK FCA explored becoming an AI robo-regulator. By 2023 deepfakes could confuse AI trading systems, and in 2024 California passed its AI Kill Bill. Now a central bank is applying the same thinking to whole markets.

Go deeper with 311

• The 311 Starburst Centre: every technology and trend above, with timelines and readiness.
• 311 Vantage: ask what autonomous AI agents mean for your organisation and get a plain English executive brief.
• The Exponential Technology Codex and the Annual Trends Codex: the technologies and trends reshaping every industry.
• Book a briefing or keynote on the future of AI, risk and financial services for your board or leadership team.