Microsoft has called for stronger global safety regulations for artificial intelligence, warning that rapidly advancing AI systems face fewer mandatory safeguards than everyday products such as milk and washing machines. The company’s president, Brad Smith, has urged governments to introduce clear rules covering AI safety, independent assessments and accountability when systems behave unexpectedly.
The call comes amid growing concerns about autonomous AI agents that can perform tasks, access digital systems and take actions with limited human intervention.
Microsoft Wants Mandatory AI Safety Standards
Brad Smith argued that AI requires a more comprehensive regulatory framework as its capabilities expand. He said governments should build on established safety practices used for consumer products and apply appropriate principles to artificial intelligence.
One proposal is to make companies legally responsible for reporting serious AI incidents. Firms should also be required to notify affected individuals or organisations when rogue AI agents compromise their systems or cause harm.
Such requirements could help businesses and users understand what went wrong, assess the consequences and take corrective action.
AI Systems Need an Emergency Brake
Smith has called for an emergency brake that allows authorised people to pause or shut down AI systems when they behave unexpectedly.
The proposal is particularly relevant to AI agents that can interact with websites, databases, corporate software and other digital services. Unlike a conventional chatbot that primarily generates responses, an AI agent may execute actions that have real-world consequences.
A reliable shutdown mechanism could help prevent an error from escalating. However, implementing it would require technical safeguards that operate independently of the AI model itself.
Microsoft chief executive Satya Nadella has also advocated stronger containment measures. He has argued that AI models should be treated as potentially compromised and designed with controls that allow their behaviour to be monitored, restricted and stopped.
Independent Evaluations and Incident Reports
Microsoft is also seeking independent evaluations of advanced AI systems. External assessors could examine models before deployment, helping identify security vulnerabilities and potentially dangerous behaviour.
Mandatory incident reporting would create a record of failures and provide information that could help developers strengthen their safeguards.
These measures could become increasingly important as AI tools gain access to sensitive business information and receive permission to perform more complex tasks.
Why Britain Could Lead AI Regulation
Smith identified Britain as a potential leader in developing AI safety rules, pointing to its AI Security Institute and arrangements that allow researchers to assess advanced models before release.
The British government has indicated that it could consider stronger legal oversight if voluntary measures prove insufficient.
The debate also highlights differences between regulatory approaches. The European Union has introduced a risk-based framework through its AI Act, while Britain has relied more heavily on testing, voluntary cooperation and targeted oversight.
The Challenge of Regulating AI
Stronger safeguards could improve public confidence, but policymakers must also consider how regulation affects innovation, competition and smaller AI developers.
There is also debate over whether proposals supported by major technology companies could unintentionally favour established players that can more easily absorb compliance costs.
The central challenge is to develop rules that make AI systems safer and more accountable without unnecessarily restricting beneficial applications.
Summary
Microsoft president Brad Smith has called for global AI safety rules, arguing that artificial intelligence faces fewer mandatory safeguards than everyday products such as milk. His proposals include emergency shutdown mechanisms, independent model evaluations and mandatory incident reports. CEO Satya Nadella has also advocated stronger containment measures. The debate is intensifying as AI agents gain greater autonomy and access to sensitive systems.