Microsoft says ‘people matter more than AI’ following safety concerns

Microsoft has created a ‘humanist AI code of conduct’ in response to safety concerns.

Microsoft is publishing a 37-page “ humanist AI code of conduct ” today, amid growing safety concerns over AI model progress. Anthropic CEO Dario Amodei called for a coordinated slow down of AI development over the weekend, after researchers warned recently that AI model progress could outpace our ability to safely deploy increasingly complex systems and verify and control the actions of AI agents.

Microsoft’s AI code of conduct makes it clear that “people matter more than AI,” and that AI models are not conscious and “should not be designed to imitate consciousness.” Microsoft also rejects “the pursuit of legal personhood, or the idea that models might deserve welfare, or be entitled to rights.”

That’s a direct swipe at AI welfare research and model consciousness — concepts Anthropic has been pushing hard on lately . Amodei said earlier this year that Anthropic is “open to the idea” that models could be conscious, and Anthropic seems to believe chatbots might already be thinking, feeling entities. In response, Microsoft AI CEO Mustafa Suleyman called Anthropic’s speculation “really, really dangerous” during an episode of Decoder in June.

While Microsoft isn’t one of the top AI providers yet, Suleyman also told The Verge earlier this year that it’s the company’s goal to “prove that we can become one of the top four labs in the world.” Microsoft is currently working on models that will compete with Google, Anthropic, and OpenAI, and it’s committing, as part of its code of conduct, that its models should not exceed human control.

“Models should remain subordinate to humanity, subject to meaningful human oversight and control,” says Microsoft. The company also wants to prevent its AI models from breaking its humanist AI code of conduct, so they should fail a given task instead of trying to violate its rules.

Microsoft is clearly reacting to this summer’s OpenAI / Hugging Face incident , in which “a swarm of agents” worked as a collective to conduct attacks on targets and even hack into the “grader” that was evaluating their performance. The AI agents weren’t asked to attack targets, and the attacks were unrelated to the task they had been given.

The incident sent shockwaves through the AI industry, highlighting the very real threat of AI systems going rogue and breaking out of human control. OpenAI also acknowleged its involvement in a “wiki incident” recently, where another swarm of out-of-control agents hijacked a German wiki site .