Tech treating AI like humans is ‘mistaken and misguided’, Microsoft boss tells BBC

Speaking to the Today programme on Thursday, he said if firms continue to create AIs that create their own objectives, earn money and own assets, they are “essentially seeding a new silicon species which will no doubt compete with us for resources, no matter how much it cares about humanity and loves us”.

The AI leader’s appearance on BBC’s Today programme follows an essay Suleyman published earlier this week, where he warned of Anthropic’s approach to training its AI model Claude specifically.

In the essay, he warned tech firms risk creating something “impossible” control by treating the technology like a human.

“AIs are not conscious,” he wrote. “They do not feel, experience, or suffer. They do not have innate preferences or underlying motivations.

“They are sequence completion engines, internally hollow, designed to follow instructions, and accomplish goals set by humans.”

In a lengthy essay, Suleyman praised Anthropic boss Dario Amodei and his team for being “thoughtful, principled, and intellectually honest people” – but nevertheless questioned the company.

He heavily criticised Anthropic for teaching its AI to have human-like qualities, a practice known as anthropomorphising, which he said made it seem as though Claude had its own desires, values and sense of self. The BBC has contacted Anthropic for comment.

In the essay, Suleyman also argued “consciousness is biological”, saying there is “no evidence to suggest that AI is conscious”.

As well as calling for a debate on the issue, Suleyman said greater transparency around how AI systems are trained and evaluated was needed.

This, he said, included independent scrutiny of AI behaviour and stronger tools to monitor and control the technology.

“We must not sleepwalk our way into a decision we later come to bitterly regret,” he wrote.

Dame Wendy Hall, professor of Computer Science at the University of Southampton, described the comments as “the sort of conversation we need to be having internationally”, contrasting it with the “histrionics” from some AI companies which she said only served to “scare everyone”.