San Francisco Frontiers - King Charles to call on tech giants for 'reassurances' over AI

The gathering at Dumfries House will include senior representatives from Nvidia, Google DeepMind, OpenAI, Anthropic, and Britain's minister for artificial intelligence, Buckingham Palace said.

The debate over the risks of artificial intelligence has intensified since the beginning of the summer, fuelled by several incidents and apocalyptic warnings from industry professionals.

"Those in our world who value our humanity and its vital moral component are anxiously seeking your reassurance that we will not lose control of our destiny," Charles will say at the opening of the conference, according to a statement from the palace.

"The task before you is not merely to advance technology, but to ensure that it remains firmly in the service of humanity, community and the natural world," the British monarch will say.

The conference could, however, be overshadowed by dramatic claims by the late Princess Diana's brother that Charles acted insensitively following her death in a car crash almost 30 years ago.

Buckingham Palace hit back after Charles Spencer claimed in his new memoir that the then-prince, Diana's former husband, said "we'll forget her soon enough" days after she died in 1997.

"His Majesty is mindful that the pain of fraternal grief can cloud reason, affect judgment and colour memory in ways others do not recognise, even many years after such a loss," a palace spokesperson said.

- 'Humanity must remain sacred' -

The Palace has not published the full list of guests, but according to sources close to the event, DeepMind president Demis Hassabis, the head of American semiconductor giant Nvidia Jensen Huang, and OpenAI's chief financial officer Sarah Friar are among the participants.

The head of the US quantum computing group IonQ Niccolo de Masi will also be there.

The king, who considers the development of AI to be both intriguing and deeply concerning in equal measure, will not take part in the discussions.

He will join the participants before the start of the summit to urge them to consider how to harness AI "by putting safety at its heart" and to build international cooperation so that "no nation is left behind -- and the future of mankind protected", according to Buckingham Palace.

As artificial intelligence evolves, "our humanity must remain sacred," he will stress.

A charter was drawn up ahead of the summit by the Ditchley Foundation, a UK charity overseeing the discussions, according to the Sunday Times.

– 'Global coordination' –

Rapid advances in AI have fuelled concerns over job losses and the soaring energy demand and environmental impact of data centres.

Fears that designers of AI agents could lose control of their creations intensified after several models from OpenAI and Anthropic reportedly broke out of their confined environments on their own, accessed the internet, and intruded on websites and platforms.

Anthropic's CEO, Dario Amodei, on Saturday called on companies in the sector to slow down their development in order to better understand the risks, receiving support from OpenAI CEO Sam Altman and Elon Musk.

The head of Microsoft AI, Mustafa Suleyman, told the BBC on Thursday that the development of AI that can act autonomously could create "a new silicon species, which will no doubt compete with us for resources".

On Wednesday, UN Secretary-General Antonio Guterres said global coordination on AI was "indispensable" while Pope Leo XIV warned against the temptation to delegate to algorithms decisions that fall within the exclusive realm of human responsibility.

US President Donald Trump and several members of his majority have, by contrast, reiterated in recent days their determination not to constrain the sector, officially out of concern that doing so would allow China to gain the upper hand.

Mark Zuckerberg, the head of Meta, has rejected calls to slow the development of this technology, arguing that market forces and the risk of litigation are the best safeguards.

T.Rivera--SFF