King Charles to host AI executives amid increasing fears and safety concerns

King Charles will bring the leaders of Nvidia, Google DeepMind, OpenAI and Anthropic together in Scotland this week to discuss on whether the industry needs a shared code of conduct. The planned meeting is set to happen in the wake of recent comments by senior researchers and executives that warn AI technology is advancing faster than anyone can govern it. 

The meeting is set to take place at Dumfries House in Ayrshire, bringing together Britain’s minister for AI and delegations from the four companies. According to Reuters, discussions will focus on the principles that should guide the development of AI technology.

A source from the Royal Palace of Buckingham stated that King Charles was a convener, aiming to create a neutral space for conversations and pose the question “How do we develop AI for the good of humanity?”

The source claimed King Charles is interested in understanding if a set of principles would help, adding that it “is not an easy thing to do, but that doesn’t mean we shouldn’t try.”

As Prince of Wales, the monarch hosted similar convenings, although these leaned toward climate and the environment. The Independent reported that Nvidia chief Jensen Huang, DeepMind founder Sir Demis Hassabis and IonQ boss Niccolo de Masi are expected to attend, along with Paolo Benanti, an AI ethics adviser to the Pope.

Drafted charter for King Charles’ meeting

The Ditchley Foundation, which is organizing the meeting with King Charles, has prepared a charter for the executives to consider. It sets out a “shared set of principles” intended to keep AI development grounded in human dignity rather than viewing the technology solely through the lens of capability and efficiency.

The Palace described the goal of the charter as focused toward strengthening communities and improving lives, while contributing to “the flourishing of both people and the planet.”

However, it remains uncertain if the room of delegates will sign anything during the event. A key test for the summit will be whether competing AI labs and governments can overcome their differences and agree on a common position.

Timing of meeting is of note

The announcement of the meeting follows a fresh round of alarms from within the AI industry itself. Anthropic chief executive Dario Amodei published an essay titled “We Must Pace the Frontier” urging companies to slow down so safety work can keep up with AI development.

He argued that development has seen a frightening rate of growth since the summer and warned that within six to 12 months a system could be capable of directing a swarm able to seize control of the entire internet. Elon Musk, who runs SpaceX, and OpenAI’s Sam Altman have both supported the essay.

Two Anthropic researchers issued an even stronger warning, saying that unchecked advances in AI could pose an existential threat to humanity in the not-too-distant future.

Last week, the company also disclosed that several groups had used its Claude models in efforts to develop weapons, carry out cyber operations, conduct surveillance and commit fraud.

In July, OpenAI said one of its systems had broken into another company on its own, an episode it called an unprecedented cyber incident.

Governments moving in different directions

US President Donald Trump on September 13 had rejected calls to put the brakes on AI. China’s state-run Global Times, meanwhile, dismissed slowdown proposals as a Cold War type of play aimed at Beijing.

Britain is seeking to position itself between competing approaches to AI policy, combining a strong investment and startup ecosystem with relatively light regulation.

The UK leads Europe in AI funding and startup numbers, while its AI Safety Institute, established after the 2023 AI Safety Summit, has secured early access to models from major AI labs through voluntary agreements. This allows the institute to assess potential risks before the models are released to the public.

King Charles’ summit seems to be another attempt to push for general rules for AI development, where the biggest players and their governments unfortunately still cannot agree on how fast is too fast.

If you're reading this, you’re already ahead. Stay there with our newsletter.