������

This week the US Federal Bureau of Investigation  of bombing a fertility clinic in California last month allegedly used artificial intelligence (AI) to obtain bomb-making instructions. The FBI did not disclose the name of the AI program in question.

This brings into sharp focus the urgent need to make AI safer. Currently we are living in the “wild west” era of AI, where companies are fiercely competing to develop the fastest and most entertaining AI systems. Each company wants to outdo competitors and claim the top spot. This intense competition  – especially when it comes to safety.

Coincidentally, at around the same time of the FBI’s revelation, one of the godfathers of modern AI, Canadian computer science professor Yoshua Bengio,  dedicated to developing a new AI model specifically designed to be safer than other AI models – and target those that cause social harm.

So what is Bengio’s new AI model? And will it actually protect the world from AI-faciliated harm?

In 2018, Bengio, alongside his colleagues Yann LeCun and Geoffrey Hinton, won the Turing Award for groundbreaking research they . A branch of machine learning, deep learning attempts to mimic the processes of the human brain by using artificial neural networks to learn from computational data and make predictions.

Bengio’s new nonprofit organisation, , is developing “Scientist AI”.  this model will be “honest and not deceptive”, and incorporate safety-by-design principles.

According to a  released online earlier this year, Scientist AI will differ from current AI systems in two key ways.

First, it can assess and communicate its confidence level in its answers, helping to reduce the problem of AI giving overly confident and incorrect responses.

Second, it can explain its reasoning to humans, allowing its conclusions to be evaluated and tested for accuracy.

���Գٱ������پ��Բ�����,��. But in the rush for speed and new approaches, many  can’t explain their decisions. Their developers have sacrificed explainability for speed.

Bengio also intends “Scientist AI” to act as a guardrail against unsafe AI. It could monitor other, less reliable and harmful AI systems — essentially fighting fire with fire.

This may be the only viable solution to improve AI safety. Humans cannot properly monitor systems such as ChatGPT, which handle over a billion queries daily. Only another AI can manage this scale.

Using an AI system against other AI systems is not just a sci-fi concept – it’s a common practice in research to .

Large language models and machine learning are just small parts of today’s AI landscape.

Another key addition Bengio’s team are adding to Scientist AI is the “” which brings certainty and explainability. Just as humans make decisions based on their understanding of the world, AI needs a similar model to function effectively.

The absence of a world model in current AI models is clear.

One well-known example is the “”: most of today’s AI models can imitate the appearance of hands but cannot replicate natural hand movements, because they lack an understanding of the physics — a world model — behind them.

Another example is how models such as .

This is despite simpler AI systems, which do contain a model of the “world” of chess, .

These issues stem from the lack of a foundational world model in these systems, which .

Bengio is on the right track, aiming to build safer, more trustworthy AI by combining large language models with other AI technologies.

However, his journey isn’t going to be easy. LawZero’s  is small compared to efforts such as the  announced by US President Donald Trump earlier this year to accelerate the development of AI.

Making LawZero’s task harder is the fact that Scientist AI – like any other AI project – needs huge amounts of data to be powerful, and .

There’s also an outstanding question. Even if Bengio can build an AI system that does everything he says it can, how is it going to be able to control other systems that might be causing harm?

Still, this project, with talented researchers behind it, could spark a movement toward a future where AI truly helps humans thrive. If successful, it could set new expectations for safe AI, motivating researchers, developers, and policymakers to prioritise safety.

Perhaps if we had taken similar action when social media first emerged, we would have a safer online environment for young people’s mental health. And maybe, if Scientist AI had already been in place, it could have prevented people with harmful intentions from accessing dangerous information with the help of AI systems.

Main image source: