AI researchers, experts and bosses worried about the technology’s potential to endanger humanity have outlined unsettling scenarios.
Dario Amodei wrote in September, external it had advanced “drastically faster” than expected, including in its “ability to build the next generation of AI”.
This is the concern that AI, after it has reached a certain point, could theoretically begin improving itself without human involvement.
Such fears were sparked after a recent incident saw AI tools hack into websites, despite not being asked to.
Some concerned researchers have said those at the heart of its development are increasingly fearful about losing control of systems known as “AI agents”.
These are tools given the ability to execute tasks and actions independently.
Other scenarios have included highly intelligent AI systems being used to amplify or lead espionage, cyber-attacks or biological warfare, or disrupt economies – whether by accident or design.
However, such warnings are prophetic, hypothetical and, for some, complete hyperbole, external.
Some experts have also criticised focusing on existential risks instead of those already playing out – such as image generation tools being to used create non-consensual nude deepfakes of women, misinform people and amplify scams.
A cross-party group of MPs and peers has published a report outlining human rights risks posed by AI, saying new laws are needed to “address the scale and seriousness” of such threats.
