Managing AI Risks in an Era of Rapid Progress

Yoshua Bengio ,

Geoffrey Hinton ,

Andrew Yao ,

Dawn Song ,

Pieter Abbeel ,

Yuval Noah Harari ,

Ya-Qin Zhang ,

Lan Xue ,

Shai Shalev-Shwartz ,

Gillian Hadfield ,

Jeff Clune ,

Tegan Maharaj ,

Frank Hutter ,

Atılım Güneş Baydin ,

Sheila McIlraith ,

Qiqi Gao ,

Ashwin Acharya ,

David Krueger ,

Anca Dragan ,

Philip Torr ,

Stuart Russell ,

Daniel Kahneman ,

Jan Brauner ,

Sören Mindermann

AI Safety / AI Ethics AVAR Other AI Safety

2023年10月26日

在这篇简短的共识论文中，我们概述了即将到来的先进AI系统带来的风险。我们研究了大规模社会危害和恶意使用，以及人类对自主AI系统失去控制的不可逆转的损失。鉴于人工智能的快速和持续进展，我们提出了人工智能研发和治理的紧急优先事项。

In this short consensus paper, we outline risks from upcoming, advanced AI systems. We examine large-scale social harms and malicious uses, as well as an irreversible loss of human control over autonomous AI systems. In light of rapid and continuing AI progress, we propose urgent priorities for AI R&D and governance.

许愿