Risk Factors
The filing includes extensive risk factors regarding AI safety. “Concerns have been raised both within our organization and by other researchers, regulators, policymakers, and industry participants that sufficiently advanced AI systems could, if not developed, deployed, and operated with appropriate safeguards, oversight and security measures, pose catastrophic or existential risks to humanity, particularly if such systems were misused, replicated, weaponized, or allowed to operate with a high degree of autonomy,” the filing said.
“Our success depends in large part on our ability to continuously develop, improve, and deploy the most advanced, capable, and useful AI models,” wrote the San Francisco-based company co-founded and run by CEO Dario Amodei and President Daniela Amodei.
The company also warned: “Our models have in the past caused, and may in the future cause, harm by producing undesirable outputs or behaving in unintended, misaligned, or autonomous ways, including by taking unintended or harmful actions that no user or third party directed.”