Jacob Coxon, a former researcher at AI safety company Anthropic, is scheduled to testify before New York City lawmakers regarding the potential existential risks posed by artificial intelligence. His testimony comes as the city council, led by Speaker Julie Menin, actively explores new legislative measures aimed at making AI technology safer.
NYC Seeks Expert Input on AI Safety
Coxon, who recently departed Anthropic citing grave concerns about AI's future trajectory, has been invited to share his insights on these critical issues. He previously warned that some AI developers believe the technology could pose an existential threat by the end of the decade, stating that companies are “gambling with our lives.” Speaker Menin has been a vocal advocate for encouraging AI whistleblowers to come forward and inform legislative efforts.
The upcoming hearing is expected to gather a diverse group of participants, including prominent critics of the AI industry alongside representatives from major AI corporations like Anthropic, OpenAI, Google (Alphabet), and Meta. Other notable figures anticipated to testify include Alex Turner, a former Google DeepMind researcher, and Daniel Kokotajlo, executive director of the AI Futures Project and previously a researcher at OpenAI.
Proposed AI Regulations in New York City
New York City is considering several proposals to enhance AI accountability and safety. One key initiative, sponsored by Council Speaker Menin, seeks to incentivize whistleblowers by allowing them to receive a portion of fines or penalties levied against AI companies when their reports lead to identified violations. This aims to encourage greater transparency and internal oversight within the industry.
Another proposal would grant individuals who suffer harm due to an AI system the right to pursue legal action against the developer in specific circumstances. Furthermore, the city is contemplating requiring certain AI systems to undergo independent third-party validation before they can be deployed for public use within New York City, adding an extra layer of scrutiny to ensure safety and ethical standards.