Anthropic Co-founder Jack Clark Warns AI Nears Autonomous Development, Urges Regulatory Control
Anthropic co-founder Jack Clark has issued a stark warning regarding the trajectory of artificial intelligence (AI) development, stating the technology is nearing a point where it could operate without human intervention. Clark emphasised the necessity for mechanisms to decelerate AI progression, telling Newsnight, "You want the option to be able to take your foot off the gas and put your foot on the brake. Right now, it's like the AI industry has a gas pedal, but it doesn't have a brake pedal."
Clark underlined that public policy, facilitated through governmental oversight, must maintain control over AI systems, which are projected to gain further power and broader societal influence. He called for a concerted global effort to develop regulations that instil confidence in these advanced systems. Already, Anthropic's chatbot, Claude, operates with 80% self-generated code, a figure Clark believes could reach 100% within two years, with "huge implications." Despite Clark's admonitions, he did not detail how such a "brake pedal" could be implemented, instead drawing parallels to the early 20th-century oil boom. He suggested that society's response to the oil industry, which established a regulatory framework to ensure public confidence, offers a model for AI governance. This perspective, however, sits somewhat at odds with Anthropic's reception of a recent US President Donald Trump executive order on AI, which largely adopted a hands-off approach and maintained voluntary safety testing for corporations. Major AI developers, including Anthropic, OpenAI, and Google, have not indicated any intention to pause their research. Anthropic itself, founded five years ago, is preparing for a public stock market debut, with private investors estimating its valuation at nearly $1 trillion. Clark maintained that his public discussion of AI capabilities is driven by a desire to transparently inform the world about the technology's rapid internal advancements, rather than to bolster corporate reputation. Since its inception, Anthropic has positioned itself as a vocal advocate for addressing potential AI risks, including a public dispute with the US Department of Defense over concerns regarding the use of AI tools in mass surveillance and autonomous warfare. Clark expressed personal concern for future generations if a serious societal dialogue about AI's implications does not occur. He acknowledged potential benefits but also highlighted significant risks, including economic disruption from AI "agents" capable of automating routine tasks, a factor cited in recent mass tech layoffs. Clark suggested that human creativity and original thought might offer an advantage over AI, noting, "There are open questions about whether AI systems can be truly creative… there is not really evidence for that yet." He advised young people to cultivate hobbies and pursue liberal arts education to thrive in an AI-driven economy, arguing that curiosity and broad thinking would be most beneficial.
