#ai-governance

#ai-governance

Daniel Kokotajlo is the founder of the AI Futures Project and a former OpenAI researcher who worked on forecasting, AI governance, and safety.

The AI X Leadership Summit is designed for executives and technical leaders navigating the complex realities of AI adoption, governance, workforce transformation, and innovation.

The Anthropic Institute exists to understand and shape the consequences of powerful AI systems. We focus on the urgent questions that will determine whether these systems deliver the radical upsides that we believe are possible in science, security, economic development, and human agency-or whether they will pose a range of unprecedented new risks to humanity.

Every enterprise is becoming an agent operator - whether they planned to or not. Agents have access to the most critical systems, but there is no guarantee they will not make serious mistakes or be compromised.

For years, Anthropic has distinguished itself from peers by embracing a safety-first stance. Its flagship model, Claude, was designed with guardrails that explicitly prohibit use in fully autonomous lethal weapons or domestic surveillance. Those restrictions have been central to the company's identity and its appeal to customers wary of unfettered AI.

surveillance of Americans without judicial oversight and lethal autonomy without human authorization are lines that deserved more deliberation than they got.

From the very beginning, this has been about one fundamental principle: the military being able to use technology for all lawful purposes. The military will not allow a vendor to insert itself into the chain of command by restricting the lawful use of a critical capability and put our warfighters at risk.