Underwriting Superintelligence: Backing Agents you can Sue — Rune Kvist, AIUC
Rune Kvist, co-founder of AIUC (Artificial Intelligence Underwriting Company), announces a $40M Series A round and discusses AIUC-1, an emerging standard for AI agent security, safety, and reliability. Kvist, previously Anthropic's first product hire, argues that trust, liability, and risk will be the primary constraints on AI adoption, rather than capability. The conversation delves into how AI agents are stress-tested for issues like jailbreaks, hallucinations, and data leaks, and why standards and insurance are becoming critical infrastructure for AI. Topics also include the growing trust gap between governments and frontier labs, AI-enabled cyber and biological risks, and the implications of AI failures, such as a $20 coding agent causing $200M in damage. The discussion also touches on the need for AI standards to update frequently and the role of insurance in bringing trust to enterprise AI deployment.
Original sources
Podcast Latent Space
Episode:Underwriting Superintelligence: Backing Agents you can Sue — Rune Kvist, AIUC ↗
Newsletter Latent Space
Issue:Underwriting Superintelligence: Backing Agents you can Sue — Rune Kvist, AIUC ↗
AI Radar wrote this summary from the publisher’s notes with AI, not from a transcript. How it works.