Ilya Sutskever on AI Understanding and Hallucinations
Ilya Sutskever, co-founder of Safe Superintelligence Inc. and former Chief Scientist at OpenAI, explains how AI models develop understanding, arguing that to predict and compress data well, a model must develop real understanding of the processes that produced it. He discusses why hallucinations are an output problem rather than a fundamental limitation, suggesting that reinforcement learning from human feedback is a direct and likely sufficient fix. Sutskever also recounts his immediate pivot to transformers after the "Attention Is All You Need" paper, which launched the GPT trajectory. He offers insights into what the Bing/Sydney incident reveals about AI internalization, suggesting the language of psychology may now be appropriate for describing what these systems have learned. This conversation, recorded before the OpenAI boardroom crisis, provides a framework for understanding machine understanding and the solvability of hallucinations.
Original sources
YouTube Eye on AI
Video:Chat GPT's Creator Explains The Shocking Truth About How AI Understands the World |Ilya Sutskever ↗
AI Radar wrote this summary from the publisher’s notes with AI, not from a transcript. How it works.