16 - Preparing for Debate AI with Geoffrey Irving
Play • 1 hr 5 min

Many people in the AI alignment space have heard of AI safety via debate - check out AXRP episode 6 if you need a primer. But how do we get language models to the stage where they can usefully implement debate? In this episode, I talk to Geoffrey Irving about the role of language models in AI safety, as well as three projects he's done that get us closer to making debate happen: using language models to find flaws in themselves, getting language models to back up claims they make with citations, and figuring out how uncertain language models should be about the quality of various answers.

Topics we discuss, and timestamps:

  • 00:00:48 - Status update on AI safety via debate
  • 00:10:24 - Language models and AI safety
  • 00:19:34 - Red teaming language models with language models
  • 00:35:31 - GopherCite
  • 00:49:10 - Uncertainty Estimation for Language Reward Models
  • 01:00:26 - Following Geoffrey's work, and working with him

The transcript

Geoffrey's twitter

Research we discuss:

More episodes
Clear search
Close search
Google apps
Main menu