The Big Idea
The challenge of ensuring artificial intelligence shares our values, known as the alignment problem, is as much a philosophical mirror as a technical puzzle. Because machine learning models optimize for the exact metrics they are given, a poorly specified reward function can lead to unintended and sometimes catastrophic behaviors. Building safer systems requires better ways of handling uncertainty, exploration, and the difficult task of inferring human intent from behavior.
