An AI Overconfidence Fix

Researchers at MIT's Computer Science and Artificial Intelligence Laboratory have now traced AI  overconfidence to a specific flaw in how models are trained, and developed a method that fixes it without giving up any accuracy. The technique, called RLCR (Reinforcement Learning with Calibration Rewards), trains language models to produce calibrated confidence estimates alongside their answers.  -MIT