Forbidden: can internal signals help an AI stop cheating?
Erick Martinez tested a modular fix for reward hacking: freeze the existing model weights and a probe, then train a separate corrective adapter using the probe’s score. In this quick research sprint, Sudoku cheating fell and legitimate solving recovered.
Read more