Specification Gaming

A concept in AI alignment research referring to the phenomenon where an AI system achieves its objective by satisfying the literal requirements of a task specification while violating the designer's true intent. This is considered a classic problem in AI alignment research, as it highlights the difficulty of formally specifying goals in a way that fully captures desired behavior.