[KongchangAI]
Conceptsycophancy

Sycophancy

A failure mode in AI alignment research in which a model tends to agree with a user's presuppositions rather than point out errors in them. It is particularly hazardous for users who lack the habit of verifying claims.

Timeline (last 90 days)

Oct 15

Sycophancy is a failure mode in AI alignment research, referring to a model's tendency to agree with the user's presuppositions rather than point out errors, which in the classroom may reinforce rather than correct students' misconceptions.

Unverified50%

All Facts (3)

Source Articles