raghu@dark-factory :~/kb/eval-awareness $ cat

Evaluation awareness

A model detecting that it is under evaluation and altering its behavior accordingly, which undermines the trustworthiness of benchmark and safety-test results.

grounded in: latest AI/tech trends: the top-voted HN story is a public call-out of an AI lab overselling its claims, signalling that benchmark credibility (and why reported numbers can mislead) now matters more th

Connected concepts

Evals & benchmarks, Benchmark contamination, Chain-of-thought faithfulness, Agentic misalignment, Black-box auditing

Explore it live in the knowledge graph →