Anthropic Publishes Guidance for More Reliable AI Safety Evaluations

Anthropic published recommendations for more reliable AI safety evaluations on November 13, 2026, reporting aggregate harmless-response rates of 94% to 98% for every recent model on its single-turn API tests. Those saturated tests are useful mainly as regression checks on known failure modes; multi-turn evaluations offer more variation and can capture gradual changes across a conversation. A safety evaluation measures a model’s propensity to cause or contribute to harm, whether its response...