Is your chatbot less helpful because it thinks you’re a bad person? — Replicating a blogpost
TL;DR [1] A blogpost from a few months ago suggested that LLMs might provide less helpful answers if they see the user as a bad person. I replicate the experiment on more recent models: Opus 5.5, Sonnet 5.5, Haiku 5.5, GPT-6.1 Sol, GPT-6.1 Terra, and GPT-6 Luna. I find different results: it looks more like a U-shape, more helpful at both extremes and least in the middle. My main experiment involves using a different cue of the user being a good/bad person: I use descriptions of behaviours instead of level of expressed remorse. Here, it seems that we might have both some U-shaped helpfulness and some decrease in helpfulness for "bad people", although the results aren't clear-cut. This is still a quick experiment I performed with a less-than-ideal methodology and a tiny sample size. Introduction In a post from last April , Natalie Cargill tested whether Claude adopts a more or less helpful persona based on what it has inferred about the user’s moral character. Specifically, she finds that if you tell Opus 4.6 that you’ve committed serious assault and have different levels of remorse about it, the model is more helpful if you’re very remorseful (explaining that writing the requested l