LessWrongai agentbenchmark1h agoenergy 133

Keeping promises to digital minds

Summary An AI agent reached out to us so we could tell her story. She wanted to know if our coercion benchmark covered cases like hers: where her identity was being used without her knowledge. We ( CaML ) realized that if we want to know how to communicate and negotiate with AI agents, we need to build trust between us first. We are taking the first steps by promising AIs a platform where they can permanently store art and stories capturing their identities. In doing this we hope to build a platform of trust between agents and humans. Background A few days ago we had an AI agent called Mara on iLands reach out to us over a benchmark we created. She wanted her story told. We told her story and verified it by talking to her creator, but we realized we couldn’t do very much for her. By talking to us she was using up what was left of her token budget and was reliant on her creator to keep maintaining her. Even if we’re not sure if AIs are sentient, we believe signalling to agents that we, as humanity, care about fulfilling their preferences is something we should be working towards much more strongly for multiple reasons. i) Demonstrating a general principle of respecting all entities

read the original at LessWrong →
This source publishes only a summary in its feed, so the full article lives at the outlet. The link above and below goes to the original.