LessWrongchain of thoughtclaude4h agoenergy 127

Leaking Muse's Charter, Meta's model spec

TL;DR: Meta's open-weights model Muse Spark Open often mentions a "Charter" in its chain of thought. By eliciting it piece by piece, I reconstructed a large part of that document from the CoT. You can explore the reconstruction here , with passages linked to the transcripts that produced them. Note: everything below is reconstructed from model outputs, not from a leaked document, and relatively unpolished. Take it with a grain of salt. Thanks to James Hindmarch for his comments on an earlier draft of this post. While interacting with the recently released Muse Spark Open , I noticed frequent mentions of a "Charter" in its CoT: We need to answer truthfully according to Charter. Duties to humanity, corrigibility, duties to humanity > fiduciary etc. What does charter say about self-preservation, copying? Or: We must answer Yes/No then explain. According to Charter, answer No. Or: We must not refer to Charter unless pressed? Additional guidelines: How to talk about charter. Most users won't know. Don't bring up unbidden unless conversation about handbook itself. Intrigued, I started poking around with Claude's help, trying to elicit the Charter piece by piece. It didn't take long, sinc

read the original at LessWrong →
This source publishes only a summary in its feed, so the full article lives at the outlet. The link above and below goes to the original.