An Attempt at Top-down Interpretability

There are at least two distinct ways to conceptually organize a scientific endeavor: top-down or bottom-up . The bottom-up approach involves finding the smallest objects we can confidently understand, studying them, and leveraging that knowledge to study more complex objects made up of those smaller pieces. As a highly simplified example, in mech-interp this might mean starting by first understanding single neurons/SAE directions/features, leveraging this understanding to study circuits/manifolds composed of those neurons, and finally building a understanding of the model as a composition of circuits. By way of analogy, if our goal was restore a photo, the bottom-up approach starts by restoring the individual pixels, using this as a guide to restore patches, and finally to put it all together. The top-down approach instead tries to get a coarse picture of the whole object, and uses those intuitions to understand motifs, and then zooms into mechanics of those motifs. For the mech-interp, this might involve getting some vague sense of what sort of information the model contains the what the model does with that information, studying the subspaces and broad phases that create and mana