LessWrongalignmentsafety3h agoenergy 119

Some different lenses of agency and their implications for alignment

TL;DR; These nine lenses on agency give you a wide range of tools to model and interpret agents. Each gives you lens-specific alignment methods and lens-specific risks to address . Epistemic status: Little here is new in a general sense; it's value lies in the synthesis and in providing a single point of reference. The concepts of agent and agency (derived from the Latin agere , to do or drive) are ubiquitous in AI safety, yet they do not pick out a clearly bounded set of things or properties and are used in a great variety of ways . One response to this is to argue about their ‘proper’ use (e.g. what is a ‘real’ agent). However, we suggest that because of these terms’ centrality to how we think about both humans and AI systems, it may be better to survey this diversity as offering various ‘lenses’ through which the fundamental challenges of alignment can be perceived. Below, we describe a varied assortment of these lenses, what they tend to highlight and obscure, and how they influence the way we think about AI risk and alignment. This list, and the framing behind it, comes out of discussions at the 2026 PIBBSS summer fellowship. Agents as goal-directed systems Many formal definit

read the original at LessWrong →
This source publishes only a summary in its feed, so the full article lives at the outlet. The link above and below goes to the original.