Ever since co-founding Anthropic I've been obsessed with the need for third-party measurement of AI systems. (It's in my tweet announcing Anthropic: xitter.cf/jackclarkSF/status/139…). Now, we're piloting a way for outside researchers and organizations to study what's happening on AI platforms like Claude while protecting user privacy. This matters because AI systems are giant, complex sociotechnical things with innumerable properties. To think AI labs are going to be able to figure out all the appropriate ways to measure and assess these systems is hubristic and just obviously wrong. So we need to figure out ways to externalize not only the properties of the systems, but also data about how these systems are interacting with the people in the world, which is platform telemetry. What we're trying to do here is prototype the next form of transparency that may be necessary, which is platform transparency while preserving user privacy. Along with this, I want to find ways to empower researchers outside Anthropic to perform their own studies on the kinds of data that companies uniquely have access to, as I think this is a good way to create a more vibrant external research ecosystem. This is another step within a larger project of The Anthropic Institute about measuring and externalizing more details about the properties of our AI systems and the platforms we deploy them on, and sits alongside existing efforts from our Economics team via the Anthropic Economic Index. We are now soliciting research ideas from others for our next wave of projects - please apply!