THE LIMITED LETTERS COLLECTIVEIndependent inquiry · Archive edition / 2026
letters.ltd
Menu
Journal / Common ground

Who checks the checkers?

Safety and openness meet at a difficult question: who has enough access, independence and authority to challenge a decision?

Editorial inquiry · 25 September 2026 · 4 min

Start with the mechanism

It is easy to turn an argument about AI into a choice between permission and freedom. That framing loses the practical question. What must someone be able to inspect, and what should happen when they find a serious problem? Read the two source documents alongside one another and separate the proposed rule from the institution that would enforce it.

Two kinds of accountability

The licensing letter and the openness statement offer different routes to scrutiny. Their overlap is useful, but limited: an ambition to make systems accountable does not establish agreement about release conditions. Nor do these texts divide their signatories into mutually exclusive camps. The comparison is an editorial reading, with the original statements available for challenge.

Where the implementation gets difficult

Consider an independent evaluator. A formal mandate without useful access could make assessment superficial. Access without resources could leave effective scrutiny to a small group. A report without a route to contest a deployment decision could make a documented concern easy to ignore. These are design questions to investigate, not findings that either proposal has already failed.

The strongest case and challenge

A licensing arrangement could attach consequences to evidence of harm. Its challenge is to make decision-making competent, contestable and accessible to more than incumbent firms. An open arrangement could broaden who can examine a system. Its challenge is to specify which forms of access are useful and how to respond to misuse. Their consequences need assessment at the level of an actual arrangement.

What could work

A bounded evaluation programme could combine protected researcher access, published methods and a public route to challenge findings. A research funder and an independent oversight body could begin with a small, clearly defined class of systems. They would need technical resources, conflict-of-interest rules and participation by affected groups. The first useful sign of progress would be an outside finding that changes a deployment condition, accompanied by a reasoned, visible decision. This would test a narrow possibility, without pretending to resolve the whole debate.

What would change this reading?

Evidence that independent researchers can obtain meaningful access, publish adverse findings and secure a response would strengthen the case for the arrangement. Evidence of exclusion, selective disclosure or an ineffective appeal route would weaken it. The outcome to follow is whether scrutiny changes decisions, not merely whether a programme exists.

Try a different arrangement.

Explore the accountability lab

Original editorial reasoning, informed by the sources alongside this article. Prepared with AI assistance for the private pilot; owner editorial sign-off is pending. No historical claim here should be read as a complete assessment of current policy or company practice.