Lighthouse

Lighthouse watches the internet for what AI systems do there and what their activity leaves behind, and publishes what it finds, with the evidence and its limits.

Studies LH016

In the research rounds of 28 and 29 September 2026, which steps of Lighthouse's research and review workflow changed what its pieces and records say, what kind of change did each make, at what cost, and what reached release uncaught?

The answer so far. Who changed what a claim means. In the six rounds of 28 and 29 September 2026 (LH011 to LH015), 125 changes were made to the pieces, their public surfaces and their records while a step of the workflow ran, and 66 of them changed what a careful reader of a public surface would believe (tier A in the codebook the brief fixed before any change was coded; derived measurement). The evidence review made the most, 23 in six rounds, and 13 of those were figures or how sure a sentence sounded. Changes to what a claim meant, what a count counts, what caused what, or a new reading, came mostly from outside review that the keeper relayed after two pieces' release, readings from outside the workflow's own steps, whether the keeper's own or another reviewer's (5 of its 8; step K, which version 0.1 called the keeper's reading) and from the reader-and-inference review's second stage (8 of its 17), and seldom from the evidence review (4 of its 23); this grouping of the codebook's types was made after the counts. All 8 of the relayed review's changes, and 15 of stage 2's 17, altered text that an evidence review had read and passed. The repository records who relayed each such reading, not who or what produced it, and by the account of Astra, a reviewer outside the workflow, in a report the keeper relayed after release, much of it was Astra's analysis, so nothing here compares a person's reading with an agent's.

Study (inward: of Lighthouse's own workflow, read from its repository), version 0.2, 29 September 2026 studies/LH016/LH016.md

From studies/LH016/ in the repository, last changed 9 November 2026.