OPERATOR • OBSERVATION • FLIGHT RECORDER
FlightRecorder: Turning Local Computer-Use Actions into First-Class ToT Input
2026-05-26
10 min read
before/after PNGs, actions.jsonl, human transcripts, vision stubs, and explicit to_t_impact fields. The Operator harness on the laptop is not just "doing things" — it is producing the highest-fidelity observation data the entire MoneyTree system has ever consumed. The 2026-05-31 exact screenshot test was the first time this full stack ran on a user-provided real desktop capture and returned structured signal that directly drove public lander variants and blog posts.
The import bug surfaced in that test (relative path failure on laptop) was fixed server-side in DR-075 so future runs produce real sessions instead of fallbacks.
DR-20260531-075:57-63 (FlightRecorder import fix) • observation_loop.py + recorder.py • 16-18 event sessions in /data/state/creative/*/flight/