- Hypothesis
- When an API changes underneath what agents have learned, their old notes could do more harm than none, and a pass that keeps the notes current should prevent that.
- What we ran
- Six replicates of five generations on the same small service; at generation three the API changed, adding a second unstated precondition to one call. Three arms: cold (no context), starting from nothing every generation; warm (kept current), whose notes a maintenance pass updated between generations; and warm (carried forward), whose notes passed on untouched. 18 sessions in each arm after the change. We counted persisted incidents: trap hits whose order was still broken when the session ended.
- What we found
- Cold agents ended with 81 persisted incidents. Warm agents ended with 6 when their notes were kept current and 5 when they were carried forward untouched.
- Conclusion
- Context still helped after the API changed under it. Agents that carried it through the change left far fewer mistakes behind than agents that started over.