Discussion about this post

User's avatar
Meredith Sossman's avatar

Great piece. The prescriptions (held-back tests, charter above memory, generational handoff) all work one agent at a time. I'm curious how you'd apply them to the case in section 4, where no single agent fails its own tests but the system drifts through its handoffs.

K-ion14 built governance that operates between agents at runtime, because, as you point out, once the summary exists the influence is already baked in.

Marius Laurusevicius's avatar

Retiring an agent on a schedule is a management-system question before it is an engineering one. ISO/IEC 42001:2023, published 18 December 2023, sets requirements for an AI management system organised around Plan-Do-Check-Act, which puts the check step after deployment rather than at release. For a ten-person firm with no AI team, that turns into one cheap habit: a fixed date in the calendar to re-run the original task set against whatever is in production, and a named owner for the decision to reset the memory store. Neither needs new tooling, and both survive the person who set them up.

1 more comment...

No posts

Ready for more?