NotesNote

Designing the Way Back

Before giving an agent more room to act, ask how its actions can be inspected, stopped, and reversed. Recovery is part of the working interface, not an afterthought.

Note

An agent demonstrates a successful action. It edits the document, reorganizes the folder, or updates the record. The next question is usually how much more it can handle.

Another question deserves to come first: what would it take to undo that action?

The cost of being wrong

A proposed sentence and a sent message are not equivalent actions. Both can be produced by the same model, but their consequences are different. One can be discarded privately. The other has already reached someone else.

The boundary should follow the consequence, not the apparent simplicity of the command.

For reversible local changes, it may be reasonable to let an agent proceed and make its work easy to review. For actions that affect other people or cannot be reliably reversed, a preview and explicit approval may be worth the interruption.

“Human in the loop” is too vague to settle this. The useful questions are where the person enters, what they can inspect, and whether their intervention happens before or after the consequence.

Recovery needs evidence

A promise that changes are recoverable is not a recovery mechanism.

There needs to be a known earlier state, a record of what changed, and a way to restore the relevant part without destroying newer work. A backup that cannot be located at the moment of failure offers little practical reassurance.

Suppose an agent reorganizes a set of files. A readable mapping from old paths to new paths is more useful than a reassuring completion message. If some files changed after the move, restoration should not silently overwrite those changes.

The way back has its own requirements. It should be tested on a small case before the system is trusted with a larger one.

Trust without constant supervision

Checking every minor step is exhausting. Letting everything happen invisibly is a different kind of burden: the user has to wonder what might have changed.

A better interface can allow bounded work, expose the resulting differences, and make the stopping point clear. The user reviews the consequence of a coherent action rather than supervising every movement that produced it.

This does not make an agent infallible. It makes a mistake easier to understand and contain.

The design of delegation includes both a path forward and a path back. Capability determines what the system can attempt. Recovery helps determine what it is reasonable to let it attempt without watching continuously.

Read nextThe Work Around the Task