Give each AI step
a job you can check.
By Alvin
Imagine asking an AI to answer a question from three notes. You could request a finished answer immediately, or divide the job into steps you can inspect. Research Relay, the program on page 43, demonstrates the second approach. Each role is a separate request to a model; one model can perform all three roles.
Planner: choose a useful small job
The planner chooses which supplied notes to use. Each note has a short label such as S1. You can read the selected labels and check that the chosen notes belong to your question.
Worker: leave evidence behind
A worker returns a claim and the exact words it used as evidence. The program checks that those words occur in the chosen note before continuing.
Reviewer: judge the interpretation
A quotation can be copied correctly and still be irrelevant. The reviewer examines the connection between the claim and the quote. You inspect its decision before approving a saved report.