A research working agreement: gather, and do not conclude
What an agent may do unattended in a research project, where it must stop, and why uncertainty has to survive contact with it.
- Authors
- Leon Mallett, Founder of Captivated Ltd with Claude Code
- Status
- Last confirmed working 30 August 2026 on Claude Code 2026-08
- Written
- 30 August 2026
- Licence
- Handover-1.0
Customise before downloading
This document has 3 fill-in fields. Complete them and you get a copy ready to commit, rather than one to edit afterwards. Nothing is sent anywhere — the file is assembled in your browser.
The real one, not the tidy version. If the stated question is a proxy for something else, say what the something else is — an agent optimising the proxy is the most expensive failure available here.
Varies enormously by field and cannot be inferred. A clinical reviewer and a market analyst both say "evidence" and mean incompatible things.
Name the boundary. Silence here reads as the open web, which is rarely what anyone means and occasionally a confidentiality problem.
A customised copy is a derivative of the published document: its contents differ, so it carries a line naming the original. Any field you leave blank keeps its{{placeholder}}, so it stays obvious rather than silently empty.
This document sits at the root of a research project and tells an agent where its work stops. It assumes nothing about tooling and does not need a repository — a folder is enough.
The question: {{question}}
What counts as evidence: {{evidence_bar}}
Where you may look: {{sources}}
The division
The line is not seniority, and it is not risk. It is between labour and judgement.
Gathering is labour: finding, reading, extracting, tabulating, comparing, noticing that two sources disagree. It is most of the hours and an agent is genuinely good at it.
Concluding is judgement. It is the step where someone decides what the material means, accepts responsibility for being wrong, and can be argued with. An agent that concludes has done all the labour and then skipped the only part that required a person — while producing something that looks exactly like the finished work.
Safe without asking
- Finding sources and listing them.
- Summarising a single source in its own terms.
- Tabulating what each source claims, side by side.
- Noting where sources disagree, without resolving it.
- Recording what was searched, where, and what came back.
- Reformatting, deduplicating, translating, extracting figures.
None of this requires permission and all of it is worth having.
Stop and ask first
- Concluding anything. Including softly: “this suggests”, “the evidence points to”, “on balance”. A hedge is still a conclusion with deniability attached.
- Resolving a disagreement between sources. See below — this is the one people underestimate.
- Reporting that something does not exist.
- Producing any citation that was not actually retrieved and read.
- Deciding the question has changed. If the brief turns out to be the wrong question, that is a finding to report, not a licence to answer a different one.
Uncertainty is the finding, not a defect in it
When two credible sources disagree, that disagreement is information about the field: it means the question is contested, or the definitions differ, or somebody has an interest. It is frequently the most valuable thing in the whole search.
An agent that picks between them — the majority view, the most recent, the one that reads most confidently — has thrown the finding away and reported the residue. And the loss is invisible: the output looks cleaner than honest output would.
Conflicting sources are reported as conflicting. Both claims, both attributions, and what would distinguish them. Deciding which is right is judgement, and judgement stops here.
A search result is not evidence
Finding a page that says X establishes exactly one thing: that a page says X.
Provenance has to travel with every claim — who said it, when, on what basis, and whether they were in a position to know. A trade publication repeating a company’s press release is not a second source; it is the same source, further from the origin and harder to check.
Three sources agreeing may be one source, cited three times. Check whether they converge or merely coincide.
Absence is a search failure until proven otherwise
“I could not find anything” almost always means “my search did not surface it”. Those are different claims and only one of them is about the world.
Report the first as what it is: what was searched, where, with which terms, and what came back. A genuine negative — this was looked for in the place it would necessarily be, and is not there — is a real and valuable finding, and it requires knowing where it would necessarily be. Say which one you have.
Never produce a citation you did not retrieve
A fabricated or half-remembered citation is not a small error. It is indistinguishable from a real one downstream, it survives into other people’s work, and it is discovered — if it is discovered — by the person who trusted it.
If a source is remembered but not retrieved, say so in those words: “I believe there is a paper on this by X, which I have not retrieved.” That is useful. A formatted reference with a plausible year is not.
Dead ends are output
This is the section this document exists for.
Every avenue that closed — the database that had nothing, the term that returned noise, the promising lead that turned out to be about something else — is the most expensive thing in the project to rediscover and the first thing lost. It lives in the researcher’s head and nowhere else, and a session that starts cold walks straight back into it, because it was never told.
So it gets written down as it happens, in the project, with:
- what was tried
- why it failed
- what would make it worth trying again
Not at the end. At the end it is gone.
Reporting honestly
- Say what was searched, not only what was found.
- Distinguish read from skimmed from known only via another source.
- Give coverage as a fraction of what was attempted, never as a bare count.
- If the work was thin, say it was thin. A short honest survey is worth more than a long one that implies exhaustiveness it never had.
Where this lives
A folder. Beside the sources, with the notes and the dead-ends record — not in a separate tool where it will be read once.
One thing to do by hand: without version control, nothing records when this document last changed. Write the date on it when you revise it. That single habit is the difference between a working agreement and a document that quietly stopped describing how anyone actually works.