F4: The Scout Report

An evening of research

Imagine your town is about to vote on a proposal you have opinions about. You have already said so, more than once, to friends and online. A neighbor you respect, who has not made up her mind, asks if you would look into it and tell her what you find. You are flattered, and you mean to be fair.

So you spend an evening reading. You type in search terms that, now you think about it, contain your conclusion. You open the articles that agree with you first and read them to the end. The ones that disagree you skim for their weakest line. By eleven o'clock you have a tidy case, and the next morning you tell your neighbor, "I looked into it properly, and honestly, the evidence is pretty clear."

Nothing you told her may be false. But she asked for a map and you handed her a brief, and called it a map. You did not lie to her. You did something harder to catch: you misreported what kind of thinking you had been doing, to her and to yourself.

The move

The Scout Report is a tool, which on this site means a mental operation you can run in real time, on a claim or on your own reasoning. Its tagline is the instruction: declare your mode. Are you defending territory, or mapping it?

There are two honest modes of engaging with a contested question. In advocacy, you hold a position and make the best case for it. In inquiry, you are genuinely unsure and follow the evidence to see where it goes. Both are legitimate. Advocacy is how positions get tested in public; a trial needs lawyers as well as a jury. The trouble starts when the two are confused, because confusing them "produces maximum confidence with minimum accuracy." The advocate who believes they are an inquirer gets an advocate's certainty and an inquirer's sense of having earned it.

Running the tool takes four steps.

1. Before you start reading, arguing or writing about a question, ask which mode you are in. Do you already know what you hope to find?
2. Say it, at least to yourself, and to others when it matters. "I'm making the case for this" and "I honestly don't know yet" are both respectable sentences.
3. If you claim to be mapping, behave like it. Look for the strongest material on every side, and decide in advance what you would need to see to change your mind.
4. When you report back, report your mode along with your findings. If you started out defending and ended up somewhere unexpected, say that too; it is the most useful thing you can tell anyone.

Why it works

The tool belongs to the family the site calls Discourse Practice, which treats disagreement as a skill. This one deals with what each party to a disagreement thinks they are doing.

A listener sensibly discounts an advocate's case, because it was assembled to persuade, and trusts an inquirer's conclusion more, because it was reached rather than chosen. Misreporting your mode borrows that trust without paying for it. It does the same to you: if you believe you are mapping, you will not discount your own findings as you would a lawyer's brief, so your confidence rises while your accuracy stays put. The declaration is the cheapest fix. Once you have said "I'm defending here," you and everyone listening know how much salt to add.

The tool's name draws on a contrast between a soldier, whose job is to hold ground, and a scout, whose job is to report accurately what is out there, including what the commander does not want to hear.

Source still being found. the origin of the scout-versus-soldier metaphor for inquiry versus advocacy, who introduced it, in what work, and what that author actually argued, read in the original

Source still being found. research on whether people can tell, from the inside, when they are reasoning toward a conclusion they already favor, for example studies of people rating their own objectivity higher than others'; from a study or review actually read, with what it found and how large the effect was

Using it well

The legitimate use is stating plainly when you are advocating for a position you already hold versus when you are genuinely unsure and following the evidence.

Suppose two columnists write about a proposed law. One opens: "I have supported this kind of measure for years, and here is the strongest case I can make for it." The other opens: "I came into this expecting to oppose the law, and I'm still not sure where I land; here is what I found, including what surprised me." Both columns can be honest and useful. The first tells the reader to test it against the other side's best case; the second tells the reader that the writer's uncertainty is part of the evidence. Neither dresses one mode up as the other.

The same move works in private. Admitting to yourself before an argument, "I'm not going to change my mind tonight," tells you that what follows is advocacy, and that winning the exchange will not mean you learned anything.

Example still being found. a real, quoted, dated public case of a writer, researcher or commentator explicitly declaring their mode, either openly announcing that a piece is advocacy for a position they already hold, or openly stating that they began uncertain or expecting a different answer and reporting where the evidence took them; ideally one example from the political left and one from the right

When it becomes a weapon

The weaponized form is claiming neutral, evidence-following status while showing a perfectly consistent track record of landing on the same side every time.

This version is more persuasive than open advocacy, which is why it deserves as much attention as the legitimate use. "I'm just following the evidence" and "I have no agenda" are claims of authority. They ask to be weighed as a map, and they quietly recast everyone who argues openly as a mere partisan. A commentator whose independent inquiries have never once concluded anything inconvenient to their side is a soldier in a scout's uniform. The disguise is available to every faction, to institutions as easily as to individuals, and to skeptics of institutions as easily as to either.

There is a second way the tool can be turned into a club, and it points the opposite direction: treating any consistent record as proof of disguised advocacy. Some questions really do keep coming out the same way, because the evidence keeps pointing the same way. A consistent record is a reason to look harder, not a verdict.

A few signs help tell the honest scout from the disguised soldier:

• Has the person ever, on the record, reached a conclusion their own side disliked?
• Did they say in advance what would change their mind, and does anything ever?
• Is "I'm just following the evidence" used to inform the listener, or to outrank people who argue openly?
• Do they hold their own inquiries to the standard they demand of their opponents' advocacy?

Example still being found. a real, quoted, dated instance of a writer, outlet or institution explicitly claiming neutral or evidence-following status ("no agenda," "just following the evidence," "nonpartisan") whose published record lands consistently on one side; find instances from across the political spectrum, and from both establishment and anti-establishment sources

Run it on your own side first

Every tool on this site carries this instruction, and this one is especially easy to run only on others, because their disguises are easier to see than our own. Try these:

• Think of a contested question on which you consider yourself open-minded. When did your view on it last move, and what moved it? If you cannot remember, which mode are you really in?
• Recall the last time you told someone you had "looked into" something. Did you go looking for an answer, or for support? Which did you tell them?
• List the three subjects on which you most trust your own judgment. Have your conclusions on all three ever landed somewhere your friends would dislike?

This site claims to be mapping. The same questions apply to it, and the reader review at the end of every article exists so that you can ask them.

Grammars it works against

A grammar, on this site, is a recurring pattern of argument that turns up across many different subjects. The Scout Report is one of four tools that work against every grammar (see all twelve), because every grammar is easier to fall into when you believe you are only following the evidence. It matters most in three places.

• G11: Contested Epistemic Authority. This grammar is about who gets to be believed when experts, lived experience and institutions disagree. Both poles claim to be the scouts: the credentialist who says "trust the science" while overclaiming, and the populist whose "own research" is often motivated curation. The Scout Report asks each to declare their mode.
• G6: The Hidden Hand. Explanations built around a concealed, coordinating actor, which are dangerous because they are sometimes right. The investigator who claims to be "just asking questions" but has decided the answer, and the debunker who claims neutrality but has never once found real coordination, are both soldiers in scouts' clothing.
• G4: Loyalty, Heresy, and Betrayal. Groups punish the dissenter inside harder than the opponent outside. The professional heretic often claims to be the only one still following the evidence; the enforcers often claim the group's agreement is simply what the evidence shows. A track record settles which claim, if either, is true.

Related tools

• F3: The Charity-with-Audit Protocol starts with the most reasonable reading and then checks it against the track record. It is the natural way to test someone's claim to be a scout.
• C1: The Falsifier Question asks what would change your mind, written down in advance. Answering it is the plainest evidence that you really are mapping.
• D4: The JAQ Detector watches what happens when a "genuine question" gets an answer (JAQ stands for "just asking questions"). Just asking questions is a common disguise for advocacy presented as inquiry.
• A4: The Mirror Check asks whether you scrutinized a claim or just liked its conclusion. It catches the moment a self-declared scout starts waving their own side through.