Reconcile Conflicting Evidence

In the last chapter you learned to read numbers and words as one picture, and you watched the air fryer sources qualify each other. Sometimes, though, sources do not politely qualify each other, they flatly contradict each other: one reports a large saving, another almost none. This chapter shows you what to do when evidence collides, so you reach an honest answer instead of quietly keeping the source you liked and dropping the one you did not.

See Why Conflicting Evidence Is a Signal, Not a Setback

Start by naming the thing. Conflicting evidence is two or more pieces of evidence that point to different, incompatible answers to the same question. You have already seen a hint of it in your matrix: a row where the cells do not just add conditions but genuinely disagree.

Beginners tend to treat a conflict as a failure of their research, or as a license to pick whichever side they already believed. It is neither. A conflict is one of the most useful things your evidence can show you, because it marks the exact spot where the easy answer would have been wrong. The job of this chapter is to turn that disagreement into something you can defend, which is called reconciliation: the process of resolving a conflict between sources, or honestly explaining it, rather than ignoring one side of it.

Reconciliation does not always mean making the conflict vanish. Sometimes you resolve it, because one side is stronger or because both turn out to be true under different conditions. Sometimes you cannot resolve it, and the honest move is to report the disagreement clearly along with your confidence. Both are legitimate outcomes. Only one thing is never allowed: pretending the conflict was not there.

Reconcile a Conflict in Four Moves

When two sources clash, work through these four moves in order. Most conflicts are settled well before the last one.

• Check that it is a real conflict. Are both sources actually answering the same question, within the same boundaries of who, what, where, and when? Two sources can look opposed while quietly answering different questions.

• Look for a hidden condition. Ask whether both claims could be true under different circumstances. A hidden condition, some factor such as size, time, or place that changes the answer, often means there was never a true contradiction, just one answer that depends on context.

• Weigh by quality. If a real conflict remains, return to evidence weight from earlier in this part: judge the sources by method, relevance, and independence, and let the stronger one carry more weight. One strong source can rightly settle a disagreement against several weak ones.

• Report honestly if it stands. If the conflict survives all three moves, because comparably strong sources genuinely disagree, do not force a winner. State the disagreement plainly and carry that uncertainty into your conclusion.

Then you have reached the fourth move, and the honest answer is to say exactly that. Reporting an unresolved conflict, together with a clear statement of how confident you are, is a real result rather than a failure. The next chapter shows you how to word it.

Avoid the Three Bad Moves

Under the pressure to reach a tidy answer, people reach for three shortcuts that all corrupt the result. Name them so you can catch yourself in the act.

• Cherry-picking: keeping only the evidence that supports the answer you wanted, and quietly dropping the rest. The fix is to account for every source in your matrix, especially the inconvenient one.

• False balance: presenting two sides as equally credible when the evidence does not support that, for example giving a marketing claim the same standing as a careful measurement. The fix is to weigh the sources, not to split the difference evenly.

• Forcing a false resolution: inventing a compromise just to make the conflict go away, as in “the truth is probably somewhere in the middle.” The fix is to resolve only for a real reason, method, relevance, or a hidden condition, and otherwise to report the conflict honestly.

Reconcile the Air Fryer Conflict

Bring back the running evidence set one more time. Across your sources there is a real-looking clash on a single question: does the air fryer save a lot of energy, or barely any? The manufacturer (A) claims “up to 70% less,” and many one- and two-person households (D) praise the savings. Yet other reviews from larger households (D again) say they still use the oven, and the lab (B) shows the energy gap for a big meal shrinking to almost nothing (1.1 against 1.5 kWh). Left alone, that is exactly the kind of disagreement people settle by keeping their preferred half.

Work the four moves.

• Real conflict? Only partly. The enthusiastic reviews are mostly about small batches; the skeptical ones are about large meals. They are answering the same question under different boundaries, which is the first clue that this is not one clean contradiction.

• Hidden condition? Yes, and it is batch size. Both claims are true under their own conditions: the air fryer saves a lot for small amounts and very little for a full family meal. The lab’s two measurements confirm it, and the split in the user reviews now makes sense instead of looking like noise. Most of the “conflict” dissolves the moment you name the condition.

• Weigh what remains. One genuine clash is left: the manufacturer’s “up to 70%” against the lab’s measured savings, which are real but land below that 70% figure even for small batches. Here you weigh by quality: the lab measured directly with nothing to sell, while “up to 70%” is an unverified best case from the seller. The lab wins, so you treat 70% as an unrepresentative ceiling, not the everyday figure.

• Report honestly. Nothing is left genuinely unresolved, so you can state a clean answer, but with honest confidence: high that the fryer wins clearly for small batches, lower for the large-meal figure, since it rests on a single lab test.

Notice the bad moves you did not make. You did not cherry-pick by dropping the large-batch data because it complicated the story. You did not give the manufacturer’s 70% false balance against the lab. And you did not split the difference into a meaningless “it saves some energy sometimes.” You reconciled the conflict by finding the hidden condition and weighing what remained, which is an answer you could defend to anyone.

Let’s Recap!

• Conflicting evidence is two or more sources pointing to incompatible answers to the same question, and it marks where the easy answer would be wrong.

• Reconciliation means resolving the conflict or honestly explaining it, never quietly dropping one side.

• Work four moves in order: confirm the conflict is real, look for a hidden condition that makes both sides true, weigh by quality, then report honestly if it still stands.

• Cherry-picking, false balance, and forcing a false resolution are the three shortcuts that corrupt a synthesis.

• An unresolved conflict, reported with honest confidence, is a legitimate result rather than a failure.

You can now turn a clash of sources into a defensible position. The final teaching chapter brings every piece together, drawing one integrated conclusion that states how confident you are and names what would change your mind.