Suppose two doctors give you opposite advice, or two engineers disagree about whether a building is safe. You cannot simply study medicine or engineering for ten years and decide for yourself. Is there anything a reasonable outsider can do? The problem is ancient, and the answers are better than one might expect.
Plato's puzzle
In Plato's dialogue Charmides, Socrates asks how anyone who lacks medical knowledge could tell a real doctor from a pretender. To judge whether the doctor's words and treatments concern health correctly, it seems, one would need to know medicine oneself. The novice's dilemma is that judging an expert seems to require the very expertise the novice lacks. If that were the whole story, trust in experts would be blind. It is not the whole story.
Five kinds of evidence
In a 2001 paper titled "Experts: Which Ones Should You Trust?" Alvin Goldman listed the evidence a novice can use when experts disagree. Goldman named five sources: the arguments the experts give, the agreement of other experts, the judgments of meta-experts such as credentials and ratings, evidence of the experts' interests and biases, and their past track records. None is decisive on its own. Together they often point clearly one way.
Arguments you can partly follow
A novice cannot judge every step of a technical argument, but can notice some things. Does one expert answer the other's points, or ignore them? Does each claim rest on evidence or on authority alone? Goldman warned that quick rebuttals and polished delivery, which he called dialectical superiority, are not a reliable sign of being right, since a skilled debater can make a weak case sound strong.
Goldman added a helpful distinction. Exoteric claims are ones a novice can check, such as whether a predicted event happened; esoteric claims are ones only experts can assess. An expert's esoteric reasoning may be beyond you, but whether her past forecasts came true, or whether the bridge she approved is still standing, is not. Exoteric checks are the outsider's window into esoteric skill.
Interests and agreement
Ask what each expert stands to gain. A surgeon paid per operation has a mild incentive to recommend surgery, and an adviser paid by commission has a reason to sell. Interests do not prove bias, and honest experts can work under bad incentives, but an expert with nothing to gain from a recommendation deserves somewhat more weight on that point. Then ask whether the expert stands with the main body of the field or alone. Lone dissenters are sometimes right, but they carry the burden of showing why the others are wrong.
Second opinions
One practical tool is simply to ask another qualified person. A 2017 study at the Mayo Clinic examined 286 patients referred for a second opinion in general internal medicine. About one in five received a diagnosis that was completely different from the first one, and most of the rest had their diagnosis refined. The patients were referred precisely because their cases were hard or unclear, so the figure does not mean one in five ordinary diagnoses is wrong. It does show that even within one profession, independent judgment catches errors.
Warning signs
Certain patterns should raise an outsider's guard: a claim of certainty in a field known for uncertainty, an attack on an entire profession as corrupt, a cure sold by the person promoting it, credentials from another field and a story of persecution offered in place of evidence. Warning signs raise doubt but do not settle a question, since some sound experts show one of them and some frauds show none. They tell you where to look harder.
Worked example: a knee and a second look
Imagine a fifty-eight-year-old with a painful knee. An MRI shows a degenerative tear in the meniscus, the cartilage cushion inside the joint, and an orthopedic surgeon recommends keyhole surgery to trim it. The patient, who has no medical training, decides to apply Goldman's five sources before agreeing.
Arguments: the surgeon explains that removing the torn part should ease the pain, which sounds plausible but is the kind of untested reasoning that has misled medicine before. Agreement of other experts: a quick search finds that in 2013 a Finnish trial compared this operation with a sham operation, in which surgeons made the same small cuts but trimmed nothing, and found no extra benefit from the real surgery; later guidelines advised against routine surgery for this kind of tear. Meta-experts: those guidelines come from panels that review many trials. Interests: the surgeon is paid for operations, though that alone proves nothing. Track record: the patient cannot easily learn the surgeon's outcomes, a common gap.
The patient asks for a second opinion from a sports medicine doctor, who suggests a course of physical therapy first. Nothing here required medical training. It required asking the right questions in order, and taking seriously the evidence that a novice can reach.
