Ideas are cheap, measurements are king: how physicists guard against wishful thinking
Across these conversations scientists keep choosing data over beautiful ideas: Lincoln loves string theory but doesn't believe it, Keating watched his BICEP signal turn out to be dust, Carroll bets his own team's hoped-for signal will go away, and Frank says a cool topic doesn't get a pass. It shows why science earns trust by being willing to be proven wrong.
How do the four physicists guard against wishful thinking? Show answer
By making ideas face tests that could fail and accepting the measurement over the idea they would prefer to be true.
What is Don Lincoln's creed as an experimentalist? Show answer
Ideas are cheap and measurements are king. Nothing counts until it is measured.
How does Lincoln say a theory is killed? Show answer
It makes a prediction and the prediction fails. Without that, it is neither confirmed nor dead.
How does Lincoln treat string theory? Show answer
He likes the idea very much but does not believe it, because it has not been validated by measurement.
What changed Lincoln's mind about dark matter? Show answer
Observations, including colliding galaxy clusters and galaxies that appear to lack dark matter, which went against the modified-gravity idea he once favored.
What happened to Brian Keating's 2014 result? Show answer
His team announced a signal from the early universe before peer review. Months later it was shown to come from dust in our galaxy.
What human tendency does Keating say scientists must resist most? Show answer
Confirmation bias, strengthened by the pleasure of being right and the lure of prizes and recognition.
What is Keating's test for telling science from non-science? Show answer
Falsifiability. A claim that can fit any outcome, as an astrologer's did, cannot be proven wrong and is not science.
What does Sean Carroll do with evidence favoring his own idea? Show answer
He bets that the claimed detection will go away, and reports undecided results as undecided.
Why does Adam Frank say scientists are harsh with each other? Show answer
Because of standards of evidence built over centuries, which he credits for technology working. Exciting topics get no exemption.
Where do Lincoln and Carroll differ? Show answer
Lincoln distrusts belief beyond what is measured. Carroll gives well-tested equations provisional authority, even where no new measurement exists.
What limit does the article note about the lack of evidence? Show answer
Absence of evidence depends on how hard you have looked. Where a search has barely started, not found is weaker than ruled out.