成人VR视频

When claims about science become edutainment, science loses

Breezy assertions about what research shows undermine public trust as, however confidently stated, they are easy to challenge, says Rob Briner

November 7, 2024
A TED talk commences inside the David Rockwell designed theater n Vancouver, Canada.
Source: Lawrence Sumulong/Getty Images

I first noticed it in Ted Talk clips. You know the sort of?thing. A?nicely lit stage with a?big logo. Someone way too well groomed and friendly to?be a?scientist or an?academic is?strutting around, headset microphone positioned neatly below dazzling and shapely teeth.

If they’re really good – and some of?them are – they might use a?prop. A?neuroscientist, or a?pseudo-neuroscientist, may have a?model of a?brain. They’ll occasionally hold it up, “alas, poor Yorick”-style, and look at?it in?awe as?they declaim words such as frontal lobes, neuroplasticity, emotional intelligence or dopamine.

And then it?happens. Hard and fast and painful. Yes, it’s the Overblown Science Claim.

The Claim is always preceded by a phrase such as “we know from science that”, “science shows that”, “studies find that” or “it?turns out that”. And the Claim itself, in the case of our neuroscientist, will be something like: “Children who are able to resist eating a marshmallow if promised two later will grow up to become 326?per cent happier, six times richer, much more attractive in every way and over 10,000 times more likely to do a Ted?Talk.”

成人VR视频

ADVERTISEMENT

Since it first hit me, I can’t help but notice the Claim all over the place: in popular science books, podcasts, literature reviews, newspapers, broadcast news, tweets and LinkedIn posts. And it irritates the hell out of me.

Why? To put it simply, it’s exaggeration bordering on making stuff up – from people who really should and probably do know better.

成人VR视频

ADVERTISEMENT

I think I understand the motivations. There are books to sell. Punters to please. Grants to get. Reputations to enhance. $45K?keynotes to deliver. Teeth to re-veneer. That’s Edutainment! So nuance and humility – which should be hallmarks of science – aren’t going to cut it. Any disclaimer will make the declaimer’s field – and, by extension, themselves – seem weak and uncertain.

I also wonder sometimes if another reason for over-claiming is that it helps some scientists manage their own discomfort. Over the course of their careers they may realise, to their dismay, that : there are more questions than answers, and the more we discover, the less we know.

What’s so bad about making the Claim? For a start, we don’t know anything from science because we can’t. We have only very partial knowledge. All we really can say is that given our limited data and the constraints of the methodology, a particular finding is more or less likely. And we can sometimes have a reasonable estimate of probabilities and likelihoods.

What about the claim that studies show something? Sure,?some studies show something. But other studies do?not show the same thing. So, again, it’s about probabilities rather than studies showing something.

成人VR视频

ADVERTISEMENT

On top of this, published studies tell only part of the story. In many fields, hypothesis-supporting positive results are much more likely than negative results to get published. So the claim that studies show refers only to the unrepresentative bunch with positive results that actually see the light of day. This publication bias represents another quite bizarre rejection of a scientific hallmark by its own practitioners: to publish all your results, not only those you like.

Also, the Claim fails to consider future research. Of course, we can’t know what this will find, but we do know it’s quite possible that it will reveal apparently well-established findings to be quite untrustworthy. New teams of researchers may fail to?replicate the Claim. New research may even reveal that the methodology behind it – and behind perhaps thousands of other studies, carried out over decades – is?flawed.

Isn’t it just wrong for scientists to behave in ways that violate the basic principles of science as a profession and endeavour? When pharmaceutical companies selectively publish only the positive results of drug trials, we are outraged. When car manufacturers find ways to distort the levels of emissions produced by their vehicles, we see it as corruption. Yet, somehow, when scientists do something similar by making overblown claims, we don’t make similar judgements.

But others may. Making overblown claims undermines trust in science and scientists because such claims, however confidently asserted, are very fragile and can easily be challenged or refuted. A single contradictory finding or questioning voice can be enough to shatter confidence, making it easy to interpret the Claim as a lie, the person who made it as a liar and science in general as fake news.

成人VR视频

ADVERTISEMENT

The possibly self-interested and certainly bland “more research is needed” conclusion of many scientific papers is quite wrong. We do not need more research. We need better research. This means improving our practices around conducting, publishing and communicating science.

But while scientists’ incentives remain as they are, it is hard to imagine them seeing the fun in that.

成人VR视频

ADVERTISEMENT

Rob Briner is professor of organisational psychology at Queen Mary University of London, a visiting professor at Oslo New University and associate director of research at the Corporate Research Forum.

POSTSCRIPT:

Print headline: When edutainers make overblown claims about the evidence, science loses

Register to continue

Why register?

  • Registration is free and only takes a moment
  • Once registered, you can read 3 articles a month
  • Sign up for our newsletter
Register
Please Login or Register to read this article.

Related articles

Reader's comments (3)

It is NOT 1955. Please
This article of course contains its own version of THE CLAIM. Ironically, this article overclaims for exactly the same reason as all those Ted talks do - it draws more attention to it, and thows its claims into high releif. Vis: > For a start, we don’t know anything from science because we can’t.... While this is true on a philosophical level, there are some things we in science we are sufficiently confident in that to act in any other way than if we knew them to be certain is irrational. Genetic information is inheritied, generation to generation through DNA. Infectious disease are caused by living pathogens, not by "Miasmas" Allele frequencies change through generations and this can be influanced by natural selection. Acids neuralise bases to form salts. E = m*c^2 Then there are other things, related to that, that even though we are less sure about, it still makes sense to act as though they are true: DNA is the only genetic material On a macro scale, space-time follows the rules of general relativity Human activity is leading to a change in the world's climate systems. > Sure, some studies show something. But other studies do not show the same thing. This is not always true. Particularly in my field there are many, many things that are shown once, and then every study that ever touches on the same question agrees (although its unclear they are things that the public would be intersted in hearing about). > So, again, it’s about probabilities rather than studies showing something. The difficulty with public communication is getting across to the public the value of those things were we are not 100% certain they are true, and get we are still 100% certain that acting as though they are true is the rational way to act, as while we might be only 80% convinced of a particular explaination, it makes no sense to act as though an explaination with only 10% chance of being true were right.
Great article that draws attention to the need for independent critical thinking . There are many examples of things we knew that on further examination were found to be more complicated. Einstein's cosmological constant for example. How we understand that epigenetic changes are heritable where previously we did not. Synthetic DNA introduces new artificial bases and now DNA is not the only genetic material. What we know is that there are generally expected outcomes under generally held conditions but these are not always the case and there are improbably outcomes which demand more thoughtful research. What I believe the author is asking for is more critical thinking, not taking statements from scientists at face value and looking thoughtfully and the data. The worst thing a scientist can do is get hung up on the dogma when interpreting their results. The hypothesis must be reconsidered to explain the data, regardless of the pre existing work. I think we would all do well to challenge our preconceptions with new ideas and to question and test anything presented to us as definitive.

Sponsored

ADVERTISEMENT