Wednesday, January 28, 2015

On Science Communication and the Difficulty Relaying Scientific Information to the Public

This blog posting is a reminder about the difficulties communicating good science both in the media and to our fellow scientists and how challenging it is to communicate to both audiences simultaneously. This blog posting is derived from a three-way Twitter discussion I had with Dr. Jay Cullen (a Marine chemist, oceanographer and Associate Professor at University of Victoria, School of Earth and Ocean Sciences) and Suzy Waldman (a PhD student studying risk communication at Carleton University). The discussion related to an article in the Victoria Times Colonist titled B.C.’s citizen scientists on alert for radiation from Japan. The topic of our conversation was both my and Ms. Waldman's initial negative perceptions based on our independent reading of the article. As many of you know, I wrote a blog post in December on bad representations of risk in reporting of the Fukushima plume. As such I have been sensitized to the topic. Ms. Waldman, also being in the field, also likely has very similar sensitivities.

Our discussion started off on a rancorous note (okay maybe even accusatory on my part). Both Ms. Waldman and I had read the article and I tweeted a couple tweets towards the scientists quoted in the story indicating that they might be responsible for overblowing the risks associated with the identified cesium isotope ( 134 Cs) plume. Dr. Cullen rightly took exception to my tweets because, as he pointed out, a clean reading of the article pretty clearly demonstrates that he had gone out of his way to explain why the radiation identified actually did not pose a significant risk to human health or the environment. Our discussion eventually turned to why Ms. Waldman and I had both experienced the same apprehension in spite of the article's contents.

Ms. Waldman posited that the formulation of the article was a key. She pointed out that the first half of the article was full of really loaded words: "fallout, disaster, Chernobyl, peak, plume, radiol'l health risk". For those of you unfamiliar with risk communication these types of words are commonly called "dread" words. Dread is a term used by Dr. Paul Slovic in his seminal article on risk communication called "Perceptions of Risk". For those of you without access to journal articles Dr. Roger Pielke discusses the topic in this blog posting. Essentially dread words draw a visceral reaction from the reader irrespective of their positioning or formulation in an article. They typically represent risks or fears over which the reader has no control and often represent risks that cannot be viewed or experienced using standard human senses. In re-reading the article it is clear that Ms. Waldman has a good point. The sheer number of dread words in the first couple paragraphs would be enough to get most readers feeling uneasy. I have previously suggested that any reader who wants a non-technical but compelling read on the subject of Risk should get the book by Dan Gardner of the same name. In the book Mr. Gardner discusses how fear and risk are used by organizations and writers to advance their causes. In this case, it is likely that the language was recognized by the writer (or his/her editors) as useful in pulling eyes to the page and to keep readers reading.

My experience in science communication is different from Ms. Waldman's and as such the one thing that really drew my eyes in the article was a line about the health risk of the cesium radioisotope:

"It can pose a radiological health risk because it tends to concentrate in organisms,” Cullen said. “[But] health physicists suggest the exposure of consumers to these fish don’t pose a danger to anybody’s health.”

My first response to this statement was strong annoyance. Surely what Dr. Cullen meant was that health physicists would view the risk as being negligible (using the de minimis principle). To put it in perspective in my previous posting I pointed out that 5 becquerels represents the approximate radiation in a little less than a half of a banana. Oddly enough my annoyance at that sentence caused me to miss how Dr. Cullen went on to relate that the exposure "is expected to be three to five becquerels per cubic metre of water. Canadian guidelines for safe drinking water impose a limit of 10,000 becquerels per cubic metre, he said". After re-reading the piece I realized that I had been caught in the "good news/bad news" trap. For those unfamiliar with the concept, research shows that when good news is presented immediately following bad news (as in this case) the reader/listener can get unsettled by the bad news and become less receptive to the ensuing good news (ref).

So by my count it was Scientists - 2, readers - 0, but I also realized that Dr. Cullen may have unconsciously been partially to blame for my unease. I say unconsciously because I feel that in his interview he made the mistake of speaking "in Science" to a non-scientist. As a non-academic scientist, I am reminded to assume my audiences are at least as smart as myself and to speak to them accordingly. Speaking down to an audience almost always ends badly. The corollary to that statement is that the public is not always familiar with the way scientists communicate. As scientists we are trained with a language (jargon) all of our own. When my wife says something is "significant", she means "important"; when I say the word I mean that it met a pre-determined level of significance (i.e. p<0.05). The risk professionals in our office will never say that something has "no risk". Even if the risk is only one in ten billion it still represents a risk. Instead a risk professional will say it has "acceptable risk", where the level of acceptance is based on the conclusions of a reputable scientific or health organization. Similarly, when discussing other people's work I will often use correlation terms like "suggest" and "indicate" as they give me wiggle room when I don't have exact figures (like exact levels of statistical significance etc..) at hand. For me these words tell my fellow technical people that: "I don't have the numbers at hand but can assure you the information I am relaying to you is correct". I tend to use to causation words only when speaking in my area of expertise.

I am guessing that this is what happened to Dr. Cullen in this case. Using typical scientific diligence  he used the softer term "suggest" rather than a stronger term or phrase. Had he said "Health Physicists will tell you (or assure you) that exposures....don't pose a danger" it would have left the reporter with no doubt (or ability to manufacture doubt). Unfortunately, when a reporter hears the word "suggest" he/she is more likely to understand it in a literal sense and not the common scientific usage. That is: health physicists "propose" or "put forward for consideration that exposures....don't pose a danger". This literal definition completely misconstrues the level of doubt associated with the risk. Moreover, if the writer's editor was looking for a quotation that could be interpreted broadly (perhaps to move the article closer to the front of the paper) this would be the line to fixate on.

Ultimately, the confusion comes down to a common problem we, as technically-trained, practicing scientists, face every day. We are trained to avoid making errors of confidence (there's that Type I error thing coming to haunt us again). When working and communicating with our peers we have the tendency to use language that is less than definitive, understanding that our meaning will be understood by all. Unfortunately, we operate in a world full of people operating blissfully in a Dunning-Kruger state who are willing to express a level of certainty that an expert cannot ethically match. As specialists we have to remember to turn off our science blinders and speak with forethought about how our words will be read, interpreted and possibly misinterpreted. Certainly we can use correlation words but stick to the ones that have comparable usage in the vernacular. I cannot reasonably say the radiation poses "no risk" but I can certainly say it poses "negligible risk".

Coming from the other side, as scientists we also have to give our colleagues some slack. We have to recognize when our colleagues are trying to relate complex technical topics in a manner that is understandable by the public. Give your colleagues the benefit of the doubt and start with the assumption that they are acting in good faith even when (especially when) you disagree with them. Piling on and picking nits when a colleague is trying to make complex technical information understandable for the general public does nothing to expand our knowledge and only hurts the cause of good science in public.





Author's note: please don't interpret my use of the names Ms. Waldman or Dr. Cullen as an attempt to give one greater credibility over the other. I was brought up in the old school where one did not use another's first name in discussions unless one knew the individual well enough to justify the use. I apologize in advance if my traditional style of writing may have offended.

1 comment:

  1. Yep. Science journalism is too important to be left to journalists.

    ReplyDelete