Stop the spread of the ecological fallacy

Have a look at this recently launched public health campaign, pithily titled “Stop the Spread“. It aims to address the problem of overweight in the general population. Co-ordinated by Safefood, the statutory body responsible for the promotion of food safety in both the Republic of Ireland and Northern Ireland, the campaign has proven to be somewhat controversial in both countries. This is not least because of its implication that being overweight is somehow communicable, its promotion of waist-circumference as an uncomplicated measure of disease risk, and its apparent recommendation that all adults — including young and otherwise healthy people — should constantly strive to avoid putting on weight and thus regularly measure themselves in order to track their body shape empirically.

Safefood’s primary gimmick has been to issue 250,000 free measuring tapes for members of the public to use to see just how fat they actually are. Vividly, and without any apparent equivocation, they declare that waist circumferences greater than 32 inches for women or 37 inches for men signify significant risk of developing an obesity-related disease. This approach has been very harshly criticized by many commentators, including eating disorder advocacy and support groupswho spend most of their efforts and resources promoting precisely the opposite approach to healthy weight management. In response, Safefood have forthrightly defended their campaign as being necessary in the face of what they argue is a looming public health catastrophe. Moreover, both their website materials and public spokespersons have been adamant that the 32/37-inch threshold is consistent with the best available scientific research.

However, that particular claim is extremely questionable. It is not at all clear that the scientific research supports the details of this campaign; in fact, in some respects, the campaign directly conflicts with the very scientific research that it cites in its own defence. As a result, this campaign could actually be doing far more damage than good…

"Watch out, you'll catch obesity!"

One indicator that the campaign is based on shaky scientific foundations can be found in the advert’s initial context-setting statements. A rather sombre-sounding voiceover warns us that the problem of overweight is “spreading“, that “most of us already have it“, and that “we are rapidly passing it on to others, giving them a higher risk of heart disease, diabetes, and cancer“. This last statement accompanies an otherwise pleasant image of two young women embracing on the street. Overall, these descriptions seem to imply that obesity is a communicable disease. However, the idea that overweight (or obesity) is somehow contagious is at best a metaphor. Overweight is not contagious or infectious or otherwise communicable. It seems fairly obvious that Safefood are using the contagion metaphor for its shock value. But is a public health campaign the best place to take artistic liberties? After all, it could be that not all members of the public will realise that this type of language is intended to be figurative. If so, then claiming that overweight is a disease that is “spreading” and that “we are rapidly passing it on to others” could provoke unnecessary anxiety.

But perhaps of greater scientific concern is the way Safefood handles the 32/37-inch threshold, which they say informs us about each individual’s personal health-risk status.

Frankly, they’re doing it wrong.

On the basis that you don’t feel too bad about being contagiously fat and will have enough self-esteem left to cope with being stupid as well, Safefood provide the following film to show you how to measure your waist circumference correctly (note how something that should take 10 seconds to explain takes Safefood 1 minute 22 seconds to show on YouTube; which is somewhat ironic given that the usual basis for recommending waist circumference measurement is that it is supposed to be easy):

Now, while epidemiologists agree that average waist-circumference across groups can be informative about health risks at the group level, Safefood’s assertion is that it is relevant to health at the individual level. Here is how the Safefood website presents their position on the threshold:

32 inches (for women) and 37 inches (for men) are the recommended maximum waist sizes, no matter how tall or small you are.

No matter what height or build, an increased waistline is a sign for most people that they may be at an increased health risk of conditions like heart disease, Type II diabetes and cancer. These recommendations by the World Health Organization take into account that people are different shapes and sizes.

And here’s how Dr Cliodhna Foley-Nolan, Safefood’s Director of Human Health and Nutrition, describes things in an interview with the Medical Independent:

With the waist measurement, there is very concrete science behind those numbers. Both the WHO and the National Institute of Clinical Excellence (NICE) use waist measurements as a straightforward indicator because every indicator is going to have its limitations.

Okay. So here are the errors in Safefood’s position.

  1. Firstly, it is quite erroneous to state that the WHO “use waist measurements as a straightforward indicator“. In fact, the WHO consider waist measurements to be anything but straightforward. Their main policy statement on this issue — Waist Circumference and Waist-Hip Ratio: Report of a WHO Expert Consultation — which was published just this year, consistently explains that waist circumference is just one possible indicator among many, and that it may or may not be more useful than the alternatives (which include BMI, waist-hip ratio, and hip measurements).
  2. Secondly, the WHO are explicit in stating that waist circumference measures (and potential cut-offs) are supposed to be used “for public health action” (see p. 2 of the Report). In other words, they do not intend that cut-offs be used for personal health action. What this means is that, according to the WHO, waist-circumference data is of use for assessing the overall health of a population (or large group of people) rather than for assessing the precise health risks faced by an individual person in isolation. In this context, it appears somewhat divergent of Safefood to translate the WHO approach into recommendations for individual diagnostic purposes, or to suggest that a single person can obtain meaningful information by comparing their waist circumference to a single threshold.
  3. In fact, even at the population level, the WHO actually declines to recommend simplistic universal waist measurement cut-offs against which disease risk can be judged. As such, Safefood’s reference to their thresholds as representing “recommendations of the World Health Organization” is just spurious. Instead, in the ‘Recommendations’ section of their waist circumference Report (see p. 24), the WHO point out that, as far as they are concerned, suitable thresholds have yet to be properly established. In addition, they highlight the need for any future system to be complex rather than simple, and to be based on a multiplicity of categories (e.g., low, medium, and high risk) rather than on Safefood’s two categories (e.g., at-risk, and not-at-risk).
  4. Finally, the WHO clearly disagree with Safefood’s insistence that waist circumference measures are meaningful regardless of a person’s body shape, age, medical status, or any other biometric information. In fact, the WHO Report states that “there is substantial evidence of sex and age variations in waist circumference and waist-hip ratio, and some evidence for ethnic differences.” They cite the International Diabetes Federation as having published meticulous breakdowns of waist circumference norms according to ethnic group (a similar position to that taken by the Australian Government, who point out the limitations of generalizing existing norms to many of the ethnic groups that comprise minorities within Australian citizenry). And Safefood’s insistence that waist measurements are the only thing that matters appears even more questionable when you consider the fact that some people have very good medical reasons for having large waist circumferences. Here’s one example that is not mentioned by Safefood at all: women who are heavily pregnant.

In short, it seems very strange indeed that Safefood invoke the WHO in their defence of the “Stop the Spread” campaign. Dr Foley-Nolan’s assertion that there is “very concrete science behind those numbers” is contradicted by the fact that the science does not actually support the identification of particular thresholds for universal use or for the use of any universal thresholds at the individual level. Furthermore, when the Safefood website asserts that “These recommendations by the World Health Organization take into account that people are different shapes and sizes“, this is contradicted by the fact that (a) these are in fact Safefood’s own recommendations, not recommendations from the WHO; and (b) as far as the WHO are concerned, such thresholds are indeed confounded by individual differences in body shape and size, such as those relating to ethnicity.

But from a scientific perspective, perhaps the most depressing aspect of Safefood’s “Stop the Spread” campaign is that it commits a logical error that is extremely well known to epidemiologists, biological scientists, logicians, and statisticians alike. In fact, it is so straightforward that those of us involved in education in these areas typically teach it to undergraduates. The error is known as the ecological fallacy.

The ecological fallacy is committed when people look at the averages of data collected from groups of people, and then assume that these same averages can be applied to each individual within the group. For example, the ecological fallacy is committed when town planners calculate the mean average family size in a neighbourhood and then decree that all new houses should be constructed with sufficient room for 2 parents and 1.4 children. Likewise, when epidemiologists identify waist-circumference thresholds that, on average, separate low-risk and high-risk categories within the overall population, the ecological fallacy is committed when agencies like Safefood come a long and decree that all people above the threshold are correspondingly facing high risk. The fallacy is compounded when the agency in question declares that the threshold applies “no matter what height or build” a person is, that the system “takes into account that people are different shapes and sizes“, and — most awkwardly of all — that there is “very concrete science behind those numbers“.

As disappointing as this all is, at least there is some humour to be found. In statistical terms, the ecological fallacy is committed when observers falsely emphasize one type of descriptive statistic at the expense of another. The unduly emphasized statistic is called the “central tendency” (examples of which include mean averages and medians). The humour arises from the deep irony regarding the other statistic, the one that tends to be forgotten about but which is actually just as important. This statistic is called…

…wait for it…

…the “spread“.

Really, you couldn’t ask for a better punchline than that.

Categories: Authority appeals, Cancer, Dodgy advertising, Food, Health, Heart disease, Mathematics, Medical Independent, Race, Scientific literacy, Statistics, Television, Video

11 replies

  1. Another great post! I have watched that ad in horror because of their portrayal of obesity as contagious. However, I did not realise that the measurement they used could be also questioned. You’ve really got to wonder what potential benefit SafeFood could possibly be anticipating!

  2. I don’t believe you explicitly state this, but I suppose that some people below the cut off might be persuaded that they are not at risk for weight- or diet-related illnesses, when in fact they are. Being thus misinformed they might then ignore their problem resulting in more severe consequences.

  3. Wont common sense ever prevail!?
    Of course waist measurement isn’t going to a thoroughly scientific measurement of whether a person is over weight or not. However it is a quick and readily accessible way to make a good estimation. If it was overly complicated, no-one would do it. Lets face it with the exception of edge cases there really is no good excuse to exceed the 32/37 measurement.

    As for the implication obesity is contagious I would read it that as a society we are constantly re-adjusting what is a socially acceptable weight and so we are inadvertently helping people be overweight. Of course there is the problem of overfeeding our children, which can easily be seen as spreading obesity from parent to child.

    To be honest this thread screams of over weight people trying to make excuses instead of accepting the facts and their own responsibilities.

    The not-so-secret of controlling your weight is simple, exercise and a good diet. (Diet, as in all the food/fluids you consume. Not some stupid trend spawned by pseudo-science and pharmaceutical companies)

    I for one welcome, this campagin.

    • The thing is, the ad doesn’t include a caveat that waist measurement isn’t the be all and end all. In fact, it explicitly says “to find out if it [the overweight] has spread to you, just measure around your waist..”. That’s it, just measure around your waist and if the number is bigger you’re in trouble and if it’s smaller you’re not. Job done. Never mind height or build or any other variable, as Brian has said.

      As for this thread screaming of overweight people making excuses, I’d love to know how you came to the conclusion that those who have posted are overweight!

    • I agree with your interpretation of the contagious aspect of the campaign – a reasonable idea to illustrate the increasing social acceptance of increased weight. I doubt if many take this literally.

      “Of course waist measurement isn’t going to a thoroughly scientific measurement of whether a person is over weight or not.”

      The problem is that it isn’t an issue about net benefit to a population, but rather the potential harm caused by incorrect assessment. If an ad is offering means of personal health advice, even if it is incorrect in a minority of cases, this can lead to at best some people striving for an unsuitable weight (either too heavy or too light – though there seems to be no minimum waist in this campaign) or at worst developing an eating disorder or psychological issues such as depression and low self-esteem. In terms of offering individual health advice there should be an ethical responsibility to all individuals alike and this should be reflected in the campaign either through caveats or simply not claiming that this is indeed a science-reinforced method for weight self-assessment.

  4. What happened to the body mass index? Did it just die?

    Perhaps of type II diabetes?

  5. What’s up, this weekend is good in favor of me, for the reason that
    this moment i am reading this fantastic informative piece of writing here at my home.

  6. just love this item, fast shipping, arrived perfectly

  7. Epicure tastes say, thank you for the cordial reception, get-well soon, happy birthday,
    happy holidays and more, with discerning flavors
    of fine foods. While doing Holika Dahan, it’s considered good to perform the task in the auspicious time declared for it.
    A last final reason for people who are trait lonely and
    yet looking for that special someone they cannot find, maybe due to the
    fact that they maybe unwilling to let down their defenses.

»So what do you make of this?

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

%d bloggers like this: