Google Flu Prediction - Beware The Media Effect
Written by Mike James   
Saturday, 16 February 2013

Google's flu prediction web site is a really good idea, but recently it got it wrong - all due to a media effect that you might think was itself very easy to take into account.


As far as data mining or statistics goes this is a very simple idea - there is a correlation between the number of cases of flu and the number of searches on the topic of flu. It is a very reasonable idea. Of course not all searches on the topic of flu are from people who have the flu, but if you gather some data it seems that the signal to noise ratio is very good. In fact, it is so good that Google has a site that shows you the current geographical prevalence of flu and there is even a paper in Nature explaining how good the system is.

The important point is that the predictions Google makes leads the CDC's data, based on reported cases, by as much as 14 days - which is enough time for people to react to the information.

You can see this lead in the following video:


However, according to a report in Nature, this year it isn't working out quite as well. Flu in the US started to rise in November 2012 and peaked just after Christmas. Google's curve seems to follow the trend but it over estimates the CDC's figures by double and more in some regions.

The problem seems to be the obvious one - a media effect. The noise in Google's figures is related to the number of searches about flu that aren't because the people doing the searching actually have flu. If this number remains constant then it should be possible to factor it out. The problem this year is that the media has been very active on the topic of flu and this is very likely to have caused people to search for general news items on flu or to search for the sort of data that Google Flu Trends provide.


The redder the more flu

So while Google's technique is as good as, or better than more expensive ways keeping track of an epidemic, it fails for a very obvious reason.

Of course this is fixable. All Google has to do is find a search based variable, or any easily to obtain variable, that is correlated with media attention and build a model that factors this in. This is easy in principle, but comes with the usual practical problems of implementation

There is also a more general lesson to be learned. Social media and search data may distill the current interests of the crowd, but the cause of those interests may vary in erratic ways. Wasn't there something about correlation not being the same as causation...


More Information

When Google got flu wrong

Google Flu Trends

Related Articles

Google Civic Information API

The Significance Of Big Data

Twitter Can't Predict Elections Either

How the Music Flows from Place to Place


To be informed about new articles on I Programmer, install the I Programmer Toolbar, subscribe to the RSS feed, follow us on, Twitter, Facebook, Google+ or Linkedin,  or sign up for our weekly newsletter.






or email your comment to:



Keep Ahead With JavaScript Day 2022

JetBrains is again organizing a free virtual event covering JavaScript, TypeScript and related technologies. It takes place on November 10th, 2022 with all presentations being streamed live on You Tub [ ... ]

Visual Studio Now Generally Available With Arm64 Support

The latest version of Visual Studio 2022 is now available with support for ARM64. This is the first Visual Studio GA release to support ARM64, alongside other improvements including .NET 7 and enterpr [ ... ]

More News


Last Updated ( Saturday, 16 February 2013 )