Google Flu Trends Still Appears Sick: An Evaluation of the 2013-2014 Flu Season
11 Pages Posted: 14 Mar 2014
Date Written: March 13, 2014
Abstract
In response to its poor performance during the 2012-2013 flu season, Google Flu Trends (GFT) engineers announced a redesign of the GFT algorithm. Two changes were made: (1) dampening anomalous media spikes and (2) using ElasticNet, rather than regression, for estimation. This paper identifies several problems that persist in the new algorithm. First, the transparency problems identified in our earlier Science paper appear to have, if anything, become worse. Second, there are reasons to doubt whether a spike in media attention was the only, or primary, cause of GFT's errors. Finally, there is strong evidence that GFT is still not using all the information at its disposal to make accurate measurements of flu prevalence. While it is too early to give a complete evaluation of the new algorithm, these results are discouraging.
Keywords: Google Flu Trends, big data, transparency, replication, time series
JEL Classification: C22, I1, I18
Suggested Citation: Suggested Citation