Combining Search, Social Media, and Traditional Data Sources to Improve Influenza Surveillance

Abstract

We present a machine learning-based methodology capable of providing real-time ("nowcast") and forecast estimates of influenza activity in the US by leveraging data from multiple data sources including: Google searches, Twitter microblogs, nearly real-time hospital visit records, and data from a participatory surveillance system. Our main contribution consists of combining multiple influenza-like illnesses (ILI) activity estimates, generated independently with each data source, into a single prediction of ILI utilizing machine learning ensemble approaches. Our methodology exploits the information in each data source and produces accurate weekly ILI predictions for up to four weeks ahead of the release of CDC's ILI reports. We evaluate the predictive ability of our ensemble approach during the 2013-2014 (retrospective) and 2014-2015 (live) flu seasons for each of the four weekly time horizons. Our ensemble approach demonstrates several advantages: (1) our ensemble method's predictions outperform every prediction using each data source independently, (2) our methodology can produce predictions one week ahead of GFT's real-time estimates with comparable accuracy, and (3) our two and three week forecast estimates have comparable accuracy to real-time predictions using an autoregressive model. Moreover, our results show that considerable insight is gained from incorporating disparate data streams, in the form of social media and crowd sourced data, into influenza predictions in all time horizons.

Full text

Its licence does not allow us to show the full text. Read it at PubMed Central:

References 43

1. 1.

   Lipsitch M, Finelli L, Heffernan RT, Leung GM, & Redd S. Improving the evidence base for decision making during a pandemic: the example of 2009 influenza A/H1N1. Biosecurity and bioterrorism: biodefense strategy, practice, and science. 2011; 9(2), 89–115.

   Not in our library10.1089/bsp.2011.0007

2. 2.

   WHO (2015) Influenza (Seasonal), Fact Sheet Number 211. Available at http://www.who.int/mediacentre/factsheets/fs211/en/index.html.

   Not in our library

3. 3.

   Cobb L, Krishnamurthy A, Mandel J, and Beezley JD. Bayesian tracking of emerging epidemics using ensemble optimal statistical interpolation. Spatial and spatio-temporal epidemiology. 2014; 10: 39–48.

   Not in our library10.1016/j.sste.2014.06.004

4. 4.
   Comparison of Filtering Methods for the Modeling and Retrospective Forecasting of Influenza Epidemics · 2014

   No notice
5. 5.

   Yang W, Lipsitch M, and Sham. Inference of seasonal and pandemic influenza transmission dynamics using ‘big’ surveillance data. Proceedings of the National Academy of Sciences. 2015;112(9): 2723–2728.

   Not in our library10.1073/pnas.1415012112

6. 6.

   Ginsberg J, Mohebbi MH, Patel RS, Brammer L, Smolinski MS, and Brilliant L. Detecting influenza epidemics using search engine query data. Nature. 2009; 457, 1012–1014

   Not in our library10.1038/nature07634

7. 7.

   Scarpino SV, Dimitrov NB, and Meyers LA. Optimizing provider recruitment for influenza surveillance networks. PLoS Comput Biol. 2012; 8, no. 4: e1002472

   Not in our library10.1371/journal.pcbi.1002472

8. 8.

   Polgreen PM, Chen Y, Pennock DM, Nelson FD, and Weinstein RA. Using internet searches for influenza surveillance. Clinical Infectious Diseases. 2008; 47(11):1443–1448.

   Not in our library10.1086/593098

9. 9.
   Monitoring Influenza Epidemics in China with Search Query from Baidu · 2013

   No notice
10. 10.
    The Use of Twitter to Track Levels of Disease Activity and Public Concern in the U.S. during the Influenza A H1N1 Pandemic · 2011

    No notice
11. 11.
    Twitter Improves Influenza Forecasting · 2014

    No notice
12. 12.

    Chen L, Tozammel Hossain KSM, Butler P, Ramakrishnan N, and Prakash BA. Flu Gone Viral: Syndromic Surveillance of Flu on Twitter using Temporal Topic Models. IEEE International Conference In Data Mining (ICDM), 2014; pp. 755–760. IEEE,.

    Not in our library

13. 13.
    Wikipedia usage estimates prevalence of influenza-like illness in the United States in near real-time. · 2014

    Not checked
14. 14.

    Generous N, Fairchild G, Deshpande A, Del Valle SY, and Priedhorsky R. Global disease monitoring and forecasting with wikipedia. PLoS computational biology. 2014; 10(11), e1003892

    Not in our library10.1371/journal.pcbi.1003892

15. 15.

    Crawley AW Flu near you: Comparing crowd-sourced reports of influenza-like illness to the CDC outpatient influenza-like illness surveillance network, October 2012 to March 2014. In 2014 CSTE Annual Conference. Cste, 2014.

    Not in our library

16. 16.

    Smolinski MS, Crawley AW, Baltrusaitis K, Chunara R, Olsen JM, Wojick O, et al Flu Near You: Crowdsourced Symptom Reporting Spanning Two Influenza Seasons. American Journal of Public Health. 2015; e1–e7.

    Not in our library10.2105/ajph.2015.302696

17. 17.

    Santillana M, Nsoesie EO, Mekaru SR, Scales D, Brownstein JS. Using Clinicians’ Search Query Data to Monitor Influenza Epidemics. Clinical Infectious Diseases. 2014; 59 (10): 1446–1450

    Not in our library10.1093/cid/ciu647

18. 18.

    Butler D. When Google got flu wrong. Nature. 2013; 494(7436):155

    Not in our library10.1038/494155a

19. 19.
    Assessing Google Flu Trends Performance in the United States during the 2009 Influenza Virus A (H1N1) Pandemic · 2011

    No notice
20. 20.
    Reassessing Google Flu Trends Data for Detection of Seasonal and Pandemic Influenza: A Comparative Epidemiological Study at Three Geographic Scales · 2013

    No notice
21. 21.

    Lazer DM, Kennedy R, King L, Vespigniani A. The parable of Google flu: traps in big data analysis. Science. 2014; 343, 1203–1205.

    Not in our library10.1126/science.1248506

22. 22.

    Santillana M, Zhang DW, Althouse BM, and Ayers JW. What can digital disease detection learn from (an external revision to) Google flu trends? Am. J. Prev. Med. 2014; 47, 341–347.

    Not in our library10.1016/j.amepre.2014.05.020

23. 23.

    Davidson M, Haim DA, and Radin JM. Using Networks to Combine Big Data and Traditional Surveillance to Improve Influenza Predictions. Sci. Rep. 2015; 5

    Not in our library10.1038/srep08154

24. 24.

    Yang S, Santillana M, and Kou SC. ARGO: a model for accurate estimation of influenza epidemics using Google search data. 2015. arXiv preprint arXiv:150500864.

    Not in our library10.1073/pnas.1515373112

25. 25.

    Lamb A, Paul MJ, and Dredze M. Separating Fact from Fear: Tracking Flu Infections on Twitter. HLT-NAACL. 2013.

    Not in our library

26. 26.
    National and Local Influenza Surveillance through Twitter: An Analysis of the 2012-2013 Influenza Epidemic · 2013

    No notice
27. 27.

    Dredze M, Cheng R, Paul M, and Broniatowski D. HealthTweets.org: A Platform for Public Health Surveillance using Twitter. AAAI Workshop on the World Wide Web and Public Health Intelligence, 2014.

    Not in our library

28. 28.

    Copeland P, Romano R, Zhang T, Hecht G, Zigmond D, Stefansen C. Google disease trends: an update. Int Soc Negl Trop Dis. 2013; 3.

    Not in our library

29. 29.

    Stefansen C. Google Flu Trends gets a brand new engine. Google Research Blog. 2014.

    Not in our library

30. 30.

    Friedman J, Hastie T, and Tibshirani R. The elements of statistical learning. 2009; Vol. 2, No. 1. New York: springer.

    Not in our library

31. 31.

    Breiman L. Stacked regressions. Machine Learning.1996; 24, 49–64.

    Not in our library

32. 32.

    Smola A, and Vapnik V. Support vector regression machines. Advances in neural information processing systems. 1997; 9: 155–161.

    Not in our library

33. 33.

    Freund Y, and Schapire RE. A decision-theoretic generalization of on-line learning and an application to boosting. Journal of computer and system sciences.1997; 55.1: 119–139.

    Not in our library

34. 34.

    Brownstein JS, and Mandl KD. Reengineering real time outbreak detection systems for influenza epidemic monitoring. In AMIA Annual Symposium Proceedings American Medical Informatics Association. 2006; Vol. 2006, p. 866.

    Not in our library

35. 35.
    Monitoring the Impact of Influenza by Age: Emergency Department Fever and Respiratory Complaint Surveillance in New York City · 2007

    No notice
36. 36.

    Viboud C, Charu V, Olson D, Ballesteros S, Gog J, Khan F, et al Demonstrating the use of high-volume electronic medical claims data to monitor local and regional influenza activity in the US. PLOS One. 2014; 9(7): e102429

    Not in our library10.1371/journal.pone.0102429

37. 37.

    Paolotti D, Carnahan A, Colizza V, Eames K, Edmunds J, Gomes G, et al Web-based participatory surveillance of infectious diseases: the Influenzanet participatory surveillance experience. Clinical Microbiology and Infection. 2014; 20(1), 17–21.

    Not in our library10.1111/1469-0691.12477

38. 38.

    Dalton C, Durrheim D, Fejsa J, Francis L, Carlson S, d'Espaignet ET, et al Flutracking: a weekly Australian community online survey of influenza-like illness in 2006, 2007 and 2008. Commun Dis Intell Q Rep. 2009; 33(3): 316–22.

    Not in our library10.33321/cdi.2009.33.34

39. 39.
    Using Web Search Query Data to Monitor Dengue Epidemics: A New Model for Neglected Tropical Disease Surveillance · 2011

    No notice
40. 40.
    A new approach to monitoring dengue activity. · 2011

    Not checked
41. 41.

    Gluskin RT, Johansson M, Santillana M, Brownstein JS. Evaluation of Internet-based dengue query data: Google Dengue Trends. PLoS neglected tropical diseases. 2014; 8.2: e2713.

    Not in our library10.1371/journal.pntd.0002713

42. 42.

    Ocampo AJ, Chunara R, and Brownstein JS. Using search queries for malaria surveillance, Thailand. Malaria journal. 2013; 12.1: 390.

    Not in our library10.1186/1475-2875-12-390

43. 43.
    A Case Study of the New York City 2012-2013 Influenza Season With Daily Geocoded Twitter Data From Temporal and Spatiotemporal Perspectives · 2014

    Not checked

Cited by papers we hold 3

• Cross-sectional telephone surveys as a tool to study epidemiological factors and monitor seasonal influenza activity in Malta · 2021
  Not checked
• Data Mining and Content Analysis of the Chinese Social Media Platform Weibo During the Early COVID-19 Outbreak: Retrospective Observational Infoveillance Study · 2020
  Not checked
• Predicting COVID-19 Incidence Through Analysis of Google Trends Data in Iran: Data Mining and Deep Learning Pilot Study · 2020
  No notice

Reads

A person counts once a day per paper. We keep no cookie and no address: a reader is a hash that changes every day. Any month under five reads shows no number.