Monitoring Influenza Activity in the United States: a Comparison of Traditional Surveillance Systems with Google Flu Trends

Overview

Journal PLoS One

Specialties General Medicine
Science

Date 2011 May 11

PMID 21556151

Citations 69

Authors

Justin R Ortiz

Hong Zhou

David K Shay

Kathleen M Neuzil

Ashley L Fowlkes

Christopher H Goss

Affiliations

Soon will be listed here.

Abstract

Background: Google Flu Trends was developed to estimate US influenza-like illness (ILI) rates from internet searches; however ILI does not necessarily correlate with actual influenza virus infections.

Methods And Findings: Influenza activity data from 2003-04 through 2007-08 were obtained from three US surveillance systems: Google Flu Trends, CDC Outpatient ILI Surveillance Network (CDC ILI Surveillance), and US Influenza Virologic Surveillance System (CDC Virus Surveillance). Pearson's correlation coefficients with 95% confidence intervals (95% CI) were calculated to compare surveillance data. An analysis was performed to investigate outlier observations and determine the extent to which they affected the correlations between surveillance data. Pearson's correlation coefficient describing Google Flu Trends and CDC Virus Surveillance over the study period was 0.72 (95% CI: 0.64, 0.79). The correlation between CDC ILI Surveillance and CDC Virus Surveillance over the same period was 0.85 (95% CI: 0.81, 0.89). Most of the outlier observations in both comparisons were from the 2003-04 influenza season. Exclusion of the outlier observations did not substantially improve the correlation between Google Flu Trends and CDC Virus Surveillance (0.82; 95% CI: 0.76, 0.87) or CDC ILI Surveillance and CDC Virus Surveillance (0.86; 95%CI: 0.82, 0.90).

Conclusions: This analysis demonstrates that while Google Flu Trends is highly correlated with rates of ILI, it has a lower correlation with surveillance for laboratory-confirmed influenza. Most of the outlier observations occurred during the 2003-04 influenza season that was characterized by early and intense influenza activity, which potentially altered health care seeking behavior, physician testing practices, and internet search behavior.

Citing Articles

Infodemiology of Influenza-like Illness: Utilizing Google Trends' Big Data for Epidemic Surveillance.

Shih D, Wu Y, Wu T, Chang S, Shih M J Clin Med. 2024; 13(7).

PMID: 38610711 PMC: 11012909. DOI: 10.3390/jcm13071946.

Using the Baidu index to predict trends in the incidence of tuberculosis in Jiangsu Province, China.

Wang Y, Zhou H, Zheng L, Li M, Hu B Front Public Health. 2023; 11:1203628.

PMID: 37533520 PMC: 10390734. DOI: 10.3389/fpubh.2023.1203628.

Influenza surveillance with Baidu index and attention-based long short-term memory model.

Dai S, Han L PLoS One. 2023; 18(1):e0280834.

PMID: 36689543 PMC: 9870163. DOI: 10.1371/journal.pone.0280834.

Application of the Internet Platform in Monitoring Chinese Public Attention to the Outbreak of COVID-19.

Gong X, Hou M, Han Y, Liang H, Guo R Front Public Health. 2022; 9:755530.

PMID: 35155335 PMC: 8831856. DOI: 10.3389/fpubh.2021.755530.

Suggestion of a simpler and faster influenza-like illness surveillance system using 2014-2018 claims data in Korea.

Choi H, Choi W, Han E Sci Rep. 2021; 11(1):11243.

PMID: 34045533 PMC: 8159991. DOI: 10.1038/s41598-021-90511-0.

References

Talavera G, Mezquita N . Human metapneumovirus in children with influenza-like illness in Yucatan, Mexico. Am J Trop Med Hyg. 2007; 76(1):182-3. View

Birch C, Clothier H, Seccull A, Tran T, Catton M, Lambert S . Human coronavirus OC43 causes influenza-like illness in residents and staff of aged-care facilities in Melbourne, Australia. Epidemiol Infect. 2005; 133(2):273-7. PMC: 2870246. DOI: 10.1017/s0950268804003346. View

Brammer L, Budd A, Cox N . Seasonal and pandemic influenza surveillance considerations for constructing multicomponent systems. Influenza Other Respir Viruses. 2009; 3(2):51-8. PMC: 4634524. DOI: 10.1111/j.1750-2659.2009.00077.x. View

Izurieta H, Thompson W, Kramarz P, Shay D, Davis R, DeStefano F . Influenza and the rates of hospitalization for respiratory disease among infants and young children. N Engl J Med. 2000; 342(4):232-9. DOI: 10.1056/NEJM200001273420402. View

Bhat N, Wright J, Broder K, Murray E, Greenberg M, Glover M . Influenza-associated deaths among children in the United States, 2003-2004. N Engl J Med. 2005; 353(24):2559-67. DOI: 10.1056/NEJMoa051721. View

Valdivia A, Lopez-Alcalde J, Vicente M, Pichiule M, Ruiz M, Ordobas M . Monitoring influenza activity in Europe with Google Flu Trends: comparison with the findings of sentinel physician networks - results for 2009-10. Euro Surveill. 2010; 15(29). DOI: 10.2807/ese.15.29.19621-en. View

Wilson N, Mason K, Tobias M, Peacey M, Huang Q, Baker M . Interpreting Google flu trends data for pandemic H1N1 influenza: the New Zealand experience. Euro Surveill. 2009; 14(44). View

Zambon M, Stockton J, Clewley J, Fleming D . Contribution of influenza and respiratory syncytial virus to community cases of influenza-like illness: an observational study. Lancet. 2001; 358(9291):1410-6. DOI: 10.1016/s0140-6736(01)06528-x. View

Thompson W, Shay D, Weintraub E, Brammer L, Bridges C, Cox N . Influenza-associated hospitalizations in the United States. JAMA. 2004; 292(11):1333-40. DOI: 10.1001/jama.292.11.1333. View

10.

Cook A, Chen M, Pin Lin R . Internet search limitations and pandemic influenza, Singapore. Emerg Infect Dis. 2010; 16(10):1647-9. PMC: 3294408. DOI: 10.3201/eid1610.100840. View

11.

Lipsitch M, Riley S, Cauchemez S, Ghani A, Ferguson N . Managing and reducing uncertainty in an emerging influenza pandemic. N Engl J Med. 2009; 361(2):112-5. PMC: 3066026. DOI: 10.1056/NEJMp0904380. View

12.

Thompson W, Shay D, Weintraub E, Brammer L, Cox N, Anderson L . Mortality associated with influenza and respiratory syncytial virus in the United States. JAMA. 2003; 289(2):179-86. DOI: 10.1001/jama.289.2.179. View

13.

Poehling K, Edwards K, Weinberg G, Szilagyi P, Staat M, Iwane M . The underrecognized burden of influenza in young children. N Engl J Med. 2006; 355(1):31-40. DOI: 10.1056/NEJMoa054869. View

14.

Neuzil K, OConnor T, Gorse G, Nichol K . Recognizing influenza in older patients with chronic obstructive pulmonary disease who have received influenza vaccine. Clin Infect Dis. 2003; 36(2):169-74. DOI: 10.1086/345668. View

15.

Hasman H, Pachucki C, Unal A, Nguyen D, Devlin T, Peeples M . Aetiology of influenza-like illness in adults includes parainfluenzavirus type 4. J Med Microbiol. 2009; 58(Pt 4):408-413. PMC: 2778239. DOI: 10.1099/jmm.0.006098-0. View

16.

Simonsen L, Clarke M, Williamson G, Stroup D, Arden N, Schonberger L . The impact of influenza epidemics on mortality: introducing a severity index. Am J Public Health. 1998; 87(12):1944-50. PMC: 1381234. DOI: 10.2105/ajph.87.12.1944. View

17.

Ginsberg J, Mohebbi M, Patel R, Brammer L, Smolinski M, Brilliant L . Detecting influenza epidemics using search engine query data. Nature. 2008; 457(7232):1012-4. DOI: 10.1038/nature07634. View

18.

Thompson W, Weintraub E, Dhankhar P, Cheng P, Brammer L, Meltzer M . Estimates of US influenza-associated deaths made using four different methods. Influenza Other Respir Viruses. 2009; 3(1):37-49. PMC: 4986622. DOI: 10.1111/j.1750-2659.2009.00073.x. View

19.

Treanor J, Hayden F, Vrooman P, Barbarash R, Bettis R, Riff D . Efficacy and safety of the oral neuraminidase inhibitor oseltamivir in treating acute influenza: a randomized controlled trial. US Oral Neuraminidase Study Group. JAMA. 2000; 283(8):1016-24. DOI: 10.1001/jama.283.8.1016. View

20.

. Estimates of deaths associated with seasonal influenza --- United States, 1976-2007. MMWR Morb Mortal Wkly Rep. 2010; 59(33):1057-62. View