Correction of Vaccine Effectiveness Derived from Test-negative Case-control Studies

Overview

Journal BMC Med Res Methodol

Publisher Biomed Central

Specialties General Medicine
Health Services

Date 2023 Jun 10

PMID 37301843

Authors

Farrokh Habibzadeh

Affiliations

Soon will be listed here.

Abstract

Background: Determining the vaccine effectiveness (VE) is an important part of studying every new vaccine. Test-negative case-control (TNCC) studies have recently been used to determine the VE. However, the estimated VE derived from a TNCC design depends on the test sensitivity and specificity. Herein, a method for correction of the value of VE derived from a TNCC study is presented.

Methods: An analytical method is presented to compute the corrected VE based on the sensitivity and specificity of the diagnostic test utilized. To show the application of the method proposed, a hypothetical TNCC study is presented. In this in silico study, 100 000 individuals referring to a healthcare system for COVID-19-like illness were tested with diagnostic tests with sensitivities of 0.6, 0.8, and 1.0, and specificities ranging from 0.85 to 1.00. A vaccination coverage of 60%, an attack rate of 0.05 for COVID-19 in unvaccinated group, and a true VE of 0.70, were assumed. In this simulation, a COVID-19-like illness with an attack rate of 0.30 could also affect all the studied population regardless of their vaccination status.

Results: The observed VE ranged from 0.11 (computed for a test sensitivity of 0.60 and specificity of 0.85) to 0.71 (computed for a test sensitivity and specificity of 1.0). The mean computed corrected VE derived from the proposed method was 0.71 (the standard deviation of 0.02).

Conclusions: The observed VE derived from TNCC studies can be corrected easily. An acceptable estimate for VE can be computed regardless of the diagnostic test sensitivity and specificity used in the study.

Citing Articles

Estimating the number of probable new SARS-CoV-2 infections among tested subjects from the number of confirmed cases.

Diarra Y, Wimba P, Katchunga P, Bengehya J, Miganda B, Oyimangirwe M BMC Med Res Methodol. 2023; 23(1):272.

PMID: 37978439 PMC: 10655282. DOI: 10.1186/s12874-023-02077-2.

References

Chua H, Feng S, Lewnard J, Sullivan S, Blyth C, Lipsitch M . The Use of Test-negative Controls to Monitor Vaccine Effectiveness: A Systematic Review of Methodology. Epidemiology. 2019; 31(1):43-64. PMC: 6888869. DOI: 10.1097/EDE.0000000000001116. View

Hoberman A, Greenberg D, Paradise J, Rockette H, Lave J, Kearney D . Effectiveness of inactivated influenza vaccine in preventing acute otitis media in young children: a randomized controlled trial. JAMA. 2003; 290(12):1608-16. DOI: 10.1001/jama.290.12.1608. View

Orenstein E, De Serres G, Haber M, Shay D, Bridges C, Gargiullo P . Methodologic issues regarding the use of three observational study designs to assess influenza vaccine effectiveness. Int J Epidemiol. 2007; 36(3):623-31. DOI: 10.1093/ije/dym021. View

Eguia R, Crawford K, Stevens-Ayers T, Kelnhofer-Millevolte L, Greninger A, Englund J . A human coronavirus evolves antigenically to escape antibody immunity. PLoS Pathog. 2021; 17(4):e1009453. PMC: 8031418. DOI: 10.1371/journal.ppat.1009453. View

Jackson M, Nelson J . The test-negative design for estimating influenza vaccine effectiveness. Vaccine. 2013; 31(17):2165-8. DOI: 10.1016/j.vaccine.2013.02.053. View

Gupta R, Topol E . COVID-19 vaccine breakthrough infections. Science. 2021; 374(6575):1561-1562. DOI: 10.1126/science.abl8487. View

Habibzadeh F, Habibzadeh P, Yadollahie M . The apparent prevalence, the true prevalence. Biochem Med (Zagreb). 2022; 32(2):020101. PMC: 9195606. DOI: 10.11613/BM.2022.020101. View

Schulz K, Grimes D . Case-control studies: research in reverse. Lancet. 2002; 359(9304):431-4. DOI: 10.1016/S0140-6736(02)07605-5. View

Lipsitch M . Measuring and interpreting associations between antibiotic use and penicillin resistance in Streptococcus pneumoniae. Clin Infect Dis. 2001; 32(7):1044-54. DOI: 10.1086/319604. View

10.

Habibzadeh F, Habibzadeh P, Yadollahie M . On determining the most appropriate test cut-off value: the case of tests with continuous results. Biochem Med (Zagreb). 2016; 26(3):297-307. PMC: 5082211. DOI: 10.11613/BM.2016.034. View

11.

Lewnard J, Patel M, Jewell N, Verani J, Kobayashi M, Tenforde M . Theoretical Framework for Retrospective Studies of the Effectiveness of SARS-CoV-2 Vaccines. Epidemiology. 2021; 32(4):508-517. PMC: 8168935. DOI: 10.1097/EDE.0000000000001366. View

12.

Vandenbroucke J, Pearce N . Test-Negative Designs: Differences and Commonalities with Other Case-Control Studies with "Other Patient" Controls. Epidemiology. 2019; 30(6):838-844. DOI: 10.1097/EDE.0000000000001088. View

13.

De Serres G, Skowronski D, Wu X, Ambrose C . The test-negative design: validity, accuracy and precision of vaccine efficacy estimates compared to the gold standard of randomised placebo-controlled clinical trials. Euro Surveill. 2013; 18(37). DOI: 10.2807/1560-7917.es2013.18.37.20585. View

14.

Volz E, Hill V, McCrone J, Price A, Jorgensen D, OToole A . Evaluating the Effects of SARS-CoV-2 Spike Mutation D614G on Transmissibility and Pathogenicity. Cell. 2020; 184(1):64-75.e11. PMC: 7674007. DOI: 10.1016/j.cell.2020.11.020. View

15.

Sullivan S, Tchetgen Tchetgen E, Cowling B . Theoretical Basis of the Test-Negative Study Design for Assessment of Influenza Vaccine Effectiveness. Am J Epidemiol. 2016; 184(5):345-53. PMC: 5013887. DOI: 10.1093/aje/kww064. View

16.

Shi M, An Q, Ainslie K, Haber M, Orenstein W . A comparison of the test-negative and the traditional case-control study designs for estimation of influenza vaccine effectiveness under nonrandom vaccination. BMC Infect Dis. 2017; 17(1):757. PMC: 5721721. DOI: 10.1186/s12879-017-2838-2. View

17.

Bloemenkamp K, Rosendaal F, Buller H, Helmerhorst F, Colly L, Vandenbroucke J . Risk of venous thrombosis with use of current low-dose oral contraceptives is not explained by diagnostic suspicion and referral bias. Arch Intern Med. 1999; 159(1):65-70. DOI: 10.1001/archinte.159.1.65. View

18.

Altman D, Bland J . Diagnostic tests. 1: Sensitivity and specificity. BMJ. 1994; 308(6943):1552. PMC: 2540489. DOI: 10.1136/bmj.308.6943.1552. View

19.

Habibzadeh F, Habibzadeh P, Yadollahie M . On Measuring Vaccine Effectiveness with Observational Study Designs. Acta Med Acad. 2022; 51(2):134-146. PMC: 9982864. DOI: 10.5644/ama2006-124.383. View

20.

Jackson M, Rothman K . Effects of imperfect test sensitivity and specificity on observational studies of influenza vaccine effectiveness. Vaccine. 2015; 33(11):1313-6. PMC: 5934991. DOI: 10.1016/j.vaccine.2015.01.069. View