Using Rule-based Natural Language Processing to Improve Disease Normalization in Biomedical Text

Overview

Journal J Am Med Inform Assoc

Publisher Oxford University Press

Specialty Medical Informatics

Date 2012 Oct 9

PMID 23043124

Citations 37

Authors

Ning Kang

Bharat Singh

Zubair Afzal

Erik M van Mulligen

Jan A Kors

Affiliations

Soon will be listed here.

Abstract

Background And Objective: In order for computers to extract useful information from unstructured text, a concept normalization system is needed to link relevant concepts in a text to sources that contain further information about the concept. Popular concept normalization tools in the biomedical field are dictionary-based. In this study we investigate the usefulness of natural language processing (NLP) as an adjunct to dictionary-based concept normalization.

Methods: We compared the performance of two biomedical concept normalization systems, MetaMap and Peregrine, on the Arizona Disease Corpus, with and without the use of a rule-based NLP module. Performance was assessed for exact and inexact boundary matching of the system annotations with those of the gold standard and for concept identifier matching.

Results: Without the NLP module, MetaMap and Peregrine attained F-scores of 61.0% and 63.9%, respectively, for exact boundary matching, and 55.1% and 56.9% for concept identifier matching. With the aid of the NLP module, the F-scores of MetaMap and Peregrine improved to 73.3% and 78.0% for boundary matching, and to 66.2% and 69.8% for concept identifier matching. For inexact boundary matching, performances further increased to 85.5% and 85.4%, and to 73.6% and 73.3% for concept identifier matching.

Conclusions: We have shown the added value of NLP for the recognition and normalization of diseases with MetaMap and Peregrine. The NLP module is general and can be applied in combination with any concept normalization system. Whether its use for concept types other than disease is equally advantageous remains to be investigated.

Citing Articles

PromptLink: Leveraging Large Language Models for Cross-Source Biomedical Concept Linking.

Xie Y, Lu J, Ho J, Nahab F, Hu X, Yang C Int ACM SIGIR Conf Res Dev Inf Retr. 2025; 2024:2589-2593.

PMID: 40018364 PMC: 11867735. DOI: 10.1145/3626772.3657904.

Mapping vaccine names in clinical trials to vaccine ontology using cascaded fine-tuned domain-specific language models.

Li J, Li Y, Pan Y, Guo J, Sun Z, Li F J Biomed Semantics. 2024; 15(1):14.

PMID: 39123237 PMC: 11316402. DOI: 10.1186/s13326-024-00318-x.

Thyroid Ultrasound Appropriateness Identification Through Natural Language Processing of Electronic Health Records.

Jacome C, Segura Torres D, Fan J, Loor-Torres R, Duran M, Al Zahidy M Mayo Clin Proc Digit Health. 2024; 2(1):67-74.

PMID: 38501072 PMC: 10947349. DOI: 10.1016/j.mcpdig.2024.01.001.

Mapping Vaccine Names in Clinical Trials to Vaccine Ontology using Cascaded Fine-Tuned Domain-Specific Language Models.

Li J, Li Y, Pan Y, Guo J, Sun Z, Li F Res Sq. 2023; .

PMID: 37841880 PMC: 10571639. DOI: 10.21203/rs.3.rs-3362256/v1.

B-LBConA: a medical entity disambiguation model based on Bio-LinkBERT and context-aware mechanism.

Yang S, Zhang P, Che C, Zhong Z BMC Bioinformatics. 2023; 24(1):97.

PMID: 36927359 PMC: 10021986. DOI: 10.1186/s12859-023-05209-z.

References

Bodenreider O . The Unified Medical Language System (UMLS): integrating biomedical terminology. Nucleic Acids Res. 2003; 32(Database issue):D267-70. PMC: 308795. DOI: 10.1093/nar/gkh061. View

Ratkovic Z, Golik W, Warnier P . Event extraction of bacteria biotopes: a knowledge-intensive NLP-based approach. BMC Bioinformatics. 2012; 13 Suppl 11:S8. PMC: 3384252. DOI: 10.1186/1471-2105-13-S11-S8. View

Okazaki N, Ananiadou S, Tsujii J . Building a high-quality sense inventory for improved abbreviation disambiguation. Bioinformatics. 2010; 26(9):1246-53. PMC: 2859134. DOI: 10.1093/bioinformatics/btq129. View

Morgan A, Lu Z, Wang X, Cohen A, Fluck J, Ruch P . Overview of BioCreative II gene normalization. Genome Biol. 2008; 9 Suppl 2:S3. PMC: 2559987. DOI: 10.1186/gb-2008-9-s2-s3. View

Baumgartner Jr W, Lu Z, Johnson H, Caporaso J, Paquette J, Lindemann A . Concept recognition for extracting protein interaction relations from biomedical text. Genome Biol. 2008; 9 Suppl 2:S9. PMC: 2559993. DOI: 10.1186/gb-2008-9-s2-s9. View

Shah N, Bhatia N, Jonquet C, Rubin D, Chiang A, Musen M . Comparison of concept recognizers for building the Open Biomedical Annotator. BMC Bioinformatics. 2009; 10 Suppl 9:S14. PMC: 2745685. DOI: 10.1186/1471-2105-10-S9-S14. View

Rebholz-Schuhmann D, Arregui M, Gaudan S, Kirsch H, Jimeno A . Text processing through Web services: calling Whatizit. Bioinformatics. 2007; 24(2):296-8. DOI: 10.1093/bioinformatics/btm557. View

Thompson P, Iqbal S, McNaught J, Ananiadou S . Construction of an annotated corpus to support biomedical information extraction. BMC Bioinformatics. 2009; 10:349. PMC: 2774701. DOI: 10.1186/1471-2105-10-349. View

Wang X, Matthews M . Distinguishing the species of biomedical named entities for term identification. BMC Bioinformatics. 2008; 9 Suppl 11:S6. PMC: 2586755. DOI: 10.1186/1471-2105-9-S11-S6. View

10.

Aronson A . Effective mapping of biomedical text to the UMLS Metathesaurus: the MetaMap program. Proc AMIA Symp. 2002; :17-21. PMC: 2243666. View

11.

Harris M, Clark J, Ireland A, Lomax J, Ashburner M, Foulger R . The Gene Ontology (GO) database and informatics resource. Nucleic Acids Res. 2003; 32(Database issue):D258-61. PMC: 308770. DOI: 10.1093/nar/gkh036. View

12.

Lu Z, Kao H, Wei C, Huang M, Liu J, Kuo C . The gene normalization task in BioCreative III. BMC Bioinformatics. 2011; 12 Suppl 8:S2. PMC: 3269937. DOI: 10.1186/1471-2105-12-S8-S2. View

13.

Schuemie M, Mons B, Weeber M, Kors J . Evaluation of techniques for increasing recall in a dictionary approach to gene and protein name identification. J Biomed Inform. 2006; 40(3):316-24. DOI: 10.1016/j.jbi.2006.09.002. View

14.

Uzuner O, South B, Shen S, DuVall S . 2010 i2b2/VA challenge on concepts, assertions, and relations in clinical text. J Am Med Inform Assoc. 2011; 18(5):552-6. PMC: 3168320. DOI: 10.1136/amiajnl-2011-000203. View

15.

Hanisch D, Fundel K, Mevissen H, Zimmer R, Fluck J . ProMiner: rule-based protein and gene entity recognition. BMC Bioinformatics. 2005; 6 Suppl 1:S14. PMC: 1869006. DOI: 10.1186/1471-2105-6-S1-S14. View

16.

Krauthammer M, Nenadic G . Term identification in the biomedical literature. J Biomed Inform. 2004; 37(6):512-26. DOI: 10.1016/j.jbi.2004.08.004. View

17.

Mutalik P, Deshpande A, Nadkarni P . Use of general-purpose negation detection to augment concept indexing of medical documents: a quantitative study using the UMLS. J Am Med Inform Assoc. 2001; 8(6):598-609. PMC: 130070. DOI: 10.1136/jamia.2001.0080598. View

18.

Hakenberg J, Plake C, Leaman R, Schroeder M, Gonzalez G . Inter-species normalization of gene mentions with GNAT. Bioinformatics. 2008; 24(16):i126-132. DOI: 10.1093/bioinformatics/btn299. View

19.

Tsuruoka Y, McNaught J, Ananiadou S . Normalizing biomedical terms by minimizing ambiguity and variability. BMC Bioinformatics. 2008; 9 Suppl 3:S2. PMC: 2352870. DOI: 10.1186/1471-2105-9-S3-S2. View

20.

Schwartz A, Hearst M . A simple algorithm for identifying abbreviation definitions in biomedical text. Pac Symp Biocomput. 2003; :451-62. View