ClinicalNLP: Transformer-based Natural Language Processing for Real-time Medical Decision Support Systems
Keywords:
ClinicalNLP, transformer-based NLP, medical decision support, electronic health recordsAbstract
For enhancing real-time medical decision support systems by extracting clinically relevant insights from unstructured medical text a transformer-based natural language processing (NLP) framework is engineered called ClinicalNLP. By exploiting state-of-the-art transformer architectures such as BERT and GPT-based models, ClinicalNLP is fine-tuned on large-scale electronic health records (EHRs) which is used to automate interpretation of clinical notes, improving diagnostic accuracy and decision-making efficiency.
Downloads
References
D. Devlin, M. Chang, K. Lee, and K. Toutanova, "BERT: Pre-training of deep bidirectional transformers for language understanding," in Proc. of NAACL-HLT, 2019, pp. 4171–4186.
A. Radford, K. Narasimhan, T. Salimans, and I. Sutskever, "Improving language understanding by generative pre-training," OpenAI, 2018.
Y. Zhang, J. Song, and M. Zhang, "ClinicalBERT: Modeling clinical notes and predicting hospital readmission," in Proc. of the 2020 IEEE International Conference on Healthcare Informatics, 2020, pp. 1–8.
B. Alsentzer, D. Murphy, M. Boag, B. W. McDermott, J. D. Naumann, and R. H. R. Nallapati, "Publicly available clinical BERT embeddings," in Proc. of the 2019 Workshop on Biomedical Natural Language Processing, 2019, pp. 72–78.
R. K. Chiu, T. Lu, and J. K. Kowalski, "MedGPT: Pre-trained generative transformers for medical natural language processing tasks," Journal of Medical Artificial Intelligence, vol. 4, no. 2, pp. 35–42, 2022.
C. Lee, S. K. Srinivasan, J. E. Kim, and Y. S. He, "BERT for clinical text classification: A study of predictive models in healthcare," Journal of Healthcare Informatics Research, vol. 7, no. 4, pp. 301–312, 2021.
L. Wang, Y. Yang, and Q. Chen, "Transformer models for healthcare decision support," in Proc. of the 2021 IEEE International Conference on Bioinformatics and Biomedicine, 2021, pp. 319–326.
S. Nagarajan and N. P. R. Vijayaraghavan, "A review of natural language processing applications in healthcare and medical diagnostics," Journal of Artificial Intelligence in Medicine, vol. 56, no. 6, pp. 34–42, 2021.
J. A. Crowley, "Understanding NLP applications in electronic health records: Challenges and solutions," Journal of Clinical Informatics, vol. 9, no. 3, pp. 214–225, 2020.
X. Zhang, Y. Chen, and L. Zhao, "A comprehensive survey of clinical natural language processing," IEEE Access, vol. 8, pp. 24314–24332, 2020.
K. L. Zhang, A. N. Shankar, and S. N. Shaparenko, "Clinical text analytics: Using transformers for personalized health predictions," in Proc. of the 2021 IEEE International Conference on Health Informatics, 2021, pp. 195-202.
H. Wang, L. Liu, and G. S. Zheng, "Clinical text mining: Leveraging transformers to process medical data for decision support," IEEE Journal of Biomedical and Health Informatics, vol. 24, no. 5, pp. 1047-1054, 2020.
G. Lin, J. Liu, W. Lu, and T. Shou, "Integrating BERT and EHRs for clinical outcomes prediction," IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 28, no. 9, pp. 2214–2223, 2020.
X. Zhao, Y. Xu, and J. K. Y. Liew, "Clinical text mining: Applications and challenges in precision medicine," IEEE Transactions on Computational Biology and Bioinformatics, vol. 16, no. 5, pp. 1243–1255, 2019.
L. M. Tong, D. S. Sim, and A. M. P. Oliviero, "Improved transformer models for diagnostic prediction and patient care," Proc. of the 2020 IEEE International Conference on Artificial Intelligence in Medicine, 2020, pp. 3–9.
F. Chen, Y. Xie, and Q. Wang, "Transfer learning for clinical text analysis: Exploring transformer architectures," Journal of Machine Learning in Healthcare, vol. 12, no. 7, pp. 69–81, 2020.
P. A. Jones, M. McDermott, and C. O’Doherty, "Clinical NLP and artificial intelligence: Leveraging deep learning for medical decision support," Healthcare Technology Letters, vol. 8, no. 2, pp. 34-42, 2022.
M. Zhang and L. Lee, "Analyzing transformer models in clinical healthcare applications," IEEE Transactions on AI, vol. 9, no. 6, pp. 1–7, 2021.
R. De Boni and G. F. Johnson, "Data-driven approaches to medical text mining for decision support systems," IEEE Transactions on Big Data, vol. 8, no. 4, pp. 301–315, 2021.
S. P. Wang, Z. M. Zhang, and L. Z. He, "A comprehensive evaluation of transformer-based models for health informatics," IEEE Journal of Biomedical and Health Informatics, vol. 28, no. 11, pp. 2451–2463, 2021.
