Assess and validate predictive performance of models for in-hospital mortality in COVID-19 patients:A retrospective cohort study in the Netherlands comparing the value of registry data with high-granular electronic health records

Purpose: To assess, validate and compare the predictive performance of models for in-hospital mortality of COVID-19 patients admitted to the intensive care unit (ICU) over two different waves of infections. Our models were built with high-granular Electronic Health Records (EHR) data versus less-granular registry data. Methods: Observational study of all COVID-19 patients admitted to 19 Dutch ICUs participating in both the national quality registry National Intensive Care Evaluation (NICE) and the EHR-based Dutch Data Warehouse (hereafter EHR). Multiple models were developed on data from the f... Mehr ...

Verfasser: Vagliano, Iacopo
Schut, Martijn C.
Abu-Hanna, Ameen
Dongelmans, Dave A.
de Lange, Dylan W.
Gommers, Diederik
Cremer, Olaf L.
Bosman, Rob J.
Rigter, Sander
Wils, Evert-Jan
Frenzel, Tim
de Jong, Remko
Peters, Marco A. A.
Kamps, Marlijn J. A.
Ramnarain, Dharmanand
Nowitzky, Ralph
Nooteboom, Fleur G. C. A.
de Ruijter, Wouter
Urlings-Strop, Louise C.
Smit, Ellen G. M.
Mehagnoul-Schipper, D. Jannet
Dormans, Tom
de Jager, Cornelis P. C.
Hendriks, Stefaan H. A.
Achterberg, Sefanja
Oostdijk, Evelien
Reidinga, Auke C.
Festen-Spanjer, Barbara
Brunnekreef, Gert B.
Cornet, Alexander D.
van den Tempel, Walter
Boelens, Age D.
Koetsier, Peter
Lens, Judith
Faber, Harald J.
Karakus, A.
Entjes, Robert
de Jong, Paul
Rettig, Thijs C. D.
Reuland, M. C.
Arbous, Sesmu
Fleuren, Lucas M.
Dam, Tariq A.
Thoral, Patrick J.
Lalisang, Robbert C. A.
Tonutti, Michele
de Bruin, Daan P.
Elbers, Paul W. G.
de Keizer, Nicolette F.
Dokumenttyp: Artikel
Erscheinungsdatum: 2022
Reihe/Periodikum: Vagliano , I , Schut , M C , Abu-Hanna , A , Dongelmans , D A , de Lange , D W , Gommers , D , Cremer , O L , Bosman , R J , Rigter , S , Wils , E-J , Frenzel , T , de Jong , R , Peters , M A A , Kamps , M J A , Ramnarain , D , Nowitzky , R , Nooteboom , F G C A , de Ruijter , W , Urlings-Strop , L C , Smit , E G M , Mehagnoul-Schipper , D J , Dormans , T , de Jager , C P C , Hendriks , S H A , Achterberg , S , Oostdijk , E , Reidinga , A C , Festen-Spanjer , B , Brunnekreef , G B , Cornet , A D , van den Tempel , W , Boelens , A D , Koetsier , P , Lens , J , Faber , H J , Karakus , A , Entjes , R , de Jong , P , Rettig , T C D , Reuland , M C , Arbous , S , Fleuren , L M , Dam , T A , Thoral , P J , Lalisang , R C A , Tonutti , M , de Bruin , D P , Elbers , P W G & de Keizer , N F 2022 , ' Assess and validate predictive performance of models for in-hospital mortality in COVID-19 patients : A retrospective cohort study in the Netherlands comparing the value of registry data with high-granular electronic health records ' , International Journal of Medical Informatics , vol. 167 , 104863 . https://doi.org/10.1016/j.ijmedinf.2022.104863
Sprache: Englisch
Permalink: https://search.fid-benelux.de/Record/base-27232833
Datenquelle: BASE; Originalkatalog
Powered By: BASE
Link(s) : https://research.vumc.nl/en/publications/a3f5211f-c05b-4dc0-9fbc-32625c6ebf35

Purpose: To assess, validate and compare the predictive performance of models for in-hospital mortality of COVID-19 patients admitted to the intensive care unit (ICU) over two different waves of infections. Our models were built with high-granular Electronic Health Records (EHR) data versus less-granular registry data. Methods: Observational study of all COVID-19 patients admitted to 19 Dutch ICUs participating in both the national quality registry National Intensive Care Evaluation (NICE) and the EHR-based Dutch Data Warehouse (hereafter EHR). Multiple models were developed on data from the first 24 h of ICU admissions from February to June 2020 (first COVID-19 wave) and validated on prospective patients admitted to the same ICUs between July and December 2020 (second COVID-19 wave). We assessed model discrimination, calibration, and the degree of relatedness between development and validation population. Coefficients were used to identify relevant risk factors. Results: A total of 1533 patients from the EHR and 1563 from the registry were included. With high granular EHR data, the average AUROC was 0.69 (standard deviation of 0.05) for the internal validation, and the AUROC was 0.75 for the temporal validation. The registry model achieved an average AUROC of 0.76 (standard deviation of 0.05) in the internal validation and 0.77 in the temporal validation. In the EHR data, age, and respiratory-system related variables were the most important risk factors identified. In the NICE registry data, age and chronic respiratory insufficiency were the most important risk factors. Conclusion: In our study, prognostic models built on less-granular but readily-available registry data had similar performance to models built on high-granular EHR data and showed similar transportability to a prospective COVID-19 population. Future research is needed to verify whether this finding can be confirmed for upcoming waves.