BackgroundThe role of computed tomography (CT) in the diagnosis and characterization of coronavirus disease 2019 (COVID-19) pneumonia has been widely recognized. We evaluated the performance of a software for quantitative analysis of chest CT, the LungQuant system, by comparing its results with independent visual evaluations by a group of 14 clinical experts. The aim of this work is to evaluate the ability of the automated tool to extract quantitative information from lung CT, relevant for the design of a diagnosis support model.MethodsLungQuant segments both the lungs and lesions associated with COVID-19 pneumonia (ground-glass opacities and consolidations) and computes derived quantities corresponding to qualitative characteristics used to clinically assess COVID-19 lesions. The comparison was carried out on 120 publicly available CT scans of patients affected by COVID-19 pneumonia. Scans were scored for four qualitative metrics: percentage of lung involvement, type of lesion, and two disease distribution scores. We evaluated the agreement between the LungQuant output and the visual assessments through receiver operating characteristics area under the curve (AUC) analysis and by fitting a nonlinear regression model.ResultsDespite the rather large heterogeneity in the qualitative labels assigned by the clinical experts for each metric, we found good agreement on the metrics compared to the LungQuant output. The AUC values obtained for the four qualitative metrics were 0.98, 0.85, 0.90, and 0.81.ConclusionsVisual clinical evaluation could be complemented and supported by computer-aided quantification, whose values match the average evaluation of several independent clinical experts.

A multicenter evaluation of a deep learning software (LungQuant) for lung parenchyma characterization in COVID-19 pneumonia / Scapicchio, Camilla; Chincarini, Andrea; Ballante, Elena; Berta, Luca; Bicci, Eleonora; Bortolotto, Chandra; Brero, Francesca; Cabini, Raffaella Fiamma; Cristofalo, Giuseppe; Fanni, Salvatore Claudio; Fantacci, Maria Evelina; Figini, Silvia; Galia, Massimo; Gemma, Pietro; Grassedonio, Emanuele; Lascialfari, Alessandro; Lenardi, Cristina; Lionetti, Alice; Lizzi, Francesca; Marrale, Maurizio; Midiri, Massimo; Nardi, Cosimo; Oliva, Piernicola; Perillo, Noemi; Postuma, Ian; Preda, Lorenzo; Rastrelli, Vieri; Rizzetto, Francesco; Spina, Nicola; Talamonti, Cinzia; Torresin, Alberto; Vanzulli, Angelo; Volpi, Federica; Neri, Emanuele; Retico, Alessandra. - In: EUROPEAN RADIOLOGY EXPERIMENTAL. - ISSN 2509-9280. - ELETTRONICO. - 7:(2023), pp. 18.18-18.31. [10.1186/s41747-023-00334-z]

A multicenter evaluation of a deep learning software (LungQuant) for lung parenchyma characterization in COVID-19 pneumonia

Bicci, Eleonora;Lascialfari, Alessandro;Nardi, Cosimo;Rastrelli, Vieri;Talamonti, Cinzia;
2023

Abstract

BackgroundThe role of computed tomography (CT) in the diagnosis and characterization of coronavirus disease 2019 (COVID-19) pneumonia has been widely recognized. We evaluated the performance of a software for quantitative analysis of chest CT, the LungQuant system, by comparing its results with independent visual evaluations by a group of 14 clinical experts. The aim of this work is to evaluate the ability of the automated tool to extract quantitative information from lung CT, relevant for the design of a diagnosis support model.MethodsLungQuant segments both the lungs and lesions associated with COVID-19 pneumonia (ground-glass opacities and consolidations) and computes derived quantities corresponding to qualitative characteristics used to clinically assess COVID-19 lesions. The comparison was carried out on 120 publicly available CT scans of patients affected by COVID-19 pneumonia. Scans were scored for four qualitative metrics: percentage of lung involvement, type of lesion, and two disease distribution scores. We evaluated the agreement between the LungQuant output and the visual assessments through receiver operating characteristics area under the curve (AUC) analysis and by fitting a nonlinear regression model.ResultsDespite the rather large heterogeneity in the qualitative labels assigned by the clinical experts for each metric, we found good agreement on the metrics compared to the LungQuant output. The AUC values obtained for the four qualitative metrics were 0.98, 0.85, 0.90, and 0.81.ConclusionsVisual clinical evaluation could be complemented and supported by computer-aided quantification, whose values match the average evaluation of several independent clinical experts.
2023
7
18
31
Goal 3: Good health and well-being
Scapicchio, Camilla; Chincarini, Andrea; Ballante, Elena; Berta, Luca; Bicci, Eleonora; Bortolotto, Chandra; Brero, Francesca; Cabini, Raffaella Fiamm...espandi
File in questo prodotto:
File Dimensione Formato  
LungQuant - ER Experimental.pdf

accesso aperto

Descrizione: Articolo su rivista
Tipologia: Pdf editoriale (Version of record)
Licenza: Open Access
Dimensione 4.86 MB
Formato Adobe PDF
4.86 MB Adobe PDF

I documenti in FLORE sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificatore per citare o creare un link a questa risorsa: https://hdl.handle.net/2158/1323615
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 5
  • ???jsp.display-item.citation.isi??? 5
social impact