CHINESE JOURNAL OF PARASITOLOGY AND PARASITIC DISEASES >
Identification of lesion activities in haptic cystic echinococcosis using machine learning model based on radiomics and clinical features
Received date: 2024-05-16
Revised date: 2024-09-04
Online published: 2024-10-24
Supported by
National Natural Science Foundation of China(82160131);Qinghai Provincial Department of Science and Technology(2021-ZJ-963Q)
Objective To develop machine learning models utilizing radiomic and clinical features to precisely identify the biological activity of haptic cystic echinococcosis (HCE). Methods The CT images and clinical data of 521 HCE patients treated at the Hepatobiliary and Pancreatic Surgery Department of Qinghai University Affiliated Hospital, along with 236 HCE patients treated at the General Surgery Departments of Guoluo Prefectural People’s Hospital and Yushu Prefectural People’s Hospital in 2018-2022, were collected. Radiomics features were extracted and screened accordingly. Univariate and multivariate logistic regression analyses were performed on the clinical data to select features for model construction. To construct radiomics and clinical models, seven machine learning algorithms were employed including Logistic Regression (LR), Support Vector Machine (SVM), K-Nearest Neighbors (KNN), Random Forest (RandomForest), Extreme Gradient Boosting (XGBoost), Light Gradient Boosting Machine (LightGBM), and Extra Trees. A clinical-image combined model was constructed based on the prediction from radiomics model combining clinical model, using soft voting method. DeLong’s test was used to compare the performances of the radiomics model, clinical model, and combined clinical-imaging model. In addition, external validation was utilized to assess the model’s performance. Results A total of 430 patients were included for model development and training, while 171 patients were designated for external validation. Fifty-one radiomics features and five clinical features were selected for model construction. Among the seven machine learning models, the XGBoost algorithm demonstrated the best performance, achieving area under the curve (AUC) values of 0.977 [95% confidence interval (CI): 0.964-0.990] and 0.839 (95% CI: 0.776-0.901) on the training and external validation sets, respectively. The radiomics model achieved AUC values of 0.998 (95% CI: 0.997-1.000) and 0.874 (95% CI: 0.822-0.927), while the combined model obtained AUC values of 1.000 (95% CI: 0.999-1.000) and 0.931 (95% CI: 0.894-0.968). The DeLong test results indicated that the performance of the combined model was superior to that of the clinical model in the training set (Z = 2.154, P < 0.05) and showed no statistically significant difference when compared to the radiomics model (Z = 0.562, P > 0.05); however, its performance on the external validation set was better than both the clinical and radiomics models (Z = 3.338, 3.331; P < 0.05). Calibration plots and decision curve analysis (DCA) indicated that the combined model exhibited the best calibration performance in both the training and external validation sets, yielding the highest net benefit, demonstrating consistent performance across different datasets, and displaying good generalizability and reliability in external validation. Conclusion The machine learning model, developed based on radiomic and clinical data, can precisely identify the biological activity of HCE lesions. The combined model exhibits higher diagnostic accuracy and clinical application potential, providing reference for making treatment plan for HCE patients.
WANG Zhanjin , CHEN Zhiheng , LI Fuyuan , CAI Junjie , XUE Zhangtuo , ZHOU Ying , CAO Yuntai , WANG Zhan . Identification of lesion activities in haptic cystic echinococcosis using machine learning model based on radiomics and clinical features[J]. CHINESE JOURNAL OF PARASITOLOGY AND PARASITIC DISEASES, 2024 , 42(5) : 582 -593 . DOI: 10.12140/j.issn.1000-7423.2024.05.004
| [1] | Wen H, Vuitton L, Tuxun T, et al. Echinococcosis: advances in the 21st century[J]. Clin Microbiol Rev, 2019, 32(2): e00075-18. |
| [2] | Deplazes P, Rinaldi L, Alvarez Rojas CA, et al. Global distribution of alveolar and cystic echinococcosis[J]. Adv Parasitol, 2017, 95: 315-493. |
| [3] | Tamarozzi F, Akhan O, Cretu CM, et al. Prevalence of abdominal cystic echinococcosis in rural Bulgaria, romania, and Turkey: a cross-sectional, ultrasound-based, population study from the HERACLES project[J]. Lancet Infect Dis, 2018, 18(7): 769-778. |
| [4] | Rinaldi F, Brunetti E, Neumayr A, et al. Cystic echinococcosis of the liver: a primer for hepatologists[J]. World J Hepatol, 2014, 6(5): 293-305. |
| [5] | Chinese Doctor Association, Chinese College of Surgeons (CCS), Chinese Committee for Hadytidology (CCH). Expert consensus on diagnosis and treatment of hepatic cystic and alveolar echinococcosis (2019 edition)[J]. Chin J Dig Surg, 2019, 18(8): 711-721. (in Chinese) |
| (中国医师协会外科医师分会包虫病外科专业委员会. 肝两型包虫病诊断与治疗专家共识(2019版)[J]. 中华消化外科杂志, 2019, 18(8): 711-721.) | |
| [6] | Li J, Peng XY, Yang HQ, et al. Study of different type of hepatic hydatid cyst internal environment[J]. J Nongken Med, 2014, 36(2): 97-100. (in Chinese) |
| (李江, 彭心宇, 杨宏强, 等. 不同分型的囊型肝包虫囊内环境的研究[J]. 农垦医学, 2014, 36(2): 97-100.) | |
| [7] | McManus DP, Zhang W, Li J, et al. Echinococcosis[J]. Lancet, 2003, 362(9392): 1295-1304. |
| [8] | WHO Informal Working Group on Echinococcosis. Guidelines for treatment of cystic and alveolar echinococcosis in humans[J]. Bull World Health Organ, 1996, 74(3): 231-242. |
| [9] | Menezes Silva A. Hydatid cyst of the liver-criteria for the selection of appropriate treatment[J]. Acta Trop, 2003, 85(2): 237-242. |
| [10] | Apaer S, Ma HZ, Li T, et al. Prognostic value of plasma IL-27 on biological viability of hepatic cystic echinococcosis[J]. Int J Infect Dis, 2021, 109: 63-71. |
| [11] | Cao Y. The imaging diagnosis of echinococcosis: recent advances[J]. J Pract Radiol, 2018, 34(9): 1461-1464. (in Chinese) |
| (曹源. 包虫病的影像学诊断进展[J]. 实用放射学杂志, 2018, 34(9): 1461-1464.) | |
| [12] | Piccoli L, Meroni V, Genco F, et al. Serum cytokine profile by ELISA in patients with echinococcal cysts of the liver: a stage-specific approach to assess their biological activity[J]. Clin Dev Immunol, 2012, 2012: 483935. |
| [13] | Ciftci TT, Yabanoglu-Ciftci S, Unal E, et al. Metabolomic profiling of active and inactive liver cystic echinococcosis[J]. Acta Trop, 2021, 221: 105985. |
| [14] | Conchedda M, Caddori A, Caredda A, et al. Degree of calcification and cyst activity in hepatic cystic echinococcosis in humans[J]. Acta Trop, 2018, 182: 135-143. |
| [15] | Yasen A, Li WD, Aini A, et al. Th1/Th2/Th17 cytokine profile in hepatic cystic Echinococcosis patients with different cyst stages[J]. Parasite Immunol, 2021, 43(7): e12839. |
| [16] | Gillies RJ, Kinahan PE, Hricak H. Radiomics: images are more than pictures, they are data[J]. Radiology, 2016, 278(2): 563-577. |
| [17] | Polidori T, de Santis D, Rucci C, et al. Radiomics applications in cardiac imaging: a comprehensive review[J]. Radiol Med, 2023, 128(8): 922-933. |
| [18] | Fan M, Wang KL, Pan D, et al. Radiomic analysis reveals diverse prognostic and molecular insights into the response of breast cancer to neoadjuvant chemotherapy: a multicohort study[J]. J Transl Med, 2024, 22(1): 637. |
| [19] | Chen M, Copley SJ, Viola P, et al. Radiomics and artificial intelligence for precision medicine in lung cancer treatment[J]. Semin Cancer Biol, 2023, 93: 97-113. |
| [20] | Kang WD, Qiu X, Luo YG, et al. Application of radiomics-based multiomics combinations in the tumor microenvironment and cancer prognosis[J]. J Transl Med, 2023, 21(1): 598. |
| [21] | Xu WY, Zhang TL, Xia YW, et al. Predicting the surrounding zone of hepatic alveolar echinococcosis based on CT machine learning[J]. Chin Comput Med Imag, 2022, 28(3): 286-290. (in Chinese) |
| (许文瑶, 张铁亮, 夏雨薇, 等. 基于CT影像的机器学习模型术前预测肝脏泡型包虫病边缘带浸润[J]. 中国医学计算机成像杂志, 2022, 28(3): 286-290.) | |
| [22] | Yu YH, Liu WY, Zhao Y, et al. The value of CT imaging in distinguishing pulmonary cystic echinococcosis from pulmonary abscess[J]. J Clin Radiol, 2022, 41(11): 2041-2045. (in Chinese) |
| (郁耀辉, 刘文亚, 赵圆, 等. CT影像组学鉴别肺囊性包虫病与肺脓肿的价值[J]. 临床放射学杂志, 2022, 41(11): 2041-2045.) | |
| [23] | Hou J, Wen H, Wang MK, et al. Analysis of the influencing factors of lesion activity in hepatic cystic echinococcosis patients[J]. Chin J Parasitol Parasit Dis, 2022, 40(3): 309-315. (in Chinese) |
| (侯娇, 温浩, 王明坤, 等. 肝细粒棘球蚴病手术患者病灶活性状态的影响因素分析[J]. 中国寄生虫学与寄生虫病杂志, 2022, 40(3): 309-315.) | |
| [24] | Hosmer Jr DW, Lemeshow S, Sturdivant RX. Applied logistic regression[M]. Hoboken: John Wiley & Sons, 2013: 1-35. |
| [25] | Scholkopf B, Smola AJ. Learning with kernels: support vector machines, regularization, optimization, and beyond[J]. IEEE Trans Neural Netw, 2005, 16(3): 781. |
| [26] | Cover T, Hart P. Nearest neighbor pattern classification[J]. IEEE Trans Inf Theory, 1967, 13(1): 21-27. |
| [27] | Breiman L. Random forests[J]. Mach Learn, 2001, 45(1): 5-32. |
| [28] | Ogunleye A, Wang QG. XGBoost model for chronic kidney disease diagnosis[J]. IEEE/ACM Trans Comput Biol Bioinform, 2020, 17(6): 2131-2140. |
| [29] | GuolinKe QM, Finley T, Wang T, et al. Lightgbm: a highly efficient gradient boosting decision tree[C]. Cambridge: Adv Neural Inf Process Syst, 2017: 1-9. |
| [30] | Geurts P, Ernst D, Wehenkel L. Extremely randomized trees[J]. Mach Learn, 2006, 63(1): 3-42. |
| [31] | Pakala T, Molina M, Wu GY. Hepatic echinococcal cysts: a review[J]. J Clin Transl Hepatol, 2016, 4(1): 39-46. |
| [32] | Wen H, Xu MQ. Practical echinococcosis[M]. Beijing: Science Press, 2007: 76-154. (in Chinese) |
| (温浩, 徐明谦. 实用包虫病学[M]. 北京: 科学出版社, 2007: 76-154.) | |
| [33] | Shi R, Qiao F, Song J, et al. The value of MR IVIM-DWI in predicting the biological activity of hepatic cystic echinococcosis[J]. J Pract Radiol, 2020, 36(5): 826-830. (in Chinese) |
| (石睿, 乔飞, 宋娟, 等. 磁共振体素内不相干运动扩散加权成像预测囊性肝包虫生物学活性的价值[J]. 实用放射学杂志, 2020, 36(5): 826-830.) | |
| [34] | Li T, Bao HH. Evaluation of computer tomography and magnetic resonance imaging in the classification and viability of hepatic cystic echinococcosis[J]. Chin J Magn Reson Imag, 2021, 12(5): 25-29. (in Chinese) |
| (李婷, 鲍海华. CT和MRI对肝囊型包虫病分型与活性的评价[J]. 磁共振成像, 2021, 12(5): 25-29.) | |
| [35] | Bhutani N, Kajal P. Hepatic echinococcosis: a review[J]. Ann Med Surg, 2018, 36: 99-105. |
| [36] | Joliat GR, Melloul E, Petermann D, et al. Outcomes after liver resection for hepatic alveolar echinococcosis: a single-center cohort study[J]. World J Surg, 2015, 39(10): 2529-2534. |
| [37] | Balli O, Balli G, Cakir V, et al. Percutaneous treatment of giant cystic echinococcosis in liver: catheterization technique in patients with CE1 and CE3a[J]. Cardiovasc Intervent Radiol, 2019, 42(8): 1153-1159. |
| [38] | Cheng XY, Feng ZC, Pan BY, et al. Establishment and application of the BRP prognosis model for idiopathic pulmonary fibrosis[J]. J Transl Med, 2023, 21(1): 805. |
| [39] | He JX, Wang B, Tao JS, et al. Accurate classification of pulmonary nodules by a combined model of clinical, imaging, and cell-free DNA methylation biomarkers: a model development and external validation study[J]. Lancet Digit Health, 2023, 5(10): e647-e656. |
| [40] | Zhu ZC, Chen MJ, Hu G, et al. A pre-treatment CT-based weighted radiomic approach combined with clinical characteristics to predict durable clinical benefits of immunotherapy in advanced lung cancer[J]. Eur Radiol, 2023, 33(6): 3918-3930. |
/
| 〈 |
|
〉 |