论著

基于影像组学及临床特征的机器学习模型鉴别肝细粒棘球蚴病病灶活性的研究

  • 汪占金 ,
  • 陈志恒 ,
  • 李富源 ,
  • 蔡俊杰 ,
  • 薛张佗 ,
  • 周瀛 ,
  • 曹云太 ,
  • 王展
展开
  • 1 青海大学临床医学院,青海 西宁 810000
    2 青海大学附属医院肝胆胰二科,青海 西宁 810000
    3 青海大学附属医院影像中心,青海 西宁 810000
    4 青海大学附属医院医工结合与转化应用部,青海 西宁 810000
汪占金(1999—),男,硕士研究生,从事棘球蚴病人工智能诊治研究。E-mail:18197256027@163.com

收稿日期: 2024-05-16

  修回日期: 2024-09-04

  网络出版日期: 2024-10-24

基金资助

国家自然科学基金(82160131);青海省科技厅青年基金(2021-ZJ-963Q)

Identification of lesion activities in haptic cystic echinococcosis using machine learning model based on radiomics and clinical features

  • WANG Zhanjin ,
  • CHEN Zhiheng ,
  • LI Fuyuan ,
  • CAI Junjie ,
  • XUE Zhangtuo ,
  • ZHOU Ying ,
  • CAO Yuntai ,
  • WANG Zhan
Expand
  • 1 Clinical Medical School, Qinghai University, Xining 810000, Qinghai, China
    2 Department of Hepatobiliary and Pancreatic Surgery, Qinghai University Affiliated Hospital, Xining 810000, Qinghai, China
    3 Imaging Center, Qinghai University Affiliated Hospital, Xining 810000, Qinghai, China
    4 Department of Medical Engineering and Translational Applications, Qinghai University Affiliated Hospital, Xining 810000, Qinghai, China

Received date: 2024-05-16

  Revised date: 2024-09-04

  Online published: 2024-10-24

Supported by

National Natural Science Foundation of China(82160131);Qinghai Provincial Department of Science and Technology(2021-ZJ-963Q)

摘要

目的 开发影像组学和临床特征的机器学习模型,以精准鉴别肝细粒棘球蚴病(HCE)病灶的生物活性。 方法 收集2018—2022年就诊于青海大学附属医院肝胆胰外科的521例HCE患者和就诊于果洛州人民医院普外科和玉树州人民医院普外科的236例HCE患者的CT图像及临床资料,提取影像特征并进行筛选。对临床资料采用单因素及多因素Logistic回归分析,筛选构建模型的特征。采用Logistic回归(LR)、支持向量机(SVM)、K-近邻算法(KNN)、随机森林(RandomForest)、极限梯度提升(XGBoost)、轻量级梯度提升机(LightGBM)、极端随机树(ExtraTrees)等7种机器学习算法构建影像组学模型和临床模型,结合影像组学模型和临床模型的预测结果,基于软投票法构建联合模型,采用Delong检验比较影像组学模型、临床模型和临床-影像联合模型的性能,并通过外部验证评估模型性能。 结果 共430例患者被纳入进行模型开发训练,171例患者作为外部验证,筛选出51个影像特征及5个临床特征用于构建模型。7种机器学习模型中,以XGBoost算法性能表现最佳,其构建的临床模型在训练集和外部验证集上的AUC值均最大,分别为0.977[95%置信区间(95% CI):0.964~0.990]和0.839(95% CI:0.776~0.901);其构建的影像组学模型AUC值均最大,分别为0.998(95% CI:0.997~1.000和0.874(95% CI:0.822~0.927);其构建的联合模型AUC值均最大,分别为1.000(95% CI:0.999~1.000)和0.931(95% CI:0.894~0.968)。DeLong检验结果表明,联合模型在训练集上的性能优于临床模型(Z = 2.154,P < 0.05),与影像组学模型差异无统计学意义(Z = 0.562,P > 0.05);在外部验证集上的性能优于临床模型和影像组学模型(Z = 3.338、3.331,P < 0.05)。校准曲线和决策分析(DCA)曲线表明,联合模型在训练集和外部验证集的校准性能最佳、净收益最高,在不同数据集上性能稳定,在外部验证中展现了良好的泛化能力和可靠性。 结论 基于影像组学以及临床数据开发的机器学习模型能够精准鉴别肝细粒棘球蚴病病灶的生物活性,联合模型具更高的诊断精度和临床应用潜力,可为HCE患者的治疗方案提供参考。

本文引用格式

汪占金 , 陈志恒 , 李富源 , 蔡俊杰 , 薛张佗 , 周瀛 , 曹云太 , 王展 . 基于影像组学及临床特征的机器学习模型鉴别肝细粒棘球蚴病病灶活性的研究[J]. 中国寄生虫学与寄生虫病杂志, 2024 , 42(5) : 582 -593 . DOI: 10.12140/j.issn.1000-7423.2024.05.004

Abstract

Objective To develop machine learning models utilizing radiomic and clinical features to precisely identify the biological activity of haptic cystic echinococcosis (HCE). Methods The CT images and clinical data of 521 HCE patients treated at the Hepatobiliary and Pancreatic Surgery Department of Qinghai University Affiliated Hospital, along with 236 HCE patients treated at the General Surgery Departments of Guoluo Prefectural People’s Hospital and Yushu Prefectural People’s Hospital in 2018-2022, were collected. Radiomics features were extracted and screened accordingly. Univariate and multivariate logistic regression analyses were performed on the clinical data to select features for model construction. To construct radiomics and clinical models, seven machine learning algorithms were employed including Logistic Regression (LR), Support Vector Machine (SVM), K-Nearest Neighbors (KNN), Random Forest (RandomForest), Extreme Gradient Boosting (XGBoost), Light Gradient Boosting Machine (LightGBM), and Extra Trees. A clinical-image combined model was constructed based on the prediction from radiomics model combining clinical model, using soft voting method. DeLong’s test was used to compare the performances of the radiomics model, clinical model, and combined clinical-imaging model. In addition, external validation was utilized to assess the model’s performance. Results A total of 430 patients were included for model development and training, while 171 patients were designated for external validation. Fifty-one radiomics features and five clinical features were selected for model construction. Among the seven machine learning models, the XGBoost algorithm demonstrated the best performance, achieving area under the curve (AUC) values of 0.977 [95% confidence interval (CI): 0.964-0.990] and 0.839 (95% CI: 0.776-0.901) on the training and external validation sets, respectively. The radiomics model achieved AUC values of 0.998 (95% CI: 0.997-1.000) and 0.874 (95% CI: 0.822-0.927), while the combined model obtained AUC values of 1.000 (95% CI: 0.999-1.000) and 0.931 (95% CI: 0.894-0.968). The DeLong test results indicated that the performance of the combined model was superior to that of the clinical model in the training set (Z = 2.154, P < 0.05) and showed no statistically significant difference when compared to the radiomics model (Z = 0.562, P > 0.05); however, its performance on the external validation set was better than both the clinical and radiomics models (Z = 3.338, 3.331; P < 0.05). Calibration plots and decision curve analysis (DCA) indicated that the combined model exhibited the best calibration performance in both the training and external validation sets, yielding the highest net benefit, demonstrating consistent performance across different datasets, and displaying good generalizability and reliability in external validation. Conclusion The machine learning model, developed based on radiomic and clinical data, can precisely identify the biological activity of HCE lesions. The combined model exhibits higher diagnostic accuracy and clinical application potential, providing reference for making treatment plan for HCE patients.

参考文献

[1] Wen H, Vuitton L, Tuxun T, et al. Echinococcosis: advances in the 21st century[J]. Clin Microbiol Rev, 2019, 32(2): e00075-18.
[2] Deplazes P, Rinaldi L, Alvarez Rojas CA, et al. Global distribution of alveolar and cystic echinococcosis[J]. Adv Parasitol, 2017, 95: 315-493.
[3] Tamarozzi F, Akhan O, Cretu CM, et al. Prevalence of abdominal cystic echinococcosis in rural Bulgaria, romania, and Turkey: a cross-sectional, ultrasound-based, population study from the HERACLES project[J]. Lancet Infect Dis, 2018, 18(7): 769-778.
[4] Rinaldi F, Brunetti E, Neumayr A, et al. Cystic echinococcosis of the liver: a primer for hepatologists[J]. World J Hepatol, 2014, 6(5): 293-305.
[5] Chinese Doctor Association, Chinese College of Surgeons (CCS), Chinese Committee for Hadytidology (CCH). Expert consensus on diagnosis and treatment of hepatic cystic and alveolar echinococcosis (2019 edition)[J]. Chin J Dig Surg, 2019, 18(8): 711-721. (in Chinese)
  (中国医师协会外科医师分会包虫病外科专业委员会. 肝两型包虫病诊断与治疗专家共识(2019版)[J]. 中华消化外科杂志, 2019, 18(8): 711-721.)
[6] Li J, Peng XY, Yang HQ, et al. Study of different type of hepatic hydatid cyst internal environment[J]. J Nongken Med, 2014, 36(2): 97-100. (in Chinese)
  (李江, 彭心宇, 杨宏强, 等. 不同分型的囊型肝包虫囊内环境的研究[J]. 农垦医学, 2014, 36(2): 97-100.)
[7] McManus DP, Zhang W, Li J, et al. Echinococcosis[J]. Lancet, 2003, 362(9392): 1295-1304.
[8] WHO Informal Working Group on Echinococcosis. Guidelines for treatment of cystic and alveolar echinococcosis in humans[J]. Bull World Health Organ, 1996, 74(3): 231-242.
[9] Menezes Silva A. Hydatid cyst of the liver-criteria for the selection of appropriate treatment[J]. Acta Trop, 2003, 85(2): 237-242.
[10] Apaer S, Ma HZ, Li T, et al. Prognostic value of plasma IL-27 on biological viability of hepatic cystic echinococcosis[J]. Int J Infect Dis, 2021, 109: 63-71.
[11] Cao Y. The imaging diagnosis of echinococcosis: recent advances[J]. J Pract Radiol, 2018, 34(9): 1461-1464. (in Chinese)
  (曹源. 包虫病的影像学诊断进展[J]. 实用放射学杂志, 2018, 34(9): 1461-1464.)
[12] Piccoli L, Meroni V, Genco F, et al. Serum cytokine profile by ELISA in patients with echinococcal cysts of the liver: a stage-specific approach to assess their biological activity[J]. Clin Dev Immunol, 2012, 2012: 483935.
[13] Ciftci TT, Yabanoglu-Ciftci S, Unal E, et al. Metabolomic profiling of active and inactive liver cystic echinococcosis[J]. Acta Trop, 2021, 221: 105985.
[14] Conchedda M, Caddori A, Caredda A, et al. Degree of calcification and cyst activity in hepatic cystic echinococcosis in humans[J]. Acta Trop, 2018, 182: 135-143.
[15] Yasen A, Li WD, Aini A, et al. Th1/Th2/Th17 cytokine profile in hepatic cystic Echinococcosis patients with different cyst stages[J]. Parasite Immunol, 2021, 43(7): e12839.
[16] Gillies RJ, Kinahan PE, Hricak H. Radiomics: images are more than pictures, they are data[J]. Radiology, 2016, 278(2): 563-577.
[17] Polidori T, de Santis D, Rucci C, et al. Radiomics applications in cardiac imaging: a comprehensive review[J]. Radiol Med, 2023, 128(8): 922-933.
[18] Fan M, Wang KL, Pan D, et al. Radiomic analysis reveals diverse prognostic and molecular insights into the response of breast cancer to neoadjuvant chemotherapy: a multicohort study[J]. J Transl Med, 2024, 22(1): 637.
[19] Chen M, Copley SJ, Viola P, et al. Radiomics and artificial intelligence for precision medicine in lung cancer treatment[J]. Semin Cancer Biol, 2023, 93: 97-113.
[20] Kang WD, Qiu X, Luo YG, et al. Application of radiomics-based multiomics combinations in the tumor microenvironment and cancer prognosis[J]. J Transl Med, 2023, 21(1): 598.
[21] Xu WY, Zhang TL, Xia YW, et al. Predicting the surrounding zone of hepatic alveolar echinococcosis based on CT machine learning[J]. Chin Comput Med Imag, 2022, 28(3): 286-290. (in Chinese)
  (许文瑶, 张铁亮, 夏雨薇, 等. 基于CT影像的机器学习模型术前预测肝脏泡型包虫病边缘带浸润[J]. 中国医学计算机成像杂志, 2022, 28(3): 286-290.)
[22] Yu YH, Liu WY, Zhao Y, et al. The value of CT imaging in distinguishing pulmonary cystic echinococcosis from pulmonary abscess[J]. J Clin Radiol, 2022, 41(11): 2041-2045. (in Chinese)
  (郁耀辉, 刘文亚, 赵圆, 等. CT影像组学鉴别肺囊性包虫病与肺脓肿的价值[J]. 临床放射学杂志, 2022, 41(11): 2041-2045.)
[23] Hou J, Wen H, Wang MK, et al. Analysis of the influencing factors of lesion activity in hepatic cystic echinococcosis patients[J]. Chin J Parasitol Parasit Dis, 2022, 40(3): 309-315. (in Chinese)
  (侯娇, 温浩, 王明坤, 等. 肝细粒棘球蚴病手术患者病灶活性状态的影响因素分析[J]. 中国寄生虫学与寄生虫病杂志, 2022, 40(3): 309-315.)
[24] Hosmer Jr DW, Lemeshow S, Sturdivant RX. Applied logistic regression[M]. Hoboken: John Wiley & Sons, 2013: 1-35.
[25] Scholkopf B, Smola AJ. Learning with kernels: support vector machines, regularization, optimization, and beyond[J]. IEEE Trans Neural Netw, 2005, 16(3): 781.
[26] Cover T, Hart P. Nearest neighbor pattern classification[J]. IEEE Trans Inf Theory, 1967, 13(1): 21-27.
[27] Breiman L. Random forests[J]. Mach Learn, 2001, 45(1): 5-32.
[28] Ogunleye A, Wang QG. XGBoost model for chronic kidney disease diagnosis[J]. IEEE/ACM Trans Comput Biol Bioinform, 2020, 17(6): 2131-2140.
[29] GuolinKe QM, Finley T, Wang T, et al. Lightgbm: a highly efficient gradient boosting decision tree[C]. Cambridge: Adv Neural Inf Process Syst, 2017: 1-9.
[30] Geurts P, Ernst D, Wehenkel L. Extremely randomized trees[J]. Mach Learn, 2006, 63(1): 3-42.
[31] Pakala T, Molina M, Wu GY. Hepatic echinococcal cysts: a review[J]. J Clin Transl Hepatol, 2016, 4(1): 39-46.
[32] Wen H, Xu MQ. Practical echinococcosis[M]. Beijing: Science Press, 2007: 76-154. (in Chinese)
  (温浩, 徐明谦. 实用包虫病学[M]. 北京: 科学出版社, 2007: 76-154.)
[33] Shi R, Qiao F, Song J, et al. The value of MR IVIM-DWI in predicting the biological activity of hepatic cystic echinococcosis[J]. J Pract Radiol, 2020, 36(5): 826-830. (in Chinese)
  (石睿, 乔飞, 宋娟, 等. 磁共振体素内不相干运动扩散加权成像预测囊性肝包虫生物学活性的价值[J]. 实用放射学杂志, 2020, 36(5): 826-830.)
[34] Li T, Bao HH. Evaluation of computer tomography and magnetic resonance imaging in the classification and viability of hepatic cystic echinococcosis[J]. Chin J Magn Reson Imag, 2021, 12(5): 25-29. (in Chinese)
  (李婷, 鲍海华. CT和MRI对肝囊型包虫病分型与活性的评价[J]. 磁共振成像, 2021, 12(5): 25-29.)
[35] Bhutani N, Kajal P. Hepatic echinococcosis: a review[J]. Ann Med Surg, 2018, 36: 99-105.
[36] Joliat GR, Melloul E, Petermann D, et al. Outcomes after liver resection for hepatic alveolar echinococcosis: a single-center cohort study[J]. World J Surg, 2015, 39(10): 2529-2534.
[37] Balli O, Balli G, Cakir V, et al. Percutaneous treatment of giant cystic echinococcosis in liver: catheterization technique in patients with CE1 and CE3a[J]. Cardiovasc Intervent Radiol, 2019, 42(8): 1153-1159.
[38] Cheng XY, Feng ZC, Pan BY, et al. Establishment and application of the BRP prognosis model for idiopathic pulmonary fibrosis[J]. J Transl Med, 2023, 21(1): 805.
[39] He JX, Wang B, Tao JS, et al. Accurate classification of pulmonary nodules by a combined model of clinical, imaging, and cell-free DNA methylation biomarkers: a model development and external validation study[J]. Lancet Digit Health, 2023, 5(10): e647-e656.
[40] Zhu ZC, Chen MJ, Hu G, et al. A pre-treatment CT-based weighted radiomic approach combined with clinical characteristics to predict durable clinical benefits of immunotherapy in advanced lung cancer[J]. Eur Radiol, 2023, 33(6): 3918-3930.
文章导航

/

〈 〉