Academia.eduAcademia.edu

Outline

Title
Abstract
Results
Discussion
Conclusions
Materials and Methods
Materials
References

Building Reliable Radiomic Models Using Image Perturbation

Profile image of Xinzhi TENGXinzhi TENG

2022

https://doi.org/10.21203/RS.3.RS-1195202/V1
visibility

…

description

10 pages

link

1 file

Abstract

Radiomic model reliability is a central premise for its clinical translation. Presently, it is assessed using test-retest or external data, which, unfortunately, is often scarce in reality. Therefore, we aimed to develop a novel image perturbation-based method (IPBM) for the first of its kind toward building a reliable radiomic model. We first developed a radiomic prognostic model for head-and-neck cancer patients on a training (70%) and evaluated on a testing (30%) cohort using C-index. Subsequently, we applied the IPBM to CT images of both cohorts (Perturbed-Train and Perturbed-Test cohort) to generate 60 additional samples for both cohorts. Model reliability was assessed using intra-class correlation coefficient (ICC) to quantify consistency of the C-index among the 60 samples in the Perturbed-Train and Perturbed-Test cohorts. Besides, we re-trained the radiomic model using reliable RFs exclusively (ICC>0.75) to validate the IPBM. Results showed moderate model reliability in P...

Related papers

Development of a Model Based on Delta-Radiomic Features for the Optimization of Head and Neck Squamous Cell Carcinoma Patient Treatment
Erika Korobeinikova

Medicina

Background and Objectives: To our knowledge, this is the first study that investigated the prognostic value of radiomics features extracted from not only staging 18F-fluorodeoxyglucose positron emission tomography (FDG PET/CT) images, but also post-induction chemotherapy (ICT) PET/CT images. This study aimed to construct a training model based on radiomics features obtained from PET/CT in a cohort of patients with locally advanced head and neck squamous cell carcinoma treated with ICT, to predict locoregional recurrence, development of distant metastases, and the overall survival, and to extract the most significant radiomics features, which were included in the final model. Materials and Methods: This retrospective study analyzed data of 55 patients. All patients underwent PET/CT at the initial staging and after ICT. Along the classical set of 13 parameters, the original 52 parameters were extracted from each PET/CT study and an additional 52 parameters were generated as a differen...

View PDFchevron_right
The impact of inter-observer variation in delineation on robustness of radiomics features in non-small cell lung cancer
Tomas Kron

Scientific Reports, 2022

Artificial intelligence and radiomics have the potential to revolutionise cancer prognostication and personalised treatment. Manual outlining of the tumour volume for extraction of radiomics features (RF) is a subjective process. This study investigates robustness of RF to inter-observer variation (IOV) in contouring in lung cancer. We utilised two public imaging datasets: 'NSCLC-Radiomics' and 'NSCLC-Radiomics-Interobserver1' ('Interobserver'). For 'NSCLC-Radiomics', we created an additional set of manual contours for 92 patients, and for 'Interobserver', there were five manual and five semiautomated contours available for 20 patients. Dice coefficients (DC) were calculated for contours. 1113 RF were extracted including shape, first order and texture features. Intraclass correlation coefficient (ICC) was computed to assess robustness of RF to IOV. Cox regression analysis for overall survival (OS) was performed with a previously published radiomics signature. The median DC ranged from 0.81 ('NSCLC-Radiomics') to 0.85 ('Interobserver'-semi-automated). The median ICC for the 'NSCLC-Radiomics', 'Interobserver' (manual) and 'Interobserver' (semi-automated) were 0.90, 0.88 and 0.93 respectively. The ICC varied by feature type and was lower for first order and gray level co-occurrence matrix (GLCM) features. Shape features had a lower median ICC in the 'NSCLC-Radiomics' dataset compared to the 'Interobserver' dataset. Survival analysis showed similar separation of curves for three of four RF apart from 'original_shape_Compactness2', a feature with low ICC (0.61). The majority of RF are robust to IOV, with first order, GLCM and shape features being the least robust. Semiautomated contouring improves feature stability. Decreased robustness of a feature is significant as it may impact upon the features' prognostic capability. DC Dice coefficients DICOM Digital imaging and communications in medicine GLCM Gray level co-occurrence matrix GLDM Gray level dependence matrix GLRLM Gray level run length matrix GLSZM Gray level size zone matrix HNSCC Head and neck squamous cell carcinoma HU Hounsfield units IBSI Image biomarker standardisation initiative

View PDFchevron_right
Author Correction: Radiomics feature stability of open-source software evaluated on apparent diffusion coefficient maps in head and neck cancer
Carlos Cardenas

Scientific Reports, 2021

View PDFchevron_right
Comparison of radiomic pre-processing steps in the reproducible prediction of disease free survival across multi-scanners/centers
Johanne Hermesse

2021

Background Features reproducibility and the generalizability of the models are currently among the most important limitations when integrating radiomics into the clinics. Radiomic features are sensitive to imaging acquisition protocols, reconstruction algorithms and parameters, as well as by the different steps of the usual radiomics workflow. We propose a framework for comparing the reproducibility of different pre-processing steps in PET/CT radiomic analysis in the prediction of disease free survival (DFS) across multi-scanners/centers. Results We evaluated and compared the prediction performance of several models that differ in i) the type of intensity discretization, ii) feature selection method, iii) features type i.e, original or tumour to liver ratio radiomic features (OR or TLR). We trained our models using data from one scanner/center and tested on two external scanner/centers. Our results show that there is a low reproducibility in predictions across scanners and discretiz...

View PDFchevron_right
Relevance of apparent diffusion coefficient features for a radiomics‐based prediction of response to induction chemotherapy in sinonasal cancer
Valentina Corino

NMR in Biomedicine, 2020

In this paper, several radiomics-based predictive models of response to induction chemotherapy (IC) in sinonasal cancers (SNCs) are built and tested. Models were built as a combination of radiomic features extracted from three types of MRI images: T1-weighted images, T2-weighted images and apparent diffusion coefficient (ADC) maps. Fifty patients (aged 54 ± 12 years, 41 men) were included in this study. Patients were classified according to their response to IC (25 responders and 25 nonresponders). Not all types of images were acquired for all of the patients: 49 had T1-weighted images, 50 had T2-weighted images and 34 had ADC maps. Only in a subset of 33 patients were all three types of image acquired. Eighty-nine radiomic features were extracted from the MRI images. Dimensionality reduction was performed by using principal component analysis (PCA) and by selecting only the three main components. Different algorithms (trees ensemble, K-nearest neighbors, support vector machine, naïve Bayes) were used to classify the patients as either responders or nonresponders. Several radiomic models (either monomodality or multimodality obtained by a combination of T1-weighted, T2-weighted and ADC images) were developed and the performance was assessed through 100 iterations of train and test split. The area under the curve (AUC) of the models ranged from 0.56 to 0.78. Trees ensemble, support vector machine and naïve Bayes performed similarly, but in all cases ADC-based models performed better. Trees ensemble gave the highest AUC (0.78 for the T1-weighted+T2-weighted+ADC model) and was used for further analyses. For trees ensemble, the models based on ADC features performed better than those models that did not use those features (P < 0.02 for one-tail Hanley test, AUC range 0.68-0.78 vs 0.56-0.69) except the T1-weighted+ADC model (AUC 0.71 vs 0.69, nonsignificant differences). The results suggest the relevance of ADC-based radiomics for prediction of response to IC in SNCs.

View PDFchevron_right
Post-radiochemotherapy PET radiomics in head and neck cancer - The influence of radiomics implementation on the reproducibility of local control tumor models
Gabriela Studer

Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology, 2017

This study investigated an association of post-radiochemotherapy (RCT) PET radiomics with local tumor control in head and neck squamous cell carcinoma (HNSCC) and evaluated the models against two radiomics software implementations. 649 features, available in two radiomics implementations and based on the same definitions, were extracted from HNSCC primary tumor region in 18F-FDG PET scans 3 months post definitive RCT (training cohort n = 128, validation cohort n = 50) and compared using the intraclass correlation coefficient (ICC). Local recurrence models were trained, separately for both implementations, using principal component analysis (PCA) and the least absolute shrinkage and selection operator. The reproducibility of the concordance indexes (CI) in univariable Cox regression for features preselected in PCA and the final multivariable models was investigated using respective features from the other implementation. Only 80 PET radiomic features yielded ICC &gt; 0.8 in the compa...

View PDFchevron_right
Utility of adding Radiomics to clinical features in predicting the outcomes of radiotherapy for head and neck cancer using machine learning
Tarun Gangil

PLOS ONE, 2022

Background Radiomics involves the extraction of quantitative information from annotated Computed-Tomography (CT) images, and has been used to predict outcomes in Head and Neck Squamous Cell Carcinoma (HNSCC). Subjecting combined Radiomics and Clinical features to Machine Learning (ML) could offer better predictions of clinical outcomes. This study is a comparative performance analysis of ML models with Clinical, Radiomics, and Clinico-Radiomic datasets for predicting four outcomes of HNSCC treated with Curative Radiation Therapy

View PDFchevron_right
Reproducibility and Prognosis of Quantitative Features Extracted from CT Images
virendra kumar

2014

We study the reproducibility of quantitative imaging features that are used to describe tumor shape, size, and texture from computed tomography (CT) scans of non-small cell lung cancer (NSCLC). CT images are dependent on various scanning factors. We focus on characterizing image features that are reproducible in the presence of variations due to patient factors and segmentation methods. Thirty-two NSCLC nonenhanced lung CT scans were obtained from the Reference Image Database to Evaluate Response data set. The tumors were segmented using both manual (radiologist expert) and ensemble (software-automated) methods. A set of features (219 threedimensional and 110 two-dimensional) was computed, and quantitative image features were statistically filtered to identify a subset of reproducible and nonredundant features. The variability in the repeated experiment was measured by the test-retest concordance correlation coefficient (CCC TreT). The natural range in the features, normalized to variance, was measured by the dynamic range (DR). In this study, there were 29 features across segmentation methods found with CCC TreT and DR ≥ 0.9 and R 2 Bet ≥ 0.95. These reproducible features were tested for predicting radiologist prognostic score; some texture features (run-length and Laws kernels) had an area under the curve of 0.9. The representative features were tested for their prognostic capabilities using an independent NSCLC data set (59 lung adenocarcinomas), where one of the texture features, run-length gray-level nonuniformity, was statistically significant in separating the samples into survival groups (P ≤ .046).

View PDFchevron_right
Delta-radiomics increases multicentre reproducibility: a phantom study
Luigi Pirtoli

Medical Oncology, 2020

Texture analysis (TA) can provide quantitative features from medical imaging that can be correlated to clinical endpoints. The challenges relevant to robustness of radiomics features have been analyzed by many researchers, as it seems to be influenced by acquisition and reconstruction protocols. Delta-texture analysis (D-TA), conversely, consist in the analysis of TA feature variations at different acquisition times, usually before and after a therapy. Aim of this study was to investigate the influence of different CT scanners and acquisition parameters in the robustness of TA and D-TA. We scanned a commercial phantom (CIRS model 467, Gammex, Middleton, WI, USA), that is used for the calibration of electron density, two times by varying the disposition of plugs, using three different scanners. After the segmentation, we extracted TA features with LifeX and calculated TA features and D-TA features, defined as the variation of each TA parameters extracted from the same position by varying the plugs with the formula (Y-X)/X. The robustness of TA and D-TA features were then tested with intraclass coefficient correlation (ICC) analysis. The reliability of TA parameters across different scans, with different acquisition parameters and ROI positions has shown poor reliability in 12/37 and moderate reliability in the remaining 25/37, with no parameters showing good reliability. The reliability of D-TA, conversely, showed poor reliability in 10/37 parameters, moderate reliability in 10/37 parameters, and good reliability in 17/37 parameters. The comparison between TA and D-TA ICCs showed a significant difference for the whole group of parameters (p:0.004) and for the subclasses of GLCM parameters (p:0.033), whereas for the other subclasses of matrices (GLRLM, NGLDM, GLZLM, Histogram), the difference was not significant. D-TA features seem to be more robust than TA features. These findings reinforce the potentiality for using D-TA features for early assessment of treatment response and for developing tailored therapies. More work is needed in a clinical setting to confirm the results of the present study.

View PDFchevron_right
Application and limitation of radiomics approach to prognostic prediction for lung stereotactic body radiotherapy using breath‐hold CT images with random survival forest: A multi‐institutional study
Shuji Otsu

Medical Physics, 2020

Purpose: To predict local recurrence (LR) and distant metastasis (DM) in early-stage non-small-cell lung cancer (NSCLC) patients after stereotactic body radiotherapy (SBRT) in multiple institutions using breath-hold CT-based radiomic features with random survival forest. Methods: A total of 573 primary early-stage NSCLC patients who underwent SBRT between January 2006 and March 2016 and met the eligibility criteria were included in this study. Patients were divided into two datasets: training (464 patients in ten institutions) and test (109 patients in one institution) dataset. A total of 944 radiomic features were extracted from manually segmented gross tumor volumes (GTVs). Feature selection was performed by analyzing inter-segmentation reproducibility, GTV correlation, and inter-feature redundancy. Nine clinical factors, including histology and GTV size, were also used. Three prognostic models (clinical, radiomic, and combined) for LR and DM were constructed using random survival forest (RSF) to deal with total death as a competing risk in the training dataset. Robust models with optimal hyper-parameters were determined using 5-fold cross validation. The patients were dichotomized into two groups based on the median value of the patient-specific risk scores (high-and low-risk score groups). Gray's test was used to evaluate the statistical significance between the two risk score groups. The prognostic power was evaluated by the C-index with the 95% confidence intervals (CI) Accepted Article This article is protected by copyright. All rights reserved via bootstrapping (2,000 iterations). Results: The concordance indices at 3 years of clinical, radiomic, and combined models for LR were 0.57

View PDFchevron_right

References (51)

  1. Aerts, H. J. W. L. et al. Decoding tumour phenotype by noninvasive imaging using a quantitative radiomics approach. Nat. Com- mun. 5, 4006 (2014).
  2. Lambin, P. et al. Radiomics: The bridge between medical imaging and personalized medicine. Nat. Rev. Clin. Oncol. 14, 749-762 (2017).
  3. Gillies, R. J., Kinahan, P. E. & Hricak, H. Radiomics: Images are more than pictures, they are data. Radiology 278, 563-577 (2015).
  4. Fan, M. et al. Radiomic analysis of imaging heterogeneity in tumours and the surrounding parenchyma based on unsupervised decomposition of DCE-MRI for predicting molecular subtypes of breast cancer. Eur. Radiol. 29, 4456-4467 (2019).
  5. Bian, Y. et al. CT-based radiomics score for distinguishing between grade 1 and grade 2 nonfunctioning pancreatic neuroendocrine tumors. Am. J. Roentgenol. 215, 852-863 (2020).
  6. Coroller, T. P. et al. CT-based radiomic signature predicts distant metastasis in lung adenocarcinoma. Radiother. Oncol. 114, 345-350 (2015).
  7. Guerrisi, A. et al. Novel cancer therapies for advanced cutaneous melanoma: The added value of radiomics in the decision making process-A systematic review. Cancer Med. 9, 1603-1612 (2020).
  8. Zhao, B. Understanding sources of variation to improve the reproducibility of radiomics. Front. Oncol. 11, 826 (2021).
  9. Ibrahim, A. et al. Radiomics for precision medicine: Current challenges, future prospects, and the proposal of a new framework. Methods 188, 20-29 (2021).
  10. Lafata, K. et al. Spatial-temporal variability of radiomic features and its effect on the classification of lung cancer histology. Phys. Med. Biol. 63, 225003 (2018).
  11. Blazis, S. P., Dickerscheid, D. B. M., Linsen, P. V. M. & Martins Jarnalo, C. O. Effect of CT reconstruction settings on the perfor- mance of a deep learning based lung nodule CAD system. Eur. J. Radiol. 136, 109526 (2021).
  12. Zwanenburg, A. et al. Assessing robustness of radiomic features by image perturbation. Sci. Rep. 9, 614 (2019).
  13. Suter, Y. et al. Radiomics for glioblastoma survival analysis in pre-operative MRI: Exploring feature robustness, class boundaries, and machine learning techniques. Cancer Imaging 20, 55 (2020).
  14. Vallières, M. et al. Data from head-neck-PET-CT. Cancer Imaging Arch. https:// doi. org/ 10. 7937/ K9/ TCIA. 2017. 8OJE5 Q00 (2017).
  15. Reiazi, R. et al. The impact of the variation of imaging parameters on the robustness of Computed Tomography radiomic features: A review. Comput. Biol. Med. 133, 104400 (2021).
  16. Orlhac, F. et al. How can we combat multicenter variability in MR radiomics? Validation of a correction procedure. Eur. Radiol. 31, 2272-2280 (2021).
  17. Foy, J. J. et al. Harmonization of radiomic feature variability resulting from differences in CT image acquisition and reconstruction: Assessment in a cadaveric liver. Phys. Med. Biol. 65, 205008 (2020).
  18. Ligero, M. et al. Minimizing acquisition-related radiomics variability by image resampling and batch effect correction to allow for large-scale data analysis. Eur. Radiol. 31, 1460-1470 (2021).
  19. Li, Y., Ammari, S., Balleyguier, C., Lassau, N. & Chouzenoux, E. Impact of preprocessing and harmonization methods on the removal of scanner effects in brain MRI radiomic features. Cancers 13, 3000 (2021).
  20. Zhao, B. et al. Evaluating variability in tumor measurements from same-day repeat CT scans of patients with non-small cell lung cancer. Radiology 252, 263-272 (2009).
  21. van Timmeren, J. E. et al. Test-retest data for radiomics feature stability analysis: Generalizable or study-specific?. Tomography 2, 361-365 (2016).
  22. Collins, G. S., Reitsma, J. B., Altman, D. G. & Moons, K. G. M. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): The TRIPOD Statement. BMC Med. 13, 1 (2015).
  23. Clark, K. et al. The cancer imaging archive (TCIA): Maintaining and operating a public information repository. J. Digit. Imaging 26, 1045-1057 (2013).
  24. Fh, T., Cyw, C. & Eyw, C. Radiomics AI prediction for head and neck squamous cell carcinoma (HNSCC) prognosis and recurrence with target volume approach. BJR Open 3, 20200073 (2021).
  25. Vallières, M. et al. Radiomics strategies for risk assessment of tumour failure in head-and-neck cancer. Sci. Rep. 7, 10117 (2017).
  26. Bogowicz, M. et al. Perfusion CT radiomics as potential prognostic biomarker in head and neck squamous cell carcinoma. Acta Oncol. 58, 1514-1518 (2019).
  27. Lombardo, E. et al. Distant metastasis time to event analysis with CNNs in independent head and neck cancer cohorts. Sci. Rep. 11, 6418 (2021).
  28. Diamant, A., Chatterjee, A., Vallières, M., Shenouda, G. & Seuntjens, J. Deep learning in head & neck cancer outcome prediction. Sci. Rep. 9, 2764 (2019).
  29. Moradmand, H., Aghamiri, S. M. R. & Ghaderi, R. Impact of image preprocessing methods on reproducibility of radiomic features in multimodal magnetic resonance imaging in glioblastoma. J. Appl. Clin. Med. Phys. 21, 179-190 (2020).
  30. Fave, X. et al. Impact of image preprocessing on the volume dependence and prognostic potential of radiomics features in non- small cell lung cancer. Transl. Cancer Res. 5, 349-363 (2016).
  31. Shafiq-ul-Hassan, M. et al. Intrinsic dependencies of CT radiomic features on voxel size and number of gray levels. Med. Phys. 44, 1050-1062 (2017).
  32. Yaniv, Z., Lowekamp, B. C., Johnson, H. J. & Beare, R. SimpleITK image-analysis notebooks: A collaborative environment for education and reproducible research. J. Digit Imaging 31, 290-303 (2018).
  33. Bradski, G. The OpenCV Library. Dr. Dobb's http:// www. drdob bs. com/ open-source/ the-opencv-libra ry/ 18440 4319 34.
  34. van Griethuysen, J. J. M. et al. Computational radiomics system to decode the radiographic phenotype. Cancer Res. 77, e104-e107 (2017).
  35. Fornacon-Wood, I. et al. Reliability and prognostic value of radiomic features are highly dependent on choice of feature extraction platform. Eur. Radiol. 30, 6241-6250 (2020).
  36. Zwanenburg, A. et al. The image biomarker standardization initiative: Standardized quantitative radiomics for high-throughput image-based phenotyping. Radiology 295, 328-338 (2020).
  37. Cai, J. et al. A radiomics model for predicting the response to bevacizumab in brain necrosis after radiotherapy. Clin. Cancer Res. 26, 5438-5447 (2020).
  38. Yu, L. & Liu, H. Feature selection for high-dimensional data: A fast correlation-based filter solution. 8.
  39. Parmar, C., Grossmann, P., Bussink, J., Lambin, P. & Aerts, H. J. W. L. Machine learning methods for quantitative radiomic bio- markers. Sci. Rep. 5, 13087 (2015).
  40. Lemaître, G., Nogueira, F. & Aridas, C. K. Imbalanced-learn: A python toolbox to tackle the curse of imbalanced datasets in machine learning. J. Mach. Learn. Res. 18, 1-5 (2017).
  41. Dirand, A.-S., Frouin, F. & Buvat, I. A downsampling strategy to assess the predictive value of radiomic features. Sci. Rep. 9, 17869 (2019).
  42. Qiu, Q. et al. Reproducibility and non-redundancy of radiomic features extracted from arterial phase CT scans in hepatocellular carcinoma patients: Impact of tumor segmentation variability. Quant. Imaging Med. Surg. 9, 453-464 (2019).
  43. Appice, A., Ceci, M., Rawles, S. & Flach, P. Redundant feature elimination for multi-class problems. in Twenty-First International Conference on Machine Learning: ICML '04 5 (ACM Press, 2004). https:// doi. org/ 10. 1145/ 10153 30. 10153 97
  44. Zhang, X. et al. Radiomics assessment of bladder cancer grade using texture features from diffusion-weighted imaging. J. Magn. Reson. Imaging 46, 1281-1288 (2017).
  45. Mottola, M. et al. Reproducibility of CT-based radiomic features against image resampling and perturbations for tumour and healthy kidney in renal cancer patients. Sci. Rep. 11, 11542 (2021).
  46. Rizzo, S. et al. Radiomics: The facts and the challenges of image analysis. Eur. Radiol. Exp. 2, 36 (2018).
  47. Pavic, M. et al. Influence of inter-observer delineation variability on radiomics stability in different tumor sites. Acta Oncol. 57, 1070-1074 (2018).
  48. Koo, T. K. & Li, M. Y. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J. Chiropr. Med. 15, 155-163 (2016).
  49. Lee, J. et al. Radiomics feature robustness as measured using an MRI phantom. Sci. Rep. 11, 3973 (2021).
  50. Park, S.-H. et al. Robustness of magnetic resonance radiomic features to pixel size resampling and interpolation in patients with cervical cancer. Cancer Imaging 21, 19 (2021).
  51. Vol:.(1234567890) Scientific Reports | (2022) 12:10035 | https://doi.org/10.1038/s41598-022-14178-x

Related papers

Improving radiomic model reliability using robust features from perturbations for head-and-neck carcinoma
Xinzhi TENG

Frontiers in Oncology

BackgroundUsing high robust radiomic features in modeling is recommended, yet its impact on radiomic model is unclear. This study evaluated the radiomic model’s robustness and generalizability after screening out low-robust features before radiomic modeling. The results were validated with four datasets and two clinically relevant tasks.Materials and methodsA total of 1,419 head-and-neck cancer patients’ computed tomography images, gross tumor volume segmentation, and clinically relevant outcomes (distant metastasis and local-regional recurrence) were collected from four publicly available datasets. The perturbation method was implemented to simulate images, and the radiomic feature robustness was quantified using intra-class correlation of coefficient (ICC). Three radiomic models were built using all features (ICC &gt; 0), good-robust features (ICC &gt; 0.75), and excellent-robust features (ICC &gt; 0.95), respectively. A filter-based feature selection and Ridge classification meth...

View PDFchevron_right
Radiomics feature stability of open-source software evaluated on apparent diffusion coefficient maps in head and neck cancer
Tomas Kron

Scientific Reports, 2021

Radiomics is a promising technique for discovering image based biomarkers of therapy response in cancer. Reproducibility of radiomics features is a known issue that is addressed by the image biomarker standardisation initiative (IBSI), but it remains challenging to interpret previously published radiomics signatures. This study investigates the reproducibility of radiomics features calculated with two widely used radiomics software packages (IBEX, MaZda) in comparison to an IBSI compliant software package (PyRadiomics). Intensity histogram, shape and textural features were extracted from 334 diffusion weighted magnetic resonance images of 59 head and neck cancer (HNC) patients from the PREDICT-HN observational radiotherapy study. Based on name and linear correlation, PyRadiomics shares 83 features with IBEX and 49 features with MaZda, a sub-set of well correlated features are considered reproducible (IBEX: 15 features, MaZda: 18 features). We explore the impact of including non-reproducible radiomics features in a HNC radiotherapy response model. It is possible to classify equivalent patient groups using radiomic features from either software, but only when restricting the model to reliable features using a correlation threshold method. This is relevant for clinical biomarker validation trials as it provides a framework to assess the reproducibility of reported radiomic signatures from existing trials. Extracting textural features from medical images provides additional information 1 to capture changes in tumour heterogeneity that may complement existing shape based metrics 2 . Radiomics 3,4 is the high-throughput extraction of image features from standard-of-care medical images, with the hypothesis that macroscopic image features offer insight into disease process at a molecular level 5 . Radiomics analysis has been widely adopted in oncology research, showing potential to identify magnetic resonance image (MRI) based biomarkers for clinical outcomes in head and neck cancers (HNC) 6 . The evolution of radiomics features during treatment, commonly referred to as delta-radiomics, may offer more information than a single time point to identify biomarkers during radiotherapy or chemotherapy and has been explored in HNC with CT imaging 7-10 , positron emission tomography (PET) imaging 11 and more recently in MRI studies . A review of head and neck cancer studies 6 details the investigation of MRI radiomics features for applications such as image segmentation, histopathological classification and prognostic or predictive biomarkers. Previous HNC studies explore a range of MRI sequences, from anatomical imaging such as T1 weighted, T2 weighted and short tau inversion recovery (STIR) to functional imaging such as diffusion weighted (DW-MRI) and dynamic

View PDFchevron_right
Assessing robustness of radiomic features by image perturbation
Steffen Löck

Scientific Reports

Image features need to be robust against differences in positioning, acquisition and segmentation to ensure reproducibility. Radiomic models that only include robust features can be used to analyse new images, whereas models with non-robust features may fail to predict the outcome of interest accurately. Test-retest imaging is recommended to assess robustness, but may not be available for the phenotype of interest. We therefore investigated 18 combinations of image perturbations to determine feature robustness, based on noise addition (N), translation (T), rotation (R), volume growth/ shrinkage (V) and supervoxel-based contour randomisation (C). Test-retest and perturbation robustness were compared for combined total of 4032 morphological, statistical and texture features that were computed from the gross tumour volume in two cohorts with computed tomography imaging: I) 31 non-small-cell lung cancer (NSCLC) patients; II): 19 head-and-neck squamous cell carcinoma (HNSCC) patients. Robustness was determined using the 95% confidence interval (CI) of the intraclass correlation coefficient (1, 1). Features with CI ≥ 0:90 were considered robust. The NTCV, TCV, RNCV and RCV perturbation chain produced similar results and identified the fewest false positive robust features (NSCLC: 0.2-0.9%; HNSCC: 1.7-1.9%). Thus, these perturbation chains may be used as an alternative to test-retest imaging to assess feature robustness. Radiomics is the high-throughput quantitative analysis of medical imaging to facilitate model-based treatment decisions 1,2. A prevalent approach relies on the computation of image biomarkers (features) within a region of interest (ROI). In this approach features quantify different aspects of the ROI, such as mean intensity, volume and texture heterogeneity. Variations in patient positioning, image acquisition and segmentation affect each feature to varying degrees 3,4. If radiomic models use features that are not robust against such influences, they will perform poorly when applied to new data 5. Assessing feature robustness is thus recommended to improve generalisability of radiomic models. Non-robust image features are commonly identified using test-retest imaging 6-10. In test-retest imaging, the same region of interest is imaged twice within a time interval of minutes to days, usually with the same acquisition protocol. Consequently, these two images are similar, but not identical, which allows the identification of non-robust features. After identification, non-robust features are excluded from further analysis. Although the identification of robust features is important, implementing test-retest imaging for every radiomic study has been difficult to achieve for several reasons. First, feature robustness is dependent on the phenotype of interest as well as the imaging modality. This means that information concerning feature robustness cannot be transferred between studies on different phenotypes 11 and modalities 7. Furthermore, feature values depend on multiple factors, including the voxel size and discretisation used 12-14. Thus, even if a previous study determined feature robustness for a particular phenotype and modality, the results may not be transferable due to the use of different computational settings. Second, test-retest imaging may be difficult to obtain generally, as it is not part of the clinical routine. Acquiring test-retest imaging would thus require additional resources in terms of personnel and imaging time, and, potentially, an increased patient radiation dose. An alternative would be to use the appropriate publicly available test-retest data set, but such data are likewise sparse.

View PDFchevron_right
Radiomics in Head and Neck Cancer Outcome Predictions
Victor Alves

Diagnostics

Head and neck cancer has great regional anatomical complexity, as it can develop in different structures, exhibiting diverse tumour manifestations and high intratumoural heterogeneity, which is highly related to resistance to treatment, progression, the appearance of metastases, and tumour recurrences. Radiomics has the potential to address these obstacles by extracting quantitative, measurable, and extractable features from the region of interest in medical images. Medical imaging is a common source of information in clinical practice, presenting a potential alternative to biopsy, as it allows the extraction of a large number of features that, although not visible to the naked eye, may be relevant for tumour characterisation. Taking advantage of machine learning techniques, the set of features extracted when associated with biological parameters can be used for diagnosis, prognosis, and predictive accuracy valuable for clinical decision-making. Therefore, the main goal of this cont...

View PDFchevron_right
Repeatability and reproducibility study of radiomic features on a phantom and human cohort
Sneha Mithun, Ashish Jha

Nature Scientific Reports, 2021

The repeatability and reproducibility of radiomic features extracted from CT scans need to be investigated to evaluate the temporal stability of imaging features with respect to a controlled scenario (test–retest), as well as their dependence on acquisition parameters such as slice thickness, or tube current. Only robust and stable features should be used in prognostication/prediction models to improve generalizability across multiple institutions. In this study, we investigated the repeatability and reproducibility of radiomic features with respect to three different scanners, variable slice thickness, tube current, and use of intravenous (IV) contrast medium, combining phantom studies and human subjects with non-small cell lung cancer. In all, half of the radiomic features showed good repeatability (ICC > 0.9) independent of scanner model. Within acquisition protocols, changes in slice thickness was associated with poorer reproducibility compared to the use of IV contrast. Broad feature classes exhibit different behaviors, with only few features appearing to be the most stable. 108 features presented both good repeatability and reproducibility in all the experiments, most of them being wavelet and Laplacian of Gaussian features.

View PDFchevron_right
580 California St., Suite 400
San Francisco, CA, 94104
© 2025 Academia. All rights reserved