Skip to main content
Advertisement

Main menu

  • Home
  • Content
    • Current Issue
    • Accepted Manuscripts
    • Article Preview
    • Past Issue Archive
    • AJNR Case Collection
    • Case of the Week Archive
    • Classic Case Archive
    • Case of the Month Archive
  • Special Collections
    • Spinal CSF Leak Articles (Jan 2020-June 2024)
    • 2024 AJNR Journal Awards
    • Most Impactful AJNR Articles
  • Multimedia
    • AJNR Podcast
    • AJNR Scantastics
    • Video Articles
  • For Authors
    • Submit a Manuscript
    • Author Policies
    • Fast publishing of Accepted Manuscripts
    • Graphical Abstract Preparation
    • Manuscript Submission Guidelines
    • Imaging Protocol Submission
    • Submit a Case for the Case Collection
  • About Us
    • About AJNR
    • Editorial Board
  • More
    • Become a Reviewer/Academy of Reviewers
    • Subscribers
    • Permissions
    • Alerts
    • Feedback
    • Advertisers
    • ASNR Home
  • Other Publications
    • ajnr

User menu

  • Alerts
  • Log in

Search

  • Advanced search
American Journal of Neuroradiology
American Journal of Neuroradiology

American Journal of Neuroradiology

ASHNR American Society of Functional Neuroradiology ASHNR American Society of Pediatric Neuroradiology ASSR
  • Alerts
  • Log in

Advanced Search

  • Home
  • Content
    • Current Issue
    • Accepted Manuscripts
    • Article Preview
    • Past Issue Archive
    • AJNR Case Collection
    • Case of the Week Archive
    • Classic Case Archive
    • Case of the Month Archive
  • Special Collections
    • Spinal CSF Leak Articles (Jan 2020-June 2024)
    • 2024 AJNR Journal Awards
    • Most Impactful AJNR Articles
  • Multimedia
    • AJNR Podcast
    • AJNR Scantastics
    • Video Articles
  • For Authors
    • Submit a Manuscript
    • Author Policies
    • Fast publishing of Accepted Manuscripts
    • Graphical Abstract Preparation
    • Manuscript Submission Guidelines
    • Imaging Protocol Submission
    • Submit a Case for the Case Collection
  • About Us
    • About AJNR
    • Editorial Board
  • More
    • Become a Reviewer/Academy of Reviewers
    • Subscribers
    • Permissions
    • Alerts
    • Feedback
    • Advertisers
    • ASNR Home
  • Follow AJNR on Twitter
  • Visit AJNR on Facebook
  • Follow AJNR on Instagram
  • Join AJNR on LinkedIn
  • RSS Feeds

Welcome to the new AJNR, Updated Hall of Fame, and more. Read the full announcements.


AJNR is seeking candidates for the position of Associate Section Editor, AJNR Case Collection. Read the full announcement.

 

Research ArticleADULT BRAIN

A Semiautomatic Method for Multiple Sclerosis Lesion Segmentation on Dual-Echo MR Imaging: Application in a Multicenter Context

L. Storelli, E. Pagani, M.A. Rocca, M.A. Horsfield, A. Gallo, A. Bisecco, M. Battaglini, N. De Stefano, H. Vrenken, D.L. Thomas, L. Mancini, S. Ropele, C. Enzinger, P. Preziosa and M. Filippi
American Journal of Neuroradiology November 2016, 37 (11) 2043-2049; DOI: https://doi.org/10.3174/ajnr.A4874
L. Storelli
aFrom the Neuroimaging Research Unit (L.S., E.P., M.A.R., P.P., M.F.)
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for L. Storelli
E. Pagani
aFrom the Neuroimaging Research Unit (L.S., E.P., M.A.R., P.P., M.F.)
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for E. Pagani
M.A. Rocca
aFrom the Neuroimaging Research Unit (L.S., E.P., M.A.R., P.P., M.F.)
bInstitute of Experimental Neurology, Division of Neuroscience, Department of Neurology (M.A.R., P.P., M.F.), San Raffaele Scientific Institute, Vita-Salute San Raffaele University, Milan, Italy
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for M.A. Rocca
M.A. Horsfield
cXinapse Systems (M.A.H.), Colchester, United Kingdom
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for M.A. Horsfield
A. Gallo
dMRI Center “SUN-FISM” and Institute of Diagnosis and Care “Hermitage-Capodimonte” (A.G., A.B.)
eI Division of Neurology, Department of Medical, Surgical, Neurological, Metabolic and Aging Sciences (A.G., A.B.), Second University of Naples, Naples, Italy
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for A. Gallo
A. Bisecco
dMRI Center “SUN-FISM” and Institute of Diagnosis and Care “Hermitage-Capodimonte” (A.G., A.B.)
eI Division of Neurology, Department of Medical, Surgical, Neurological, Metabolic and Aging Sciences (A.G., A.B.), Second University of Naples, Naples, Italy
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for A. Bisecco
M. Battaglini
fDepartment of Neurological and Behavioral Sciences (M.B., N.D.S.), University of Siena, Italy
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for M. Battaglini
N. De Stefano
fDepartment of Neurological and Behavioral Sciences (M.B., N.D.S.), University of Siena, Italy
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for N. De Stefano
H. Vrenken
gDepartment of Radiology and Nuclear Medicine, MS Centre Amsterdam (H.V.), VU Medical Centre, Amsterdam, the Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for H. Vrenken
D.L. Thomas
hNeuroradiological Academic Unit (D.L.T., L.M.), UCL Institute of Neurology, London, United Kingdom
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for D.L. Thomas
L. Mancini
hNeuroradiological Academic Unit (D.L.T., L.M.), UCL Institute of Neurology, London, United Kingdom
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for L. Mancini
S. Ropele
iDepartment of Neurology (S.R., C.E.)
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for S. Ropele
C. Enzinger
iDepartment of Neurology (S.R., C.E.)
jClinical Division of Neuroradiology, Vascular and Interventional Radiology, Department of Radiology (C.E.), Medical University of Graz, Austria.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for C. Enzinger
P. Preziosa
aFrom the Neuroimaging Research Unit (L.S., E.P., M.A.R., P.P., M.F.)
bInstitute of Experimental Neurology, Division of Neuroscience, Department of Neurology (M.A.R., P.P., M.F.), San Raffaele Scientific Institute, Vita-Salute San Raffaele University, Milan, Italy
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for P. Preziosa
M. Filippi
aFrom the Neuroimaging Research Unit (L.S., E.P., M.A.R., P.P., M.F.)
bInstitute of Experimental Neurology, Division of Neuroscience, Department of Neurology (M.A.R., P.P., M.F.), San Raffaele Scientific Institute, Vita-Salute San Raffaele University, Milan, Italy
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for M. Filippi
  • Article
  • Figures & Data
  • Supplemental
  • Info & Metrics
  • Responses
  • References
  • PDF
Loading

Abstract

BACKGROUND AND PURPOSE: The automatic segmentation of MS lesions could reduce time required for image processing together with inter- and intraoperator variability for research and clinical trials. A multicenter validation of a proposed semiautomatic method for hyperintense MS lesion segmentation on dual-echo MR imaging is presented.

MATERIALS AND METHODS: The classification technique used is based on a region-growing approach starting from manual lesion identification by an expert observer with a final segmentation-refinement step. The method was validated in a cohort of 52 patients with relapsing-remitting MS, with dual-echo images acquired in 6 different European centers.

RESULTS: We found a mathematic expression that made the optimization of the method independent of the need for a training dataset. The automatic segmentation was in good agreement with the manual segmentation (dice similarity coefficient = 0.62 and root mean square error = 2 mL). Assessment of the segmentation errors showed no significant differences in algorithm performance between the different MR scanner manufacturers (P > .05).

CONCLUSIONS: The method proved to be robust, and no center-specific training of the algorithm was required, offering the possibility for application in a clinical setting. Adoption of the method should lead to improved reliability and less operator time required for image analysis in research and clinical trials in MS.

ABBREVIATIONS:

DE
dual-echo
PD
proton density

Assessment of the disease burden using MR images from patients with MS, for research and clinical trials, requires quantification of the volume of hyperintense lesions on T2-weighted images.1 However, lesion segmentation remains challenging, and the required accuracy and reproducibility are difficult to achieve. Ideally, segmentation should be automated or require minimum operator input to minimize the operator time required and reduce bias2⇓–4; however, manual segmentation is still the “gold standard.”

Though several methods for fully automated MS lesion segmentation have been published, their performances are difficult to compare. This is because they are usually validated without a common framework,5 and even if validated within the same framework (such as the MS lesion segmentation challenge presented at the International Conference on Medical Image Computing and Computer Assisted Intervention [MICCAI] 20086), the validation is done by using a small dataset of cases and does not include a dual-echo (DE) proton-density (PD)/T2-weighted image dataset. In addition, most methods are optimized and tested on FLAIR MR images that benefit from CSF signal suppression and better contrast between focal lesions and the surrounding tissue7⇓–9 compared with the more established techniques that use DE sequences. Large datasets of DE MR images from past studies are available, and their acquisition is still common for both research and clinical trials, so there is still the need to develop methods for lesion segmentation on these data.10

We have previously proposed a semiautomated method based on a region-growing approach for MS lesion segmentation on DE MR images that results in a considerable reduction in the time required for lesion segmentation compared with manual segmentation and shows good agreement with the ground truth.11

Most large MR imaging studies of MS involve multiple scanning centers with different scanner manufacturers.12 Though all centers would use a common scanning protocol with pulse sequence parameters restricted within certain ranges, there are inevitable differences in image contrast because of hardware and software differences. The aim of the current study was to analyze the training procedure required by the algorithm and to validate the lesion-segmentation method proposed in a multicenter context. The method was validated by comparing the lesion segmentations (obtained using the proposed method) with manual segmentations across different MR scanner manufacturers.

Materials and Methods

Background

The method was presented at the BrainLes MICCAI workshop 201511 and validated for a single acquisition center on 20 patients. The On-line Appendix provides the methodologic framework of the lesion-segmentation technique.

MR Imaging Acquisition

The dataset consisted of 52 patients with MS, part of a project on imaging correlates of cognitive impairment in MS, acquired in 6 European centers that are part of the MAGNIMS consortium (Amsterdam, Graz, London, Milan, Naples, and Siena) by using 3T MR imaging scanners from a range of manufacturers (2 scanners from Philips Healthcare [Best, the Netherlands], 2 from GE Healthcare [Milwaukee, Wisconsin], and 2 from Siemens [Erlangen, Germany]). To be included, patients had to be aged between 20 and 65 years and have a diagnosis of relapsing-remitting MS,13 no relapse or corticosteroid treatment within the month before scanning, and no history of psychiatric conditions (On-line Table 1). Only MR imaging sequences without visually relevant artifacts were selected for the current analysis.

The research protocol was approved by the local ethics review boards of participating centers, and all patients gave written informed consent.

A similar MR imaging acquisition protocol was used for all patients: DE TSE; TR = 4000–5380 ms; TE1 = 10–23 ms; TE2 = 90–102 ms; echo-train length = 5–11; 44 contiguous, 3-mm-thick axial sections, parallel to the anterior/posterior commissure plane; matrix size = 256 × 256; rectangular field of view = 75%; and field of view = 250 × 250 mm2.

The characteristics of MR hardware and number of patients acquired at each center are summarized in On-line Table 2.

Analysis of the Training Procedure

The use of different scanners could cause hardware-dependent differences in image quality. In this study, we assumed that patients scanned with the same radiofrequency coils and MR imaging protocol on different scanners from the same manufacturer would have comparable image quality and, therefore, could be grouped together for the analysis.

Manual identification of lesions was used to initialize the algorithm, and manual segmentation was used for the training and validation of the proposed method. Both tasks were performed with software for medical image analysis (Jim Version 6.0; Xinapse Systems, Colchester, United Kingdom). Manual identification and segmentation of lesions was performed by an experienced rater with 7 years' experience in MS lesion segmentation. In the case of doubt in lesion identification, a senior rater was consulted.

For image standardization (step 1), a group of 12 patients (2 from each center) with a low lesion load was selected. A high lesion load was avoided because a high number of hyperintense lesions could relevantly alter the shape of the image intensity histograms and affect the estimation of the standard parameters. For computation of the standard parameters, scans from healthy patients would be preferable, but these are not always available in a clinical environment.

Because the method required a training step, the selection of a reliable set representative of the entire dataset, in terms of lesion load and sample size for each MR manufacturer, was investigated. Patients were grouped by scanner manufacturer. A threshold function (step 3) was calculated for each group and steadily decreased the number of patients included in the training set. First, all patients were included, and then at each step, 3 patients were removed from each group. The choice of which patients to remove was made by attempting to maintain a balanced lesion load (ie, a variation within ±10%) across the 3 different MR manufacturers. This analysis was performed to assess the relationship between the sample size and the threshold function for each MR scanner manufacturer to lead to a proper selection of the training set for this method. A straight line was fitted to the seed intensity values plotted against the optimal threshold values, obtaining the threshold function for the initial region growing. The linear relationship between the normalized seed intensity and the optimal threshold values was empirically obtained.

To evaluate the sensitivity of the segmentation results to the slope of the threshold function, 17 simulated threshold functions were generated to initialize the region growing. These functions consisted of a straight line passing from a common point (described in detail in the Results) with a slope varying from 0.1 to 0.9 in steps of 0.05 (a wider range of values than that found in the training). Lesion segmentation was performed without the refinement step to evaluate only the effect of a different slope on the results.

The optimal threshold function was selected from the simulated ones by maximizing the dice similarity coefficient between the manually and automatically outlined lesions (as described below).

Moreover, we investigated whether the 2 parameters identifying the optimal training straight line could be estimated directly from the image to be segmented, thus avoiding the need of a training procedure implying the acquisition of an extra group of patients and the manual lesion segmentation.

Because we found that training based on manual segmentation could be avoided (see Results), the entire dataset could be used as a test dataset, and the optimized procedure was applied to the whole group of patients.

Statistical Analysis

The root mean square error in lesion volume for the proposed method relative to the manual segmentation was computed. The root mean square error values, grouped by scanner manufacturer, were compared to evaluate any performance differences between MR manufacturers. It was assumed that the observations from the 3 manufacturer groups were independent of each other. The Wilcoxon-Mann-Whitney test was used to test for differences in errors between the groups. This is a nonparametric test of the null hypothesis (that 2 independent samples come from the same population) against an alternative hypothesis. The test was performed pair-wise between the 3 groups: test 1 was performed between the lesion-segmentation errors on the images acquired on Siemens scanners compared with Philips scanners; test 2 was between Siemens scanners and GE scanners; test 3 was between GE scanners and Philips scanners. The segmentations produced by the proposed method were compared with manual segmentations performed by an expert physician by using the dice similarity coefficient. Dice similarity coefficient values range from 0 to 1, where 0 corresponds to no overlap between the 2 segmentations and 1 corresponds to perfect overlap. The false-positive fraction, false-negative fraction, and true-positive fraction were computed for each lesion to indicate the percentage of voxels correctly or incorrectly classified as lesion by the method. The “ground truth” for assessing the true- and false-positive rates was the binary lesion mask obtained after manual segmentation, comparing individual lesions pixel-by-pixel between the manual and automatic mask.

Results

The threshold functions (plots of threshold value against seed intensity) showed a similar trend with decreasing of the number of patients included in the training set: as the sample size decreased, the fitted lines maintained a similar slope and passed through an approximately similar point (Fig 1). The seed intensity at this “common point” was found to be the intensity of the GM peak on the standardized histogram. This is because the image standardization process fixed the GM peak for the PD-weighted images to the same intensity value. Thus, this value as seed point would produce similar thresholds during the training and after the fitting operation on the training set these points were interpolated, producing a single “common point” between the functions. Furthermore, on the y-axis, this point represents the intensity variation on the GM standard intensity distribution that discriminates the lesion intensity values, which mostly overlap with GM intensity values, from the surrounding tissue (WM).

Fig 1.
  • Download figure
  • Open in new tab
  • Download powerpoint
Fig 1.

Threshold functions obtained after the training step for each different scanner manufacturer at the decreasing of the training set sample sizes (ie, number of patients included) as indicated. It is possible to observe that with decreasing sample size, the linear regression functions did not modify their trends.

The effect of a different slope of the threshold functions on the segmentation results was evaluated. The slope of the threshold function was varied between 0.1 and 0.9, and higher dice similarity coefficient scores were found (dice similarity coefficient >0.6) at higher values of slope (>0.7), though this improvement was not significant.

From those findings, the thresholds used in initial seed growing were expressed as: Embedded Image where T is the threshold for the region growing, m stands for slope (fixed to 0.9), Iseedi is the seed intensity value for lesion i; and IGM and σGM were the intensity of the GM peak and the standard deviation of the GM distribution on the standard histogram, respectively. The equation was used to compute the threshold function, and then the method was performed without training on manual segmentation.

Comparison of data between the different scanners showed that there was no evidence that lesion-segmentation errors came from different distributions. The mean values of segmentation errors for each MR manufacturer were 1.99 mL for GE, 1.59 mL for Philips, and 1.86 mL for Siemens. The statistical test performed between the groups revealed no differences of segmentation performance between manufacturers (Test 1, P = .65; Test 2, P = .44; and Test 3, P = .30).

The validation metrics were extracted for the lesion load of each patient, considering each lesion as a connected region in 3D space for the computation of its total volume. Fig 2 graphically reports the metrics evaluated for each patient over all lesions. The following were obtained after averaging the metrics over all patients: dice similarity coefficient = 0.62; root mean square error = 2 mL; true-positive fraction = 0.76; false-positive fraction = 0.36; and false-negative fraction = 0.22.

Fig 2.
  • Download figure
  • Open in new tab
  • Download powerpoint
Fig 2.

Dice similarity coefficient values (top left), mean true-positive fraction/false-positive fraction values (top right), and mean false-negative fraction values (bottom left) are shown for each patient. In the bottom right, a scatterplot to compare manual lesion load with automatic lesion load is shown. The dashed line is the line of identity.

An example lesion-segmentation result is shown in Fig 3.

Fig 3.
  • Download figure
  • Open in new tab
  • Download powerpoint
Fig 3.

Example lesion segmentations for 2 patients (rows) from 2 different scanners by the proposed method (red) compared with the expert operator segmentation (blue). The corresponding T2-weighted images are shown in the right column.

Discussion

Because manual segmentation is time-consuming and subject to inter- and intraobserver variability, automatic segmentation of MS lesions is an active research field with many proposals presented in recent years.5 The method validated in this study has several advantages. First, it works on DE MR images. Most proposed methods segment lesions on FLAIR sequences that benefit from suppression of the CSF signal and better contrast between focal lesions and the surrounding background.7⇓–9,14⇓–16 However, much data have been and are currently being acquired for research and clinical trials by using DE PD/T2-weighted images. Thus, with use of the proposed method, it should be possible to rapidly analyze these large sets of images. Second, despite the limitation of the manual identification of lesions by an expert physician, this initialization ensures the correct identification of all lesions and avoids the problem of the identification of entire false-positive lesions (because only possible misclassification of lesion pixels can occur). This is a common challenge for fully automatic lesion-segmentation methods, which tend to be affected by the image quality.4 In the method proposed, we avoid this issue by maintaining manual identification of lesions and automating the segmentation task that is the most time-consuming operation. Some automatic lesion-segmentation tools with available code (LST, SLS, and Lesion-TOADS) expect FLAIR images as input. As a consequence, a comparison with our method would be unfair. Moreover, most proposed methods have been validated on a restricted number of cases and within single centers or simulated MR imaging acquisitions.5,17,18 In addition, a validation of the method based on data provided by the MICCAI Grand Challenge workshop 2008 would be unfeasible because of the absence of a DE sequence in the dataset.6,19 In this study, a validation of the method against manual segmentation in a multicenter context was presented, proving that the method was robust to scanner differences and that its performance was not dependent on MR software and hardware.

During an initial assessment of the size of the training set needed, it was found that the threshold functions extracted for the initial region-growing algorithm were not noticeably affected by including fewer patients, and there were no significant differences between the threshold functions computed from each scanner manufacturer group. Moreover, using the simulated threshold functions demonstrated that once their intersection point was found, changes to the slope introduced only a small nonsignificant improvement at higher values; thus, the most important feature of the threshold function was the crossing point of the lines, which was a result of the standardization process.

These results allowed us to find an expression for the threshold function used in the initial region-growing part of the algorithm, thus avoiding the training step by using manual segmentation. Because the segmentation results improved when using a higher slope of the threshold function, 0.9 was selected to allow the use of higher thresholds and a less restricted region-growing segmentation. This is because of the stop condition on the threshold value (see equation in the On-line Appendix): a higher threshold implies a higher difference between the seed point and the i-th pixel intensity value that stops the region growing, so a larger range of intensities are classifiable as lesion (less restricted segmentation). This was made possible because we included an edge detection step in the segmentation that acts as a barrier to stop the region growing even if a too-high threshold is used. Because of noise or artifacts on the images, the 2 stop conditions were used in combination for a good result. However, using a high slope for the threshold function might generate a bias between lesions with higher and lower intensity values relative to the crossing point of the straight line; that is, with a high slope, lower-intensity lesions would have lower threshold values, causing a more restricted region growing, whereas the opposite would be observed for higher-intensity lesions. This bias was avoided by applying a threshold refinement step, in which a more robust threshold is computed to restart the region growing, thus correcting too-restricted segmentation caused by lower threshold values. Hence, using our equation to find the threshold function, we avoided the training step by using manual segmentation, making the applicability of the proposed technique easier in clinical settings. Regarding the possible bias between different lesion loads, it seemed that the difference between automatic and manual lesion load becomes larger with increasing lesion load (Fig 2). This could be explained by the fact that a high lesion load could be caused by many small lesions or a few but very large lesions. In the first case, a difference of a few pixels between the automatic and manual-segmented lesion (that is visually undetectable), summed up for all lesions, could result in a relevant difference in the quantification of lesion load between the 2 methods. In the second case, a difference of more pixels (for example at lesion border [again, visually undetectable]) could result in a relevant difference in lesion-load quantification between manual and automatic segmentation.

The stability and robustness of the method was assessed when working on data from different scanner manufacturers. The initial step in image analysis standardizes the intensity values between the PD-weighted MR imaging scans, allowing the use of fixed intensity parameters. The method was not significantly affected by possible hardware or software-dependent differences between MR imaging scanners.

Lesion segmentation performed with the new method showed good agreement with the ground truth (dice similarity coefficient = 0.62 and true-positive fraction = 0.76). The difference between the lesion load estimated using the proposed method and with manual segmentation gave a mean error of 19% (root mean square error = 2 mL), with low misclassification of lesion voxels (false-negative fraction = 0.22 and false-positive fraction = 0.36).

The evidence of the benefit for operator time required to segment lesions was demonstrated in our previous work.11 In the current study, the important reduction in time for the segmentation task was confirmed. For the lesion loads we considered, the average time for manual lesion segmentation of a single MR imaging scan was approximately 50 minutes for the segmentation task only, whereas for the new method, the average time for the same task was approximately 55 seconds, a reduction in time of approximately 98.2%.

In cases where lesions have intensity similar to that of CSF, the method gives segmentations that extend beyond the real boundary of the lesions. This happened in very few cases in this study and was mainly for periventricular lesions. It may be possible to improve this in the future by introducing further information about lesions, perhaps by using other MR tissue contrasts such as coregistered T1-weighted images. This improvement also could be useful for a more certain lesion boundary delineation in case of diffuse lesions in patients with high lesion load. Notably, the method did not encounter difficulties in segmenting subcortical/cortical lesions. This is because of the edge-detection step using the high-pass filter; the borders of subcortical/cortical lesions were well defined with respect to the surrounding tissue, different from what happened to periventricular lesions that had intensity values similar to the CSF on DE scans.

The method implemented is based on a 2D region-growing approach because it started from initial seed points positioned in 2D. 2D implementation was chosen because images were not acquired by using 3D MR images; therefore, resolution along the z-axis (section thickness) is lower than the axial one. The adaptation of the method to a 3D approach could be a future extension when 3D MR images are available to reduce the interaction time of the expert. Similarly, the applicability of the method on different images (eg, pre- and postcontrast T1-weighted sequences) would require some modifications and retraining of the method for the new contrasts.

The algorithm relies on manual identification of lesions, which must be performed by an expert operator, and the most time-consuming task (ie, outlining each lesion) is fully automated. However, it would be preferable to avoid all manual intervention to remove any operator dependence. In the future, it might be possible to fully automate T2-hyperintense lesion segmentation by using other MR imaging contrasts such as FLAIR or double inversion recovery sequences.20 Finally, the reproducibility of the method should be evaluated in longitudinal studies.

Conclusions

In this study, we evaluated the performance and stability of a semiautomatic method for MS lesion segmentation by using DE data acquired from different centers with different scanners compared with manual segmentation by an expert physician. The method proved to be robust and stable when working on data from different scanner manufacturers. It emerged also that no center-specific training of the algorithm was required, making the method suitable for direct use on a wide range of images. Adoption of the method should lead to improved reliability and less operator time required for image analysis in research and clinical trials in MS.

Footnotes

  • Disclosures: Maria Assunta Rocca—RELATED: Grant: Fondazione Italiana Sclerosi Multipla (FISM2013/s/1)*; UNRELATED: Grants/Grants Pending: Italian Ministry of Health and Fondazione Italiana Sclerosi Multipla*; Payment for Lectures (including service on speakers bureaus): Biogen Idec, Novartis, Genzyme, Teva Pharmaceutical Industries. Mark A. Horsfield—UNRELATED: Employment: Xinapse Systems, Comments: full-time employer; Stock/Stock Options: Xinapse Systems. Nicola De Stefano—UNRELATED: Board Membership: Biogen Idec, Merck Serono SA, Novartis; Consultancy: Schering, Biogen Idec, Teva Pharmaceutical Industries, Novartis, Genzyme, Merck; Grants/Grants Pending: Italian Association of Multiple Sclerosis,* Novartis*; Payment for Lectures (including service on speakers bureaus): Schering,* Biogen Idec,* Teva Pharmaceutical Industries,* Novartis,* Genzyme,* Merck Serono SA.* Hugo Vrenken—UNRELATED: Grants/Grants Pending: Pfizer,* Novartis,* Merck-Serono,* Teva,* Dutch MS Research Foundation*; Payment for Lectures (including service on speakers bureaus): Novartis.* Massimo Filippi—RELATED: Grant: Fondazione Italiana Sclerosi Multipla (FISM2013/s/1)*; UNRELATED: Board Membership: Teva Pharmaceutical Industries; Consultancy: Biogen Idec, Novartis, and Teva Pharmaceutical Industries; Grants/Grants Pending: Biogen Idec,* Teva Pharmaceutical Industries,* Novartis,* Italian Ministry of Health,* Fondazione Italiana Sclerosi Multipla,* Cure PSP,* Alzheimer's Drug Discovery Foundation (ADDF),* the Jacques and Gloria Gossweiler Foundation (Switzerland),* and ARiSLA (Fondazione Italiana di Ricerca per la SLA)*; Payment for Lectures (including service on speakers bureaus): Biogen Idec, Excemed, Novartis, and Teva Pharmaceutical Industries; Other: Springer, Comments: editor-in-chief of the Journal of Neurology. *Money paid to the institution.

  • This study was partially supported by Fondazione Italiana Sclerosi Multiple (FISM2013/S/1). D.L.T. is supported by the UCL Leonard Wolfson Experimental Neurology Centre (grant PR/ylr/18575).

References

  1. 1.↵
    1. Filippi M,
    2. Rocca MA,
    3. De Stefano N, et al
    . Magnetic resonance techniques in multiple sclerosis: the present and the future. Arch Neurol 2011;68:1514–20 doi:10.1001/archneurol.2011.914 pmid:22159052
    CrossRefPubMed
  2. 2.↵
    1. Johnston B,
    2. Atkins MS,
    3. Mackiewich B, et al
    . Segmentation of multiple sclerosis lesions in intensity corrected multispectral MRI. IEEE Trans Med Imaging 1996;15:154–69 doi:10.1109/42.491417 pmid:18215898
    CrossRefPubMed
  3. 3.↵
    1. Sajja BR,
    2. Datta S,
    3. He R, et al
    . Unified approach for multiple sclerosis lesion segmentation on brain MRI. Ann Biomed Eng 2006;34:142–51 doi:10.1007/s10439-005-9009-0 pmid:16525763
    CrossRefPubMed
  4. 4.↵
    1. Van Leemput K,
    2. Maes F,
    3. Vandermeulen D, et al
    . Automated segmentation of multiple sclerosis lesions by model outlier detection. IEEE Trans Med Imaging 2001;20:677–88 doi:10.1109/42.938237 pmid:11513020
    CrossRefPubMed
  5. 5.↵
    1. García-Lorenzo D,
    2. Francis S,
    3. Narayanan S, et al
    . Review of automatic segmentation methods of multiple sclerosis white matter lesions on conventional magnetic resonance imaging. Med Image Anal 2013;17:1–18 doi:10.1016/j.media.2012.09.004 pmid:23084503
    CrossRefPubMed
  6. 6.↵
    1. Styner M,
    2. Lee J,
    3. Chin B, et al
    . 3D segmentation in the clinic: a grand challenge II: MS lesion segmentation. MIDAS Journal 2008. http://hdl.handle.net/10380/1509
  7. 7.↵
    1. García-Lorenzo D,
    2. Prima S,
    3. Arnold DL, et al
    . Trimmed-likelihood estimation for focal lesions and tissue segmentation in multisequence MRI for multiple sclerosis. IEEE Trans Med Imaging 2011;30:1455–67 doi:10.1109/TMI.2011.2114671 pmid:21324773
    CrossRefPubMed
  8. 8.↵
    1. Khayati R,
    2. Vafadust M,
    3. Towhidkhah F, et al
    . Fully automatic segmentation of multiple sclerosis lesions in brain MR FLAIR images using adaptive mixtures method and Markov random field model. Comput Biol Med 2008;38:379–90 doi:10.1016/j.compbiomed.2007.12.005 pmid:18262511
    CrossRefPubMed
  9. 9.↵
    1. Souplet J,
    2. Lebrun C,
    3. Ayache N, et al
    . An automatic segmentation of T2-FLAIR multiple sclerosis lesions. MIDAS Journal 2008. http://hdl.handle.net/10380/1451
  10. 10.↵
    1. Erbayat Altay E,
    2. Fisher E,
    3. Jones SE, et al
    . Reliability of classifying multiple sclerosis disease activity using magnetic resonance imaging in a multiple sclerosis clinic. JAMA Neurol 2013;70:338–44 doi:10.1001/2013.jamaneurol.211 pmid:23599930
    CrossRefPubMed
  11. 11.↵
    1. Storelli L,
    2. Pagani E,
    3. Rocca MA, et al
    . A semi-automatic method for segmentation of multiple sclerosis lesions on dual-echo magnetic resonance images. Lect Notes Comput Sci 2016;9556:80–90 doi:10.1007/978-3-319-30858-6_8
    CrossRef
  12. 12.↵
    1. Schnack HG,
    2. van Haren NE,
    3. Hulshoff Pol HE, et al
    . Reliability of brain volumes from multicenter MRI acquisition: a calibration study. Hum Brain Mapp 2004;22:312–20 doi:10.1002/hbm.20040 pmid:15202109
    CrossRefPubMed
  13. 13.↵
    1. Polman CH,
    2. Reingold SC,
    3. Banwell B, et al
    . Diagnostic criteria for multiple sclerosis: 2010 revisions to the McDonald criteria. Ann Neurol 2011;69:292–302 doi:10.1002/ana.22366 pmid:21387374
    CrossRefPubMed
  14. 14.↵
    1. Subbanna N,
    2. Precup D,
    3. Arnold D, et al
    . IMaGe: iterative multilevel probabilistic graphical model for detection and segmentation of multiple sclerosis lesions in brain MRI. Inf Process Med Imaging 2015;24:514–26 pmid:26221699
    PubMed
  15. 15.↵
    1. Jain S,
    2. Sima DM,
    3. Ribbens A, et al
    . Automatic segmentation and volumetry of multiple sclerosis brain lesions from MR images. Neuroimage Clin 2015;8:367–75 doi:10.1016/j.nicl.2015.05.003 pmid:26106562
    CrossRefPubMed
  16. 16.↵
    1. Mechrez R,
    2. Goldberger J,
    3. Greenspan H
    . Patch-based segmentation with spatial consistency: application to MS lesions in brain MRI. Int J Biomed Imaging 2016;2016:7952541 doi:10.1155/2016/7952541 pmid:26904103
    CrossRefPubMed
  17. 17.↵
    1. Freifeld O,
    2. Greenspan H,
    3. Goldberg J
    . Multiple sclerosis lesion detection using constrained GMM and curve evolution. Int J Biomed Imaging 2009;2009:715124 doi:10.1155/2009/715124 pmid:19756161
    CrossRefPubMed
  18. 18.↵
    1. Galimzianova A,
    2. Pernuš F,
    3. Likar B, et al
    . Stratified mixture modeling for segmentation of white-matter lesions in brain MR images. Neuroimage 2016;124:1031–43 doi:10.1016/j.neuroimage.2015.09.047 pmid:26427644
    CrossRefPubMed
  19. 19.↵
    1. Strumia M,
    2. Schmidt FR,
    3. Anastasopoulos C, et al
    . White matter MS-lesion segmentation using a geometric brain model. IEEE Trans Med Imaging 2016;35:1636–46 doi:10.1109/TMI.2016.2522178 pmid:26829786
    CrossRefPubMed
  20. 20.↵
    1. Veronese E,
    2. Calabrese M,
    3. Favaretto A, et al
    . Automatic segmentation of gray matter multiple sclerosis lesions on DIR images. IFMBE Proc 2014;41:241–44 doi:10.1007/978-3-319-00846-2_60
    CrossRef
  • Received March 16, 2016.
  • Accepted after revision May 11, 2016.
  • © 2016 by American Journal of Neuroradiology
View Abstract
PreviousNext
Back to top

In this issue

American Journal of Neuroradiology: 37 (11)
American Journal of Neuroradiology
Vol. 37, Issue 11
1 Nov 2016
  • Table of Contents
  • Index by author
  • Complete Issue (PDF)
Advertisement
Print
Download PDF
Email Article

Thank you for your interest in spreading the word on American Journal of Neuroradiology.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
A Semiautomatic Method for Multiple Sclerosis Lesion Segmentation on Dual-Echo MR Imaging: Application in a Multicenter Context
(Your Name) has sent you a message from American Journal of Neuroradiology
(Your Name) thought you would like to see the American Journal of Neuroradiology web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Cite this article
L. Storelli, E. Pagani, M.A. Rocca, M.A. Horsfield, A. Gallo, A. Bisecco, M. Battaglini, N. De Stefano, H. Vrenken, D.L. Thomas, L. Mancini, S. Ropele, C. Enzinger, P. Preziosa, M. Filippi
A Semiautomatic Method for Multiple Sclerosis Lesion Segmentation on Dual-Echo MR Imaging: Application in a Multicenter Context
American Journal of Neuroradiology Nov 2016, 37 (11) 2043-2049; DOI: 10.3174/ajnr.A4874

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
0 Responses
Respond to this article
Share
Bookmark this article
A Semiautomatic Method for Multiple Sclerosis Lesion Segmentation on Dual-Echo MR Imaging: Application in a Multicenter Context
L. Storelli, E. Pagani, M.A. Rocca, M.A. Horsfield, A. Gallo, A. Bisecco, M. Battaglini, N. De Stefano, H. Vrenken, D.L. Thomas, L. Mancini, S. Ropele, C. Enzinger, P. Preziosa, M. Filippi
American Journal of Neuroradiology Nov 2016, 37 (11) 2043-2049; DOI: 10.3174/ajnr.A4874
del.icio.us logo Twitter logo Facebook logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One
Purchase

Jump to section

  • Article
    • Abstract
    • ABBREVIATIONS:
    • Materials and Methods
    • Results
    • Discussion
    • Conclusions
    • Footnotes
    • References
  • Figures & Data
  • Supplemental
  • Info & Metrics
  • Responses
  • References
  • PDF

Related Articles

  • PubMed
  • Google Scholar

Cited By...

  • No citing articles found.
  • Crossref (4)
  • Google Scholar

This article has been cited by the following articles in journals that are participating in Crossref Cited-by Linking.

  • Multiple sclerosis lesion detection in multimodal MRI using simple clustering-based segmentation and classification
    Ozdemir Cetin, Volkan Seymen, Unal Sakoglu
    Informatics in Medicine Unlocked 2020 20
  • Tsallis-Entropy Segmentation through MRF and Alzheimer anatomic reference for Brain Magnetic Resonance Parcellation
    Mehran Azimbagirad, Fabrício H. Simozo, Antonio C.S. Senra Filho, Luiz O. Murta Junior
    Magnetic Resonance Imaging 2020 65
  • Multiple sclerosis segmentation method in magnetic resonance imaging using fuzzy connectedness, binarization, mathematical morphology, and 3D reconstruction
    André Luiz Costa de Arruda, Daniel Aparecido Vital, Felipe Campos Kitamura, Nitamar Abdala, Matheus Cardoso Moraes
    Research on Biomedical Engineering 2020 36 3
  • Validation of a semi-automated method to quantify lesion volume changes in multiple sclerosis on 2D proton-density-weighted scans based on image subtraction
    Rozemarijn M. Mattiesing, Serena Stel, Alysha S. Mangroe, Iman Brouwer, Adriaan Versteeg, Ronald A. van Schijndel, Bernard M.J. Uitdehaag, Frederik Barkhof, Hugo Vrenken, Joost P.A. Kuijer
    Neuroimage: Reports 2024 4 1

More in this TOC Section

  • Diagnostic Neuroradiology of Monoclonal Antibodies
  • ML for Glioma Molecular Subtype Prediction
  • Segmentation of Brain Metastases with BLAST
Show more Adult Brain

Similar Articles

Advertisement

Indexed Content

  • Current Issue
  • Accepted Manuscripts
  • Article Preview
  • Past Issues
  • Editorials
  • Editors Choice
  • Fellow Journal Club
  • Letters to the Editor

Cases

  • Case Collection
  • Archive - Case of the Week
  • Archive - Case of the Month
  • Archive - Classic Case

Special Collections

  • Special Collections

Resources

  • News and Updates
  • Turn around Times
  • Submit a Manuscript
  • Author Policies
  • Manuscript Submission Guidelines
  • Evidence-Based Medicine Level Guide
  • Publishing Checklists
  • Graphical Abstract Preparation
  • Imaging Protocol Submission
  • Submit a Case
  • Become a Reviewer/Academy of Reviewers
  • Get Peer Review Credit from Publons

Multimedia

  • AJNR Podcast
  • AJNR SCANtastic
  • Video Articles

About Us

  • About AJNR
  • Editorial Board
  • Not an AJNR Subscriber? Join Now
  • Alerts
  • Feedback
  • Advertise with us
  • Librarian Resources
  • Permissions
  • Terms and Conditions

American Society of Neuroradiology

  • Not an ASNR Member? Join Now

© 2025 by the American Society of Neuroradiology All rights, including for text and data mining, AI training, and similar technologies, are reserved.
Print ISSN: 0195-6108 Online ISSN: 1936-959X

Powered by HighWire