|Year : 2022 | Volume
| Issue : 3 | Page : 263-268
Brain tumor segmentation using hierarchical combination of fuzzy logic and cellular automata
Roqaie Kalantari1, Roqaie Moqadam2, Nazila Loghmani3, Armin Allahverdy4, Mohammad Bagher Shiran1, Arash Zare-Sadeghi1
1 Finetech in Medicine Research Center, School of Medicine, Iran University of Medical Sciences (IUMS); Department of Medical Physics, School of Medicine, Iran University of Medical Sciences (IUMS), Tehran, Iran
2 Neuroimaging and Analysis group, Research Center for Molecular and Cellular Imaging, Advanced Medical Technologies and Equipment Institute; Department of Medical Physics & Biomedical Engineering, School of Medicine, Tehran University of Medical Sciences, Tehran, Iran
3 Department of Bioengineering, Northeastern University, Boston, Massachusetts, USA
4 Department of Radiology, Sari School of Allied Medical Sciences, Mazandaran University of Medical Sciences, Sari, Iran
|Date of Submission||30-May-2021|
|Date of Decision||30-Oct-2021|
|Date of Acceptance||01-Jan-2022|
|Date of Web Publication||26-Jul-2022|
Department of Medical Physics, Iran University of Medical Sciences, Tehran
Department of Radiology, Sari School of Allied Medical Sciences, Mazandaran University of Medical Sciences, Sari
Source of Support: None, Conflict of Interest: None
Background: Magnetic resonance (MR) image is one of the most important diagnostic tools for brain tumor detection. Segmentation of glioma tumor region in brain MR images is challenging in medical image processing problems. Precise and reliable segmentation algorithms can be significantly helpful in the diagnosis and treatment planning. Methods: In this article, a novel brain tumor segmentation method is introduced as a postsegmentation module, which uses the primary segmentation method's output as input and makes the segmentation performance values better. This approach is a combination of fuzzy logic and cellular automata (CA). Results: The BraTS online dataset has been used for implementing the proposed method. In the first step, the intensity of each pixel is fed to a fuzzy system to label each pixel, and at the second step, the label of each pixel is fed to a fuzzy CA to make the performance of segmentation better. This step repeated while the performance saturated. The accuracy of the first step was 85.8%, but the accuracy of segmentation after using fuzzy CA was obtained to 99.8%. Conclusion: The practical results have shown that our proposed method could improve the brain tumor segmentation in MR images significantly in comparison with other approaches.
Keywords: Cellular automata, fuzzy, glioma, segmentation
|How to cite this article:|
Kalantari R, Moqadam R, Loghmani N, Allahverdy A, Shiran MB, Zare-Sadeghi A. Brain tumor segmentation using hierarchical combination of fuzzy logic and cellular automata. J Med Signals Sens 2022;12:263-8
|How to cite this URL:|
Kalantari R, Moqadam R, Loghmani N, Allahverdy A, Shiran MB, Zare-Sadeghi A. Brain tumor segmentation using hierarchical combination of fuzzy logic and cellular automata. J Med Signals Sens [serial online] 2022 [cited 2022 Aug 13];12:263-8. Available from: https://www.jmssjournal.net/text.asp?2022/12/3/263/351887
| Introduction|| |
Image segmentation plays a vital role in image perception and interpretation in many fields and applications. Moreover, it has a wide range of applications in medical area such as lesion classification, tumor segmentation, and tissue volume estimation. There is a widespread algorithm for image segmentation to detect a pathology or abnormality in a subject. The precise approach for tumor localization can play an essential and undeniable role in diagnosis and treatment planning in brain tumors. Brain tumor contains enhancing tumor, necrotic tumor, and edema.
As glioma is the most common type of brain tumor, most studies of brain tumor segmentation concentrate on this type of brain tumor. There are many reasons for challenges in glioma segmentation. The first reason is the similarity of glioma and gliosis and stroke in magnetic resonance (MR) images, and the second reason is the appearance of glioma in most locations of the brain with different shapes and sizes. Moreover, there is no sharp boundary between glioma and normal tissue, and there are many types of MR imaging (MRI) data. Hence, using automatic brain tumor segmentation may be applicable for minimizing localization errors. However, there are no unique MRI protocols for heterogeneous tumors.
A wide variety of brain segmentation approaches contain convolutional methods, supervised methods, unsupervised methods, and hybrid methods., Convolutional methods include thresholding, and region growing.,,, Thresholding is a simple, fast, and easy to implement method for image segmentation. The main idea of this method is based on converting an image to a binary image, and the threshold would be the decision value for making a pixel zero or one. There is no need for any prior knowledge for global thresholding, but this approach is not appropriate when two classes have different sizes, so a combination of morphological operation and the threshold value is introduced, which produces more accurate results., In most images, there are more than two regions for segmentation; in these cases, more than one threshold value must be used as a local dynamic threshold. Another approach of convolutional methods is a region growing. This approach is used for segmenting an image whose regions have the same intensity values. The main idea of this approach is that all pixels must be segmented in a region, all pixels of a region must be connected and have some similarity condition, regions must be separated, and two different regions must have different features. This method can be used for images affected by lightning variation. The limitation of this method is the partial volume effect that blurs the border of two tissues. This restriction has been removed by introducing multiple respiratory gas monitoring, and this method has been used for making better results for tumor segmentation in T1 images.
Another method for brain tumor image segmentation is the supervised method. This method uses labeled data to train a decision-making system as a training phase for segmenting unlabeled data as a testing phase. There are many supervised classifiers for brain tumor segmentation like k-nearest neighbor,, Support vector machine (SVM), random forest,, artificial neural network (ANN),, and neuro-fuzzy networks. Unsupervised methods require no data for training, and the number of classes determined automatically by the algorithm. These methods use image-based features such as the intensity of pixels, gradient, and texture of regions. There are many unsupervised methods such as k-means clustering, fuzzy C-means clustering (FCM), parametric active contour models (ACM), and geometric deformable models. The other approach of brain tumor image segmentation is the hybrid technique. Hybrid techniques use two or more methods to provide better results of image segmentation. These techniques use the advantages of used methods to compensate disadvantages of other methods. The are many combinations of methods to make hybrid techniques such as the combination of FCM and SVM and the combination of ACM and ANN. Moreover, there are many studies, which used the cellular automata (CA) as learning and supervised method.,,, From comparing of mentioned methods, hybrid methods can present a better precision for brain tumor image segmentation, so in this article, a hybrid method will be presented and compare with other methods.
| Materials and Methods|| |
This article proposes a combination of CA and fuzzy logic as a hybrid method for brain tumor segmentation without any feature extraction. The structure of this combination is shown in [Figure 1]. This method uses the intensity of each pixel as input. This method consists of two major steps. In the first step, a fuzzy system uses the intensity of each pixels to label them as a tumor or host tissue. In the second step, the label of each pixel and its neighbors will be used by a fuzzy system to improve its label as CA. In this paper, CA uses the current label as input and analyses this by a fuzzy system to make the next and improved label. Hence, considering each labeled image as a frame, each frame will be produced by the last frame. The second step will be performed while the error of labeling is changing. The proposed method will be described as following.
|Figure 1: Diagram of brain tumor image segmentation using the combination of cellular automata and fuzzy system|
Click here to view
As shown in [Figure 1], there are two main sections to image segmentation in this study. At the first section, an image fed to a fuzzy inference system to label its pixels as tumor or host tissue. At this section, the input type is image and the output is label of pixels. Up to this point, the image has been segmented into host or tumor tissue. At the second section, the label feds to a fuzzy system to make improved label. Hence, it works as a CA, which its pixels attributes changes via time passing by considering the attributes of that pixel and its neighbors attributes. Hence, the second section is a CA that uses a fuzzy inference system a transition rules.
Magnetic resonance imaging brain image dataset
The imaging dataset of this study was obtained from BraTS 2015. This dataset contains Fluid Attenuated Inversion Recovery (FLAIR), T1, T1c, and T2 scans with 1 mm3 resolution. This dataset consists of 220 high-grade gliomas (HGG) and 54 low-grade gliomas (LGG) cases. The multimodal property of this dataset makes it possible to register the tumor into sub-regions, as shown in [Figure 2].
|Figure 2: Sub-regions of tumor in BraTS. The image was segmented into the whole tumor by FLAIR scan as yellow color on (a). The tumor core is illustrated by red color on the T2 scan (b). Enhancing tumor is showed by blue color, and the necrotic tumor is also shown by green color on T1c scan (c)|
Click here to view
As this article aims to segment the whole tumor, the FLAIR scan is used to segmenting the whole tumor.
Proposed image segmentation algorithm
In this article, for segmenting a pixel as a tumor or host, the interaction between its neighbors is used. This task assigns a label to each pixel as tumor or host, and a label image will be produced, and this label image will be used to make the next label image. Interaction between pixels must be configured as equations or rules. These interactions are configured as a fuzzy system. This fuzzy system uses a label image with Moor neighborhood as input. Sugeno fuzzy system is used with three Gaussian membership functions as fuzzifier and center of gravity as defuzzifier. The proposed algorithm of brain tumor segmentation is described in the following pseudocode in Code 1. The pseudocode finds the best label (tumor or host) for each pixel.
As described in Code 1, the image (FLAIR) and the original label will be used for training a fuzzy system to make a label image. For this aim, the brightness of each pixel and its neighbors will be used as input, and the original label of the pixel will be used as output. With training and simulating the fuzzy system, the label image will be produced, which feeds to another fuzzy system as cells to make better labels. Finally, the improved label image will compare with the original label to computing the error. This procedure will repeat during error change.
| Results|| |
In this article, the proposed algorithm of brain tumor image segmentation is applied on the FLAIR scan, which is available as BraTS 2015 dataset, and tumor segmented brain images by radiologists have been used as the desired output of the method, as illustrated in [Figure 3]. In this study all 220 HGG and 54 LGG cases have been considered as dataset. This algorithm simulated using MATLAB R2015b version with 3.00 GHz core i5 central processing unit and 4 GB internal Random Access Memory as hardware devices. As it was mentioned, the used data set consists of 220 HGG and 54 LGG, and all these images have been labeled as host, whole tumor, enhancing tumor, and necrotic tumor by different expert radiologists. As this study aims to discriminate host tissue and entire tumor, the FLAIR scan has been used for segmentation.
|Figure 3: (a) FLAIR scan of brain magnetic resonance imaging (b) Tumor segmented brain image by radiologists|
Click here to view
To analyze the performance of the proposed algorithm and to compare with other approaches, the sensitivity, specificity, and accuracy have been calculated as below:
Where true positive (TP) is the number of TPs, true negative (TN) is the number of TNs, false-positive (FP) is the number of FP and false negative (FN) is the number of FNs.
As it has been mentioned in Code 1, there are two main steps for image segmentation. In the first step, a fuzzy system uses original images and tumor segmented brain images by radiologists to make new labels. In a second step, another fuzzy system uses new labels to make more accurate segmentation [Figure 4]. The second step will be repeated while the accuracy achieves saturation [Figure 5]. As this algorithm is time-consuming, the images will be cropped manually.
|Figure 4: (a) Cropped FLAIR scan of Brain Magnetic resonance imaging, (b) Output of first step fuzzy system, (c) output of first-round Fuzzy cellular automata, (d) output of third-round Fuzzy cellular automata (e) output of fifth-round Fuzzy cellular automata (f) output of seventh-round Fuzzy cellular automata|
Click here to view
|Figure 5: Change of segmentation accuracy for the different round of Fuzzy cellular automata|
Click here to view
As it is obvious from [Figure 4] and [Figure 5], as the Fuzzy CA round number increases, the value of segmentation accuracy increases too, but the further increase of Fuzzy CA round number results from saturation in segmentation accuracy that causes to exit the second step's loop.
The performance metrics such as sensitivity and specificity can show the validity of a methodology, and the increment of these metrics shows the strength of that methodology. The best accuracy, specificity, and sensitivity of this method are illustrated in [Table 1].
| Discussion|| |
As mentioned, the main aim of this study is to increase the performance of a brain tumor image segmentation using a combination of fuzzy logic and CA. To achieve this aim, a simple segmentation method that uses the intensity of each pixel and fuzzy logic was used as a segmentation method which followed by fuzzy CA. The results showed that using Fuzzy CA improves the performance of image segmentation significantly, as illustrated in [Figure 5]. For more comparison, the performance of the proposed algorithm and other methods is shown in [Table 2].
As it is obvious, there is a meaningful increment in all performance values in our proposed method. These results emphasize the fact that fuzzy CA can increase the segmentation performance, and this approach can be used as a postsegmentation module for having better segmentation performance, which uses the output of main segmentation method results as input and makes the segmentation more precise.
In this article, a new methodology to segment the glioma tumor in brain MR images. There are a few studies which used CA as an image segmentation method. For example, in introduced an approach for brain tumor segmentation by combination of CA and improved tumor-cut algorithm. That study used two paradigms, consisting image transformation and segmentation algorithm to introducing gray-level co-occurrence matrix based CA (GLCM-CA). In GLCM-CA, the CA works as a transformation to getting featured image and efficient tumor-cut algorithm works as segmentation section, but in the current study, our proposed method uses the output of the main segmentation method and makes this more precise and can be used for most other segmentation methods. This article used a fuzzy system as the main segmentation method that used the intensity of each pixel as input the output of this method fed to the fuzzy CA to have better performance values. The results showed that there is a significant increment in performance values in comparison to the other approaches. This study focused on tumor segmentation, but this proposed algorithm can be used to segment other tissues, but its accuracy may be different and for more details, this algorithm must be implemented for other tissues.
| Conclusion|| |
In this paper, a new method to improve brain tumor segmentation was introduced. This method uses the combination of cellular and fuzzy logic as a hierarchical approach, without causing overlearning. In this method a basic segmentation method would be considered, then the fuzzy cellular automata would improve the accuracy of segmentation. This method can be applied to different image segmentation algorithms.
Financial support and sponsorship
Conflicts of interest
There are no conflicts of interest.
| References|| |
Wadhwa A, Bhardwaj A, Singh Verma V. A review on brain tumor segmentation of MRI images. Magn Reson Imaging 2019;61:247-59.
Zhao X, Wu Y, Song G, Li Z, Zhang Y, Fan Y. A deep learning model integrating FCNNs and CRFs for brain tumor segmentation. Med Image Anal 2018;43:98-111.
Goetz M, Weber C, Bloecher J, Stieltjes B, Meinzer HP, Maier-Hein K. “Extremely Randomized Trees Based Brain Tumor Segmentation,” Proceeding of BRATS Challenge-MICCAI; 2014. p. 006-11.
Goetz M, Weber C, Binczyk F, Polanska J, Tarnawski R, Bobek-Billewicz B, et al.
DALSA: Domain adaptation for supervised learning from sparsely annotated MR images. IEEE Trans Med Imaging 2016;35:184-96.
Allahverdi A, Akbarzadeh S, Moghaddam AK, Allahverdy A. Differentiating tumor and edema in brain magnetic resonance images using a convolutional neural network. Front Biomed Technol 2018;5:44-50.
Kapur T, Eric W, Grimson L, Kikinis R, Wells WM. “Enhanced Spatial Priors for Segmentation of Magnetic Resonance Imagery,” In International Conference on Medical Image Computing and Computer-Assisted Intervention; 1998. p. 457-68.
Bullmore E, Brammer M, Rouleau G, Everitt B, Simmons A, Sharma T, et al.
Computerized brain tissue classification of magnetic resonance images: A new approach to the problem of partial volume artifact. Neuroimage 1995;2:133-47.
Sujan M, Alam N, Noman SA, Islam MJ. A segmentation based automated system for brain tumor detection. Int J Comput Appl 2016;153:41-9.
Ilhan U, Ilhan A. Brain tumor segmentation based on a new threshold approach. Procedia Comput Sci 2017;120:580-7.
Salman YM. Modified technique for volumetric brain tumor measurements. J Biomed Sci Eng 2009;2:16.
Bajwa IS, Asghar MN, Naeem MA. Learning-based improved seeded region growing algorithm for brain tumor identification. Proc Pakistan Acad Sci 2017;54:127-33.
Deng W, Xiao W, Deng H, Liu J. MRI Brain Tumor Segmentation with Region Growing Method Based on the Gradients and Variances Along and Inside of the Boundary Curve,” in 2010 3rd
International Conference on Biomedical Engineering and Informatics; 2010. p. 393-6.
Kavitha A, Chellamuthu C, Rupa K. “An Efficient Approach for Brain Tumour Detection Based on Modified Region Growing and Neural Network in MRI Images,” in 2012 International Conference on Computing, Electronics and Electrical Technologies (ICCEET); 2012. p. 1087-95.
Otsu N. A threshold selection method from gray-level histograms. IEEE Trans Syst Man Cybern 1979;9:62-6.
Taheri S, Ong SH, Chong V. Level-set segmentation of brain tumors using a threshold-based speed function. Image Vis Comput 2010;28:26-37.
Park JW. Connectivity-based local adaptive thresholding for carotid artery segmentation using MRA images. Image Vis Comput 2005;23:1277-87.
Adams R, Bischof L. Seeded region growing. IEEE Trans Pattern Anal Mach Intell 1994;16:641-7.
Sato M, Lakare S, Wan M, Kaufman A, Nakajima M. “A Gradient Magnitude Based Region Growing Algorithm for Accurate Segmentation,” In Proceedings 2000 International Conference on Image Processing (Cat. No. 00CH37101); 2000. p. 448-51.
Lakare S, Kaufman A. “3D Segmentation Techniques for Medical Volumes.” Vol. 2000. Center for Visual Computing, Department of Computer Science, State University of New York; 2000. p. 59-68.
Gordillo N, Montseny E, Sobrevilla P. State of the art survey on MRI brain tumor segmentation. Magn Reson Imaging 2013;31:1426-38.
Khalid NE, Ibrahim S, Haniff P. MRI brain abnormalities segmentation using K-nearest neighbors (k-NN). Int J Comput Sci Eng 2011;3:980-90.
Steenwijk MD, Pouwels PJ, Daams M, van Dalen JW, Caan MW, Richard E, et al.
Accurate white matter lesion segmentation by k nearest neighbor classification with tissue type priors (kNN-TTPs). Neuroimage Clin 2013;3:462-9.
Kharrat A, Gasmi K, Messaoud MB, Benamrane N, Abid M. A hybrid approach for automatic classification of brain MRI using genetic algorithm and support vector machine. Leonardo J Sci 2010;17:71-82.
Chaddad A. Automated feature extraction in brain tumor by magnetic resonance imaging using gaussian mixture models. Int J Biomed Imaging 2015;2015:868031.
Koley S, Sadhu AK, Mitra P, Chakraborty B, Chakraborty C. Delineation and diagnosis of brain tumors from post contrast T1-weighted MR images using rough granular computing and random forest. Appl Soft Comput 2016;41:453-65.
Wang S, Zhang Y, Dong Z, Du S, Ji G, Yan J, et al.
Feed-forward neural network optimized by hybridization of PSO and ABC for abnormal brain detection. Int J Imaging Syst Technol 2015;25:153-64.
Damodharan S, Raghavan D. Combining tissue segmentation and neural network for brain tumor detection. Int Arab J Inf Technol 2015;12:42-52.
Vijay J, Subhashini J. “An Efficient Brain Tumor Detection Methodology Using K-means Clustering Algoriftnn,” In 2013 International Conference on Communication and Signal Processing; 2013. p. 653-7.
Bezdek JC, Hall LO, Clarke LP. Review of MR image segmentation techniques using pattern recognition. Med Phys 1993;20:1033-48.
Chang H, Chen Z, Huang Q, Shi J, Li X. Graph-based learning for segmentation of 3D ultrasound images. Neurocomputing 2015;151:632-44.
Pratondo A, Chui CK, Ong SH. Robust edge-stop functions for edge-based active contour models in medical image segmentation. IEEE Signal Proc Lett 2015;23:222-6.
Singh A. “Detection of Brain Tumor in MRI Images, Using Combination of Fuzzy c-Means and SVM,” In 2015 2nd
International Conference on Signal Processing and Integrated Networks (SPIN); 2015. p. 98-102.
Shenbagarajan A, Ramalingam V, Balasubramanian C, Palanivel S. Tumor diagnosis in MRI brain image using ACM segmentation and ANN-LM classification techniques. Indian J Sci Technol 2016;9:1-12.
Li C, Liu L, Sun X, Zhao J, Yin J. Image segmentation based on fuzzy clustering with cellular automata and features weighting. EURASIP J Image Video Proc 2019;2019:1-11.
Rundo L, Militello C, Russo G, Vitabile S, Gilardi MC, Mauri G. GTV cut for neuro-radiosurgery treatment planning: An MRI brain cancer seeded image segmentation method based on a cellular automata model. Nat Comput 2018;17:521-36.
Sompong C, Wongthanavasu S. An efficient brain tumor segmentation based on cellular automata and improved tumor-cut algorithm. Expert Syst Appl 2017;72:231-44.
Barik R, Naskar MN, Chowdhury S, Pal S. “Cancer Detection Using Cellular Automata Based Segmentation Techniques,” in 2021 Asian Conference on Innovation in Technology (ASIANCON); 2021. p. 1-6.
Menze BH, Jakab A, Bauer S, Kalpathy-Cramer J, Farahani K, Kirby J, et al.
The multimodal brain tumor image segmentation benchmark (BRATS). IEEE Trans Med Imaging 2015;34:1993-2024.
Selvapandian A, Manivannan K. Fusion based Glioma brain tumor detection and segmentation using ANFIS classification. Comput Methods Programs Biomed 2018;166:33-8.
Anitha R, Raja DS. Segmentation of glioma tumors using convolutional neural networks. Int J Imaging Syst Technol 2017;27:354-60.
Pereira S, Pinto A, Alves V, Silva CA. Brain tumor segmentation using convolutional neural networks in MRI images. IEEE Trans Med Imaging 2016;35:1240-51.
Urban G, Bendszus M, Hamprecht F, Kleesiek J. “Multi-Modal Brain Tumor Segmentation Using Deep Convolutional Neural Networks,” MICCAI BraTS (Brain Tumor Segmentation) Challenge. Proceedings, Winning Contribution; 2014. p. 31-5.
Islam A, Reza SM, Iftekharuddin KM. Multifractal texture estimation for detection and segmentation of brain tumors. IEEE Trans Biomed Eng 2013;60:3204-15.
[Figure 1], [Figure 2], [Figure 3], [Figure 4], [Figure 5]
[Table 1], [Table 2]