Dergi makalesi Açık Erişim

A new multi-objective hyperparameter optimization algorithm for COVID-19 detection from x-ray images

2024    Gülmez, Burak

A new multi-objective hyperparameter optimization algorithm for COVID-19 detection from x-ray images

Burak Gülmez

b.gulmez@liacs.leidenuniv.nl

Leiden Institute of Advanced Computer Science, Leiden University, Leiden, Netherlands

Abstract

The coronavirus occurred in Wuhan (China) first and it was declared a global pandemic. To detect coronavirus X-ray images can be used. Convolutional neural networks (CNNs) are used commonly to detect illness from images. There can be lots of different alternative deep CNN models or architectures. To find the best architecture, hyper-parameter optimization can be used. In this study, the problem is modeled as a multi-objective optimization (MOO) problem. Objective functions are multi-class cross entropy, error ratio, and complexity of the CNN network. For the best solutions to the objective functions, multi-objective hyper-parameter optimization is made by NSGA-III, NSGA-II, R-NSGA-II, SMS-EMOA, MOEA/D, and proposed Swarm Genetic Algorithms (SGA). SGA is a swarm-based algorithm with a cross-over process. All six algorithms are run and give Pareto optimal solution sets. When the figures obtained from the algorithms are analyzed and algorithm hypervolume values are compared, SGA outperforms the NSGA-III, NSGA-II, R-NSGA-II, SMS-EMOA, and MOEA/D algorithms. It can be concluded that SGA is better than others for multi-objective hyper-parameter optimization algorithms for COVID-19 detection from X-ray images. Also, a sensitivity analysis has been made to understand the effect of the number of the parameters of CNN on model success.

References

Abdullah JM, Rashid TA, Maaroof BB, Mirjalili S (2023) Multi-objective fitness-dependent optimizer algorithm. Neural Comput Applic 35:11969–11987. https://doi.org/10.1007/s00521-023-08332-3

Abraham A, Jain L (2005) Evolutionary multiobjective optimization. In: Abraham A, Jain L, Goldberg R (eds) Evolutionary Multiobjective optimization: theoretical advances and applications. Springer, London, pp 1–6

Akingbesote D, Zhan Y, Maskeliūnas R, Damaševičius R (2023) Improving Accuracy of Face Recognition in the era of Mask-Wearing: an evaluation of a pareto-optimized FaceNet Model with Data Preprocessing techniques. Algorithms 16. https://doi.org/10.3390/a16060292

Alhudhaif A, Polat K, Karaman O (2021) Determination of COVID-19 pneumonia based on generalized convolutional neural network model from chest X-ray images. Expert Syst Appl 180:115141. https://doi.org/10.1016/j.eswa.2021.115141

Beume N, Naujoks B, Emmerich M (2007) SMS-EMOA: multiobjective selection based on dominated hypervolume. Eur J Oper Res 181:1653–1669. https://doi.org/10.1016/j.ejor.2006.08.008

Cheng VC-C, Wong S-C, Chuang VW-M et al (2020) The role of community-wide wearing of face mask for control of coronavirus disease 2019 (COVID-19) epidemic due to SARS-CoV-2. J Infect 81:107–114. https://doi.org/10.1016/j.jinf.2020.04.024

Cho M, Kim Y (2021) FPGA-based convolutional neural network accelerator with resource-optimized approximate multiply-accumulate unit. Electronics 10:2859. https://doi.org/10.3390/electronics10222859

Çiğ H, Güllüoğlu MT, Er MB et al (2023) Enhanced Disease Detection using contrast limited adaptive Histogram equalization and multi-objective cuckoo search in Deep Learning. Trait Signal 40:915–925. https://doi.org/10.18280/ts.400308

Covid-19 Image Dataset https://www.kaggle.com/datasets/pranavraikokte/covid19-image-dataset. Accessed 15 Aug 2022

Coxon K, Turienzo CF, Kweekel L et al (2020) The impact of the coronavirus (COVID-19) pandemic on maternity care in Europe. Midwifery 88:102779. https://doi.org/10.1016/j.midw.2020.102779

Deb K, Pratap A, Agarwal S, Meyarivan T (2002) A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans Evol Comput 6:182–197. https://doi.org/10.1109/4235.996017

Dhiman G, Vinoth Kumar V, Kaur A, Sharma A (2021) DON: deep learning and optimization-based Framework for detection of Novel Coronavirus Disease using X-ray images. Interdiscip Sci Comput Life Sci 13:260–272. https://doi.org/10.1007/s12539-021-00418-7

Dhiman G, Chang V, Kant Singh K, Shankar A (2022) ADOPT: automatic deep learning and optimization-based approach for detection of novel coronavirus COVID-19 disease using X-ray images. J Biomol Struct Dyn 40:5836–5847. https://doi.org/10.1080/07391102.2021.1875049

Filatovas E, Lančinskas A, Kurasova O, Žilinskas J (2017) A preference-based multi-objective evolutionary algorithm R-NSGA-II with stochastic local search. Cent Eur J Oper Res 25:859–878. https://doi.org/10.1007/s10100-016-0443-x

Goel T, Murugan R, Mirjalili S, Chakrabartty DK (2022) Multi-COVID-Net: multi-objective optimized network for COVID-19 diagnosis from chest X-ray images. Appl Soft Comput 115:108250. https://doi.org/10.1016/j.asoc.2021.108250

Gülmez B (2022) Demand forecasting and production planning in a factory with time series analysis. In: International Research in Engineering Sciences. Egitim Publishing, Konya, pp 57–74

Gülmez B (2022) MonkeypoxHybridNet: A hybrid deep convolutional neural network model for monkeypox disease detection. In: International Research in Engineering Sciences. Egitim Publishing, Konya, pp 49–64

Gülmez B (2023) A novel deep neural network model based Xception and genetic algorithm for detection of COVID-19 from X-ray images. Ann Oper Res 328:617–641. https://doi.org/10.1007/s10479-022-05151-y

Gülmez B (2023) Optimizing and comparison of market chain product distribution problem with different genetic algorithm versions. Osmaniye Korkut Ata Univ J Inst Sci Technol 6:180–196. https://doi.org/10.47495/okufbed.1117220

Gülmez B (2023) Stock price prediction with optimized deep LSTM network with artificial rabbits optimization algorithm. Expert Syst Appl 227:120346. https://doi.org/10.1016/j.eswa.2023.120346

Gülmez B (2023) A novel deep learning model with the Grey Wolf Optimization algorithm for cotton disease detection. J Univers Comput Sci 6:595–626. https://doi.org/10.3897/jucs.94183

Gülmez B, Kulluk S (2019) Social spider algorithm for training artificial neural networks. International J Business Anal 6:32–49. https://doi.org/10.4018/IJBAN.2019100103

Gülmez B, Kulluk S (2023) Analysis and price prediction of secondhand vehicles in Türkiye with big data and machine learning techniques. J Faculty Eng Arch Gazi Univ 38:2279–2290. https://doi.org/10.17341/gazimmfd.980840

Gülmez B (2024) Advancements in rice disease detection through convolutional neural networks: A comprehensive review. Heliyon 10:e33328. https://doi.org/10.1016/j.heliyon.2024.e33328

Gülmez B, Emmerich M, Fan Y (2024) Multi-objective optimization for green delivery routing problems with flexible time windows. Appl Artif Intell 38:2325302. https://doi.org/10.1080/08839514.2024.2325302

Gunantara N (2018) A review of multi-objective optimization: methods and its applications. Cogent Eng 5:1502242. https://doi.org/10.1080/23311916.2018.1502242

Gupta V, Vasudev M, Doegar A, Sambyal N (2021) Breast cancer detection from histopathology images using modified residual neural networks. Biocybernetics Biomedical Eng 41:1272–1287. https://doi.org/10.1016/j.bbe.2021.08.011

Hajiakhondi-Meybodi Z, Mohammadi A, Abouei J (2021) Deep reinforcement learning for trustworthy and time-varying connection scheduling in a coupled UAV-based femtocaching architecture. IEEE Access 9:32263–32281. https://doi.org/10.1109/ACCESS.2021.3060323

Igel C (2005) Multi-objective model selection for support Vector machines. In: Coello Coello CA, Hernández Aguirre A, Zitzler E (eds) Evolutionary Multi-criterion optimization. Springer, Berlin, Heidelberg, pp 534–546

Kim M (2021) Prediction of COVID-19 confirmed cases after vaccination: based on statistical and deep learning models. SciMedicine J 3:153–165. https://doi.org/10.28991/SciMedJ-2021-0302-7

Kiziloluk S, Sert E (2022) COVID-CCD-Net: COVID-19 and colon cancer diagnosis system with optimized CNN hyperparameters using gradient-based optimizer. Med Biol Eng Comput 60:1595–1612. https://doi.org/10.1007/s11517-022-02553-9

Lakhmiri D, Digabel SL, Tribes C (2021) HyperNOMAD: hyperparameter optimization of deep neural networks using mesh adaptive direct search. ACM Trans Math Softw 47:27:1–2727. https://doi.org/10.1145/3450975

Liang J, Xu W, Yue C et al (2019) Multimodal multiobjective optimization with differential evolution. Swarm Evol Comput 44:1028–1059. https://doi.org/10.1016/j.swevo.2018.10.016

Lim YT, Cheng P-C, Rohatgi P, Clark JA (2009) Dynamic security policy learning. In: Proceedings of the first ACM workshop on Information security governance. Association for Computing Machinery, New York, NY, USA, pp 39–48

Liu X, Tian J, Duan P et al (2024) GrMoNAS: a granularity-based multi-objective NAS framework for efficient medical diagnosis. Comput Biol Med 171. https://doi.org/10.1016/j.compbiomed.2024.108118

Mohammedqasem R, Mohammedqasim H, Asad Ali Biabani S et al (2023) Multi-objective deep learning framework for COVID-19 dataset problems. J King Saud Univ Sci 35. https://doi.org/10.1016/j.jksus.2022.102527

Muthumayil K, Buvana M, Sekar KR et al (2021) Optimized convolutional neural network for automatic detection of COVID-19. Comput Mater Continua 70:1159–1175. https://doi.org/10.32604/cmc.2022.017178

Mutlu MM (2021) Multi-objective and multi-modal network design model for a competitive public transportation system. Ege University

Ortaçay Z (2020) Multi-objective optimization based reallocation in land consolidation. Konya Technical University

Osman AA, Al Daajani MM, Alsahafi AJ (2020) Re-positive coronavirus disease 2019 PCR test: could it be a reinfection? New Microbes New Infections 37:100748. https://doi.org/10.1016/j.nmni.2020.100748

Rahman CM, Rashid TA, Ahmed AM, Mirjalili S (2022) Multi-objective learner performance-based behavior algorithm with five multi-objective real-world engineering problems. Neural Comput Applic 34:6307–6329. https://doi.org/10.1007/s00521-021-06811-z

Raikote, P. Covid-19 Image Dataset, https://www.kaggle.com/datasets/pranavraikokte/covid19-image-dataset (2020).

Rajagopal R, Karthick R, Meenalochini P, Kalaichelvi T (2023) Deep Convolutional spiking neural network optimized with arithmetic optimization algorithm for lung disease detection using chest X-ray images. Biomed Signal Process Control 79. https://doi.org/10.1016/j.bspc.2022.104197

Sarıgül M, Ozyildirim BM, Avci M (2019) Differential convolutional neural network. Neural Netw 116:279–287. https://doi.org/10.1016/j.neunet.2019.04.025

Sayed GI (2022) A Novel Multi-objective Rat Swarm optimizer-based convolutional neural networks for the diagnosis of COVID-19 Disease. Autom Control Comput Sci 56:198–208. https://doi.org/10.3103/S0146411622030075

Shukla PK, Sandhu JK, Ahirwar A et al (2021) Multiobjective Genetic Algorithm and convolutional neural network based COVID-19 identification in chest X-Ray images. https://doi.org/10.1155/2021/7804540. Math Probl Eng 2021:

Singh D, Kumar V, Yadav V, Kaur M (2021) Deep neural network-based screening model for COVID-19-Infected patients using chest X-Ray images. Int J Pattern Recognit Artif Intell 35. https://doi.org/10.1142/S0218001421510046

Singha AK, Pathak N, Sharma N et al (2022) An Experimental Approach to diagnose Covid-19 using optimized CNN. Intell Autom Soft Comp 34:1065–1080. https://doi.org/10.32604/iasc.2022.024172

Song X, Wu N, Song S et al (2023a) Bipartite synchronization for cooperative-competitive neural networks with reaction–diffusion terms via dual event-triggered mechanism. Neurocomputing 550:126498. https://doi.org/10.1016/j.neucom.2023.126498

Song X, Wu N, Song S, Stojanovic V (2023b) Switching-like event-triggered state estimation for reaction–diffusion neural networks against DoS attacks. Neural Process Lett 55:8997–9018. https://doi.org/10.1007/s11063-023-11189-1

Xu Y, Du J, Dai L-R, Lee C-H (2014) An experimental study on Speech Enhancement based on deep neural networks. IEEE Signal Process Lett 21:65–68. https://doi.org/10.1109/LSP.2013.2291240

Yani M, Si SMTBI, MTCS ST (2019) Application of transfer learning using Convolutional Neural Network Method for Early Detection of Terry’s nail. J Phys: Conf Ser 1201:012052. https://doi.org/10.1088/1742-6596/1201/1/012052

Zhang Q, Li H (2007) MOEA/D: a Multiobjective Evolutionary Algorithm based on decomposition. IEEE Trans Evol Comput 11:712–731. https://doi.org/10.1109/TEVC.2007.892759

Zhuang Z, Tao H, Chen Y et al (2023) An optimal iterative Learning Control Approach for Linear Systems with Nonuniform Trial Lengths under Input constraints. IEEE Trans Syst Man Cybernetics: Syst 53:3461–3473. https://doi.org/10.1109/TSMC.2022.3225381