Skip to main content

Advertisement

Log in

A comprehensive comparison of accuracy-based fitness functions of metaheuristics for feature selection

  • Application of soft computing
  • Published:
Soft Computing Aims and scope Submit manuscript

Abstract

The feature selection (FS) is a binary optimization problem in the discrete optimization problem category. Maximizing the accuracy by using fewer features is the main aim of FS. Metaheuristic algorithms are widely used for FS in literature. Redundant and irrelevant features are selected/unselected by a binary metaheuristic optimization algorithm for FS. Search in a metaheuristic optimization algorithm is directed with a fitness function. The type and landscape of the search space affect the success of the algorithm. Generally, accuracy-based fitness functions of metaheuristic algorithms are used for FS. In this work, eleven existing and six novel fitness functions are analyzed on eleven various datasets with a novel binary threshold Lévy flight distribution (BTLFD) algorithm. The large datasets (Yale, ORL, and COIL20) have 1024 features. The medium datasets (SpectEW, BreastEW, Ionosphere, and SonarEW) has 22–60 features. The small datasets (Tic-tac-toe, WineEW, Zoo, and Lymphography) have 9–18 features. K-nearest neighbor is used as a classifier with five-fold cross-validation and the experimental results showed that three rarely used fitness functions produced more accurate solutions. In the comparisons, BTFLD outperformed 8 state-of-the-art metaheuristic algorithms on 21 datasets for FS.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

Data availability

Enquiries about data availability should be directed to the authors.

References

  • Abdel-Basset M, Ding W, El-Shahat D (2020a) A hybrid Harris Hawks optimization algorithm with simulated annealing for feature selection. Artif Intell Rev 154:1–45

    Google Scholar 

  • Abdel-Basset M, El-Shahat D, El-henawy I, de Albuquerque VHC, Mirjalili S (2020b) A new fusion of grey wolf optimizer algorithm with a two-phase mutation for feature selection. Expert Syst Appl 139:112824

    Google Scholar 

  • Agrawal R, Kaur B, Sharma S (2020) Quantum based whale optimization algorithm for wrapper feature selection. Appl Soft Comput 89:106092

    Google Scholar 

  • Agrawal P, Abutarboush HF, Ganesh T, Mohamed AW (2021a) Metaheuristic algorithms on feature selection: a survey of one decade of research (2009–2019). IEEE Access 9:26766–26791

    Google Scholar 

  • Agrawal P, Ganesh T, Mohamed AW (2021b) Chaotic gaining sharing knowledge-based optimization algorithm: an improved metaheuristic algorithm for feature selection. Soft Comput 25(14):9505–9528

    Google Scholar 

  • Agrawal P, Ganesh T, Mohamed AW (2021c) A novel binary gaining–sharing knowledge-based optimization algorithm for feature selection. Neural Comput Appl 33(11):5989–6008

    Google Scholar 

  • Agrawal P, Ganesh T, Oliva D, Mohamed AW (2022) S-shaped and V-shaped gaining-sharing knowledge-based algorithm for feature selection. Appl Intell 52(1):81–112

    Google Scholar 

  • Al-Betar MA, Hammouri AI, Awadallah MA, Doush IA (2020) Binary β-hill climbing optimizer with S-shape transfer function for feature selection. J Ambient Intell Humaniz Comput 12:1–29

    Google Scholar 

  • Al-Tashi Q, Kadir SJA, Rais HM, Mirjalili S, Alhussian H (2019) Binary optimization using hybrid grey wolf optimization for feature selection. IEEE Access 7:39496–39508

    Google Scholar 

  • Alweshah M, Al Khalaileh S, Gupta BB, Almomani A, Hammouri AI, Al-Betar MA (2020) The monarch butterfly optimization algorithm for solving feature selection problems. Neural Comput Appl 34:1–15

    Google Scholar 

  • Arora S, Anand P (2019) Binary butterfly optimization approaches for feature selection. Expert Syst Appl 116:147–160

    Google Scholar 

  • Arora S, Sharma M, Anand P (2020) A novel chaotic interior search algorithm for global optimization and feature selection. Appl Artif Intell 34(4):292–328

    Google Scholar 

  • Asuncion A, Newman D (2007) UCI machine learning repository. Irvine, CA, USA

  • Awadallah MA, Al-Betar MA, Hammouri AI, Alomari OA (2020) Binary JAYA algorithm with adaptive mutation for feature selection. Arab J Sci Eng 45(12):10875–10890

    Google Scholar 

  • Babalik A, Cinar AC, Kiran MS (2018a) A modification of tree-seed algorithm using Deb’s rules for constrained optimization. Appl Soft Comput 63:289–305

    Google Scholar 

  • Babalik A, Ozkis A, Uymaz SA, Kiran MS (2018b) A multi-objective artificial algae algorithm. Appl Soft Comput 68:377–395

    Google Scholar 

  • Brezočnik L, Fister I, Podgorelec V (2018) Swarm intelligence algorithms for feature selection: a review. Appl Sci 8(9):1521

    Google Scholar 

  • Chegini SN, Bagheri A, Najafi F (2018) PSOSCALF: A new hybrid PSO based on Sine Cosine Algorithm and Levy flight for solving optimization problems. Appl Soft Comput 73:697–726

    Google Scholar 

  • Chuang L-Y, Chang H-W, Tu C-J, Yang C-H (2008) Improved binary PSO for feature selection using gene expression data. Comput Biol Chem 32(1):29–38

    MATH  Google Scholar 

  • Cinar AC, Kiran MS (2018) Similarity and logic gate-based tree-seed algorithms for binary optimization. Comput Ind Eng 115:631–646

    Google Scholar 

  • Derrac J, García S, Molina D, Herrera F (2011) A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms. Swarm Evol Comput 1(1):3–18

    Google Scholar 

  • Ding Y, Zhou K, Bi W (2020) Feature selection based on hybridization of genetic algorithm and competitive swarm optimizer. Soft Comput 24:1–10

    Google Scholar 

  • El-Kenawy E-SM, Eid MM, Saber M, Ibrahim A (2020) MbGWO-SFS: modified binary grey wolf optimizer based on stochastic fractal search for feature selection. IEEE Access 8:107635–107649

    Google Scholar 

  • Emary E, Zawbaa HM (2019) Feature selection via Lèvy Antlion optimization. Pattern Anal Appl 22(3):857–876

    MathSciNet  Google Scholar 

  • Emary E, Zawbaa HM, Hassanien AE (2016a) Binary ant lion approaches for feature selection. Neurocomputing 213:54–65

    Google Scholar 

  • Emary E, Zawbaa HM, Hassanien AE (2016b) Binary grey wolf optimization approaches for feature selection. Neurocomputing 172:371–381

    Google Scholar 

  • Emary E, Zawbaa HM, Sharawi M (2019) Impact of Lèvy flight on modern meta-heuristic optimizers. Appl Soft Comput 75:775–789

    Google Scholar 

  • Emine B, Ülker E (2020) An efficient binary social spider algorithm for feature selection problem. Expert Syst Appl 146:113185

    Google Scholar 

  • Enache A-C, Sgarciu V, Petrescu-Niţă A (2015) Intelligent feature selection method rooted in Binary Bat Algorithm for intrusion detection. In: Paper presented at the 2015 IEEE 10th jubilee international symposium on applied computational intelligence and informatics

  • Faris H, Mafarja MM, Heidari AA, Aljarah I, Ala’M A-Z, Mirjalili S, Fujita H (2018) An efficient binary salp swarm algorithm with crossover scheme for feature selection problems. Knowl Based Syst 154:43–67

    Google Scholar 

  • Gao Y, Zhou Y, Luo Q (2020) An efficient binary equilibrium optimizer algorithm for feature selection. IEEE Access 8:140936–140963

    Google Scholar 

  • Gholami J, Pourpanah F, Wang X (2020) Feature selection based on improved binary global harmony search for data classification. Appl Soft Comput 93:106402

    Google Scholar 

  • Ghosh KK, Singh PK, Hong J, Geem ZW, Sarkar R (2020) Binary social mimic optimization algorithm with X-shaped transfer function for feature selection. IEEE Access 8:97890–97906

    Google Scholar 

  • Guha R, Ghosh M, Chakrabarti A, Sarkar R, Mirjalili S (2020a) Introducing clustering based population in binary gravitational search algorithm for feature selection. Appl Soft Comput 93:106341

    Google Scholar 

  • Guha R, Ghosh M, Mutsuddi S, Sarkar R, Mirjalili S (2020b) Embedded chaotic whale survival algorithm for filter-wrapper feature selection. Soft Comput 24:12821–12843

    Google Scholar 

  • Haklı H, Uğuz H (2014) A novel particle swarm optimization algorithm with Levy flight. Appl Soft Comput 23:333–345

    Google Scholar 

  • Hammouri AI, Mafarja M, Al-Betar MA, Awadallah MA, Abu-Doush I (2020) An improved dragonfly algorithm for feature selection. Knowl Based Syst 203:106131

    Google Scholar 

  • Han C, Zhou G, Zhou Y (2019) Binary symbiotic organism search algorithm for feature selection and analysis. IEEE Access 7:166833–166859

    Google Scholar 

  • He X, Zhang Q, Sun N, Dong Y (2009) Feature selection with discrete binary differential evolution. Paper presented at the 2009 international conference on artificial intelligence and computational intelligence

  • Hegazy AE, Makhlouf M, El-Tawel GS (2020) Improved salp swarm algorithm for feature selection. J King Saud Univ Comput Inf Sci 32(3):335–344

    Google Scholar 

  • Heidari AA, Pahlavani P (2017) An efficient modified grey wolf optimizer with Lévy flight for optimization tasks. Appl Soft Comput 60:115–134

    Google Scholar 

  • Houssein EH, Saad MR, Hashim FA, Shaban H, Hassaballah M (2020) Lévy flight distribution: a new metaheuristic algorithm for solving engineering optimization problems. Eng Appl Artif Intell 94:103731

    Google Scholar 

  • Hu B, Dai Y, Su Y, Moore P, Zhang X, Mao C, Chen J, Xu L (2016) Feature selection for optimized high-dimensional biomedical data using an improved shuffled frog leaping algorithm. IEEE/ACM Trans Comput Biol Bioinform 15(6):1765–1773

    Google Scholar 

  • Hussien, A. G., Houssein, E. H., & Hassanien, A. E. (2017). A binary whale optimization algorithm with hyperbolic tangent fitness function for feature selection. Paper presented at the 2017 Eighth International Conference on Intelligent Computing and Information Systems (ICICIS).

  • Jensi R, Jiji GW (2016) An enhanced particle swarm optimization with levy flight for global optimization. Appl Soft Comput 43:248–261

    Google Scholar 

  • Jia H, Li J, Song W, Peng X, Lang C, Li Y (2019) Spotted hyena optimization algorithm with simulated annealing for feature selection. IEEE Access 7:71943–71962

    Google Scholar 

  • Jiang Y, Luo Q, Wei Y, Abualigah L, Zhou Y (2021) An efficient binary gradient-based optimizer for feature selection. Math Biosci Eng 18(4):3813–3854

    MATH  Google Scholar 

  • Karakoyun M, Ozkis A, Kodaz H (2020) A new algorithm based on gray wolf optimizer and shuffled frog leaping algorithm to solve the multi-objective optimization problems. Appl Soft Comput 96:106560

    Google Scholar 

  • Karasekreter N, Şahman MA, Başçiftçi F, Fidan U (2020) PSO-based clustering for the optimization of energy consumption in wireless sensor network. Emerg Mater Res 9(3):776–783

    Google Scholar 

  • Kaya E (2021) A comprehensive study of parameters analysis for galactic swarm optimization. Int J Intell Syst Appl Eng 9(1):28–37

    Google Scholar 

  • Khurma RA, Aljarah I, Sharieh A (2021) A Simultaneous moth flame optimizer feature selection approach based on levy flight and selection operators for medical diagnosis. Arab J Sci Eng 46:1–26

    Google Scholar 

  • Kiran MS (2015) TSA: tree-seed algorithm for continuous optimization. Expert Syst Appl 42(19):6686–6698

    Google Scholar 

  • Korkmaz S, Kiran MS (2018) An artificial algae algorithm with stigmergic behavior for binary optimization. Appl Soft Comput 64:627–640

    Google Scholar 

  • Korkmaz S, Babalik A, Kiran MS (2018) An artificial algae algorithm for solving binary optimization problems. Int J Mach Learn Cybern 9(7):1233–1247

    Google Scholar 

  • Liu M, Yao X, Li Y (2020) Hybrid whale optimization algorithm enhanced with Lévy flight and differential evolution for job shop scheduling problems. Appl Soft Comput 87:105954

    Google Scholar 

  • Mafarja M, Mirjalili S (2018) Whale optimization approaches for wrapper feature selection. Appl Soft Comput 62:441–453

    Google Scholar 

  • Mafarja MM, Eleyan D, Jaber I, Hammouri A, Mirjalili S (2017) Binary dragonfly algorithm for feature selection. In: Paper presented at the 2017 international conference on new trends in computing sciences (ICTCS)

  • Mafarja M, Aljarah I, Heidari AA, Hammouri AI, Faris H, Ala’M A-Z, Mirjalili S (2018) Evolutionary population dynamics and grasshopper optimization approaches for feature selection problems. Knowl Based Syst 145:25–45

    Google Scholar 

  • Mafarja M, Aljarah I, Faris H, Hammouri AI, Ala’M A-Z, Mirjalili S (2019) Binary grasshopper optimisation algorithm approaches for feature selection problems. Expert Syst Appl 117:267–286

    Google Scholar 

  • Magdziarz M, Szczotka W (2016) Quenched trap model for Lévy flights. Commun Nonlinear Sci Numer Simul 30(1–3):5–14

    MathSciNet  MATH  Google Scholar 

  • Mohamed A-AA, Hassan S, Hemeida A, Alkhalaf S, Mahmoud M, Eldin AMB (2020) Parasitism-predation algorithm (PPA): a novel approach for feature selection. Ain Shams Eng J 11(2):293–308

    Google Scholar 

  • Nadimi-Shahraki MH, Zamani H (2022) DMDE: diversity-maintained multi-trial vector differential evolution algorithm for non-decomposition large-scale global optimization. Expert Syst Appl 198:116895

    Google Scholar 

  • Nadimi-Shahraki MH, Fatahi A, Zamani H, Mirjalili S (2022a) Binary approaches of quantum-based avian navigation optimizer to select effective features from high-dimensional medical data. Mathematics 10(15):2770

    Google Scholar 

  • Nadimi-Shahraki MH, Zamani H, Mirjalili S (2022b) Enhanced whale optimization algorithm for medical feature selection: a COVID-19 case study. Comput Biol Med 148:105858

    Google Scholar 

  • Nakamura RY, Pereira LA, Costa KA, Rodrigues D, Papa JP, Yang X-S (2012) BBA: a binary bat algorithm for feature selection. In: Paper presented at the 2012 25th SIBGRAPI conference on graphics, patterns and images

  • Nguyen BH, Xue B, Zhang M (2020) A survey on swarm intelligence approaches to feature selection in data mining. Swarm Evol Comput 54:100663

    Google Scholar 

  • Ouadfel S, Abd Elaziz M (2020) Enhanced crow search algorithm for feature selection. Expert Syst Appl 159:113572

    Google Scholar 

  • Özkış A, Babalık A (2017) A novel metaheuristic for multi-objective optimization problems: the multi-objective vortex search algorithm. Inf Sci 402:124–148

    Google Scholar 

  • Pourpanah F, Shi Y, Lim CP, Hao Q, Tan CJ (2019) Feature selection based on brain storm optimization for data classification. Appl Soft Comput 80:761–775

    Google Scholar 

  • Purushothaman R, Rajagopalan S, Dhandapani G (2020) Hybridizing gray wolf optimization (GWO) with grasshopper optimization algorithm (GOA) for text feature selection and clustering. Appl Soft Comput 96:106651

    Google Scholar 

  • Sag T, Cunkas M (2016) A new ABC-based multiobjective optimization algorithm with an improvement approach (IBMO: improved bee colony algorithm for multiobjective optimization). Turk J Electr Eng Comput Sci 24(4):2349–2373

    Google Scholar 

  • Şahman MA (2021) A discrete spotted hyena optimizer for solving distributed job shop scheduling problems. Appl Soft Comput 106:107349

    Google Scholar 

  • Şahman MA, Çunkaş M, İnal Ş, İnal F, Coşkun B, Taşkiran U (2009) Cost optimization of feed mixes by genetic algorithms. Adv Eng Softw 40(10):965–974

    MATH  Google Scholar 

  • Sahman MA, Altun AA, Dündar AO (2017) The binary differential search algorithm approach for solving uncapacitated facility location problems. J Comput Theor Nanosci 14(1):670–684

    Google Scholar 

  • Şahman MA, Altun AA, Dündar AO (2018) A new MILP model proposal in feed formulation and using a hybrid-linear binary PSO (H-LBP) approach for alternative solutions. Neural Comput Appl 29(2):537–552

    Google Scholar 

  • Sheikh KH, Ahmed S, Mukhopadhyay K, Singh PK, Yoon JH, Geem ZW, Sarkar R (2020) EHHM: electrical harmony based hybrid meta-heuristic for feature selection. IEEE Access 8:158125–158141

    Google Scholar 

  • Tahir M, Tubaishat A, Al-Obeidat F, Shah B, Halim Z, Waqas M (2020) A novel binary chaotic genetic algorithm for feature selection and its utility in affective computing and healthcare. Neural Comput Appl 34:1–22

    Google Scholar 

  • Tang D, Yang J, Dong S, Liu Z (2016) A Lévy flight-based shuffled frog-leaping algorithm and its applications for continuous optimization problems. Appl Soft Comput 49:641–662

    Google Scholar 

  • Too J, Abdullah AR (2020) Chaotic atom search optimization for feature selection. Arab J Sci Eng 45:1–17

    Google Scholar 

  • Too J, Mirjalili S (2021) General learning equilibrium optimizer: a new feature selection method for biological data classification. Appl Artif Intell 35(3):247–263

    Google Scholar 

  • Too J, Abdullah AR, Mohd Saad N, Tee W (2019) EMG feature selection and classification using a Pbest-guide binary particle swarm optimization. Computation 7(1):12

    Google Scholar 

  • Tu Q, Chen X, Liu X (2019) Multi-strategy ensemble grey wolf optimizer and its application to feature selection. Appl Soft Comput 76:16–30

    Google Scholar 

  • Tubishat M, Ja’afar S, Alswaitti M, Mirjalili S, Idris N, Ismail MA, Omar MS (2020) Dynamic salp swarm algorithm for feature selection. Expert Syst Appl 164:113873

    Google Scholar 

  • Turkoglu B, Uymaz SA, Kaya E (2022) Binary artificial algae algorithm for feature selection. Appl Soft Comput 120:108630

    Google Scholar 

  • Uymaz SA, Tezel G, Yel E (2015) Artificial algae algorithm (AAA) for nonlinear global optimization. Appl Soft Comput 31:153–171

    Google Scholar 

  • Wang Y, Li T (2020) Local feature selection based on artificial immune system for classification. Appl Soft Comput 87:105989

    Google Scholar 

  • Wang R, Zhou Y, Qiao S, Huang K (2016) Flower pollination algorithm with bee pollinator for cluster analysis. Inf Process Lett 116(1):1–14

    Google Scholar 

  • Wang X-H, Zhang Y, Sun X-Y, Wang Y-L, Du C-H (2020) Multi-objective feature selection based on artificial bee colony: an acceleration approach with variable sample size. Appl Soft Comput 88:106041

    Google Scholar 

  • Wei W, Chen S, Lin Q, Ji J, Chen J (2020) A multi-objective immune algorithm for intrusion feature selection. Appl Soft Comput 95:106522

    Google Scholar 

  • Xue B, Zhang M, Browne WN (2012a) New fitness functions in binary particle swarm optimisation for feature selection. In: Paper presented at the 2012a IEEE congress on evolutionary computation

  • Xue B, Zhang M, Browne WN (2012b) Particle swarm optimization for feature selection in classification: a multi-objective approach. IEEE Trans Cybern 43(6):1656–1671

    Google Scholar 

  • Xue B, Zhang M, Browne WN, Yao X (2015) A survey on evolutionary computation approaches to feature selection. IEEE Trans Evol Comput 20(4):606–626

    Google Scholar 

  • Xue Y, Tang T, Pang W, Liu AX (2020) Self-adaptive parameter and strategy based particle swarm optimization for large-scale feature selection problems with multiple classifiers. Appl Soft Comput 88:106031

    Google Scholar 

  • Yang X-S, Cui Z, Xiao R, Gandomi AH, Karamanoglu M (2013) Swarm intelligence and bio-inspired computation: theory and applications. Newnes, Lithgow

    Google Scholar 

  • Zamani H, Nadimi-Shahraki MH, Gandomi AH (2021) QANA: quantum-based avian navigation optimizer algorithm. Eng Appl Artif Intell 104:104314

    Google Scholar 

  • Zamani H, Nadimi-Shahraki MH, Gandomi AH (2022) Starling murmuration optimizer: a novel bio-inspired algorithm for global and engineering optimization. Comput Methods Appl Mech Eng 392:114616

    MathSciNet  MATH  Google Scholar 

  • Zawbaa HM, Emary E, Grosan C, Snasel V (2018) Large-dimensionality small-instance set feature selection: a hybrid bio-inspired heuristic approach. Swarm Evol Comput 42:29–42

    Google Scholar 

  • Zhang H, Xie J, Hu Q, Shao L, Chen T (2018) A hybrid DPSO with Levy flight for scheduling MIMO radar tasks. Appl Soft Comput 71:242–254

    Google Scholar 

  • Zhou B, Liao X (2020) Particle filter and Levy flight-based decomposed multi-objective evolution hybridized particle swarm for flexible job shop greening scheduling with crane transportation. Appl Soft Comput 91:106217

    Google Scholar 

Download references

Funding

The authors wish to thank Scientific Research Projects Coordinatorship at Selcuk University and The Scientific and Technological Research Council of Turkey for their institutional supports.

Author information

Authors and Affiliations

Authors

Contributions

Conceptualization: ACC; Methodology: ACC; Writing—original draft preparation: ACC; Writing—review and editing: ACC; Supervision: ACC.

Corresponding author

Correspondence to Ahmet Cevahir Cinar.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Ethical approval

This article does not contain any studies with human or animal subjects.

Informed consent

Informed consent was obtained from all individual participants included in the study.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Below is the link to the electronic supplementary material.

Supplementary file1 (DOCX 430 KB)

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Cinar, A.C. A comprehensive comparison of accuracy-based fitness functions of metaheuristics for feature selection. Soft Comput 27, 8931–8958 (2023). https://doi.org/10.1007/s00500-023-08414-3

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00500-023-08414-3

Keywords

Navigation

pFad - Phonifier reborn

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.


Alternative Proxies:

Alternative Proxy

pFad Proxy

pFad v3 Proxy

pFad v4 Proxy