Categorical encoder based performance comparison in preprocessing imbalanced multiclass classification

Wiyli Yustanti, Nur Iriawan*, Irhamah

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

The contribution of this study is to offer suggestions for coding techniques for categorical predictor variables and comprehensive test scenarios to obtain significant performance results for imbalanced multiclass classification problems. We modify scenarios in the data mining process with the sample, explore, modify, model, and assess (SEMMA) framework coupled with statistical hypothesis testing to generalize the model performance evaluation conclusions as enhanced-SEMMA. We selected four open-source data sets with unequal class distributions and categorical predictors. Ordinal, nominal, dirichlet, frequency, target, leave one, one hot, dummy, binary, and hashing encoder methods are used. We use the grid-search technique to find the best hyperparameters. The F1-Score and area under the curve (AUC) are evaluated to select the optimal model. In all datasets with 10-fold stratified cross-validation and 95% to 99% accuracy for each dataset, the results show that support vector machine (SVM) outperforms the decision tree (DT) K-nearest neighbor (KNN), Naïve Bayes (NB), logistic regression (LR), and random forest (RF) algorithms. Probability-based or binary encodings, such as target, Dirichlet, dummy, one-hot, or binary, are best for situations with less than 3% of minor class proportions. Nominal or ordinal encoders are preferred for data with a minor class proportion of more than 3%.

Original languageEnglish
Pages (from-to)1705-1715
Number of pages11
JournalIndonesian Journal of Electrical Engineering and Computer Science
Volume31
Issue number3
DOIs
Publication statusPublished - Sept 2023

Keywords

  • Categorical encoding
  • Classification
  • Imbalanced
  • Multiclass
  • Performance analysis

Fingerprint

Dive into the research topics of 'Categorical encoder based performance comparison in preprocessing imbalanced multiclass classification'. Together they form a unique fingerprint.

Cite this