TY - GEN
T1 - Self-Adaptive Parameter Control in Differential Evolution Based on Optimizing Undersampling Strategies for Software Defect Prediction
AU - Lutfi, Moch
AU - Shiddiqi, Ary Mazharuddin
N1 - Publisher Copyright:
© 2026 by SCITEPRESS - Science and Technology Publications, Lda.
PY - 2026
Y1 - 2026
N2 - Data imbalance is a fundamental challenge in software defect prediction (SDP), as the dominance of non-defect classes biases models and reduces the ability to detect defective modules. Although Learning-to-Rank Undersampling (LTRUS) has been shown to be more effective than random undersampling; however, its performance still depends on the determination of static ranking weights (A), which are prone to stagnation during optimization. This study proposes an adaptive framework that integrates LTRUS with four variants of differential evolution, namely JADE, SHADE, L SHADE, and SaWDE, to dynamically optimize the weight (A). Experiments were conducted using a 5-fold cross-validation scheme and three classifiers: K-Nearest Neighbors, Logistic Regression, and Naïve Bayes. Performance was evaluated using AUC, Matthews Correlation Coefficient, Precision, Recall, and F Measure, along with statistical analysis based on the Shapiro-Wilk normality test and paired t-test. The results showed that JADE performed best on KNN, with AUC 0.725, MCC 0.356, and F Measure 0.450, and on Logistic Regression, with AUC 0.750, MCC 0.397, and F Measure 0.474. In Naïve Bayes, differential evolution was most effective with an AUC of 0.784, MCC of 0.441, and F Measure of 0.515. The results indicate that performance improvements are statistically significant in several cases, particularly for KNN and Logistic Regression, although not all comparisons show significant differences.
AB - Data imbalance is a fundamental challenge in software defect prediction (SDP), as the dominance of non-defect classes biases models and reduces the ability to detect defective modules. Although Learning-to-Rank Undersampling (LTRUS) has been shown to be more effective than random undersampling; however, its performance still depends on the determination of static ranking weights (A), which are prone to stagnation during optimization. This study proposes an adaptive framework that integrates LTRUS with four variants of differential evolution, namely JADE, SHADE, L SHADE, and SaWDE, to dynamically optimize the weight (A). Experiments were conducted using a 5-fold cross-validation scheme and three classifiers: K-Nearest Neighbors, Logistic Regression, and Naïve Bayes. Performance was evaluated using AUC, Matthews Correlation Coefficient, Precision, Recall, and F Measure, along with statistical analysis based on the Shapiro-Wilk normality test and paired t-test. The results showed that JADE performed best on KNN, with AUC 0.725, MCC 0.356, and F Measure 0.450, and on Logistic Regression, with AUC 0.750, MCC 0.397, and F Measure 0.474. In Naïve Bayes, differential evolution was most effective with an AUC of 0.784, MCC of 0.441, and F Measure of 0.515. The results indicate that performance improvements are statistically significant in several cases, particularly for KNN and Logistic Regression, although not all comparisons show significant differences.
KW - Adaptive Differential Evolution
KW - Learning to Rank
KW - Software Defect Prediction
KW - Under Sampling
UR - https://www.scopus.com/pages/publications/105046610492
U2 - 10.5220/0014959700004015
DO - 10.5220/0014959700004015
M3 - Conference contribution
AN - SCOPUS:105046610492
T3 - International Conference on Evaluation of Novel Approaches to Software Engineering, ENASE - Proceedings
SP - 532
EP - 539
BT - Proceedings of the 21th International Conference on Evaluation of Novel Approaches to Software Engineering, ENASE 2026
A2 - Mannion, Mike
A2 - Mannisto, Tomi
A2 - Maciaszek, Leszek
A2 - Maciaszek, Leszek
PB - Science and Technology Publications, Lda
T2 - 21th International Conference on Evaluation of Novel Approaches to Software Engineering, ENASE 2026
Y2 - 22 May 2026 through 24 May 2026
ER -