Fractional Gradient Descent Optimizer for Linear Classifier Support Vector Machine

Dian Puspita Hapsari, Imam Utoyo, Santi Wulan Purnami

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

5 Citations (Scopus)

Abstract

Supervised learning is one of the activities in data mining that aims to classify or predict data. One of the powerful supervised learning algorithms is the Support Vector Machine which is included in the linear classifier. In data prediction activities, efforts are needed to improve the accuracy of predictions by optimizing parameters in the classification algorithm. In this study, the proposed Fractional Gradient Descent as an unconstraint optimization algorithm on objective functions in the SVM classifier. With Fractional Gradient Descent as an optimizer classification model in training data activities to progress the exactness of prediction models. Fractional Gradient Descentoptimizes the SVM classification model using fractional values so that it has small steps with a small learning rate in the process of reaching global minimums, and achieving convergence with lower iterations. With a learning rate of 0.0001 SVM Classifier with fractional gradient descent have error rate = 0.273083, at learning rate 0.001 with error rate = 0.273070, and at learning rate 0.01 with error rate = 0.273134. The results of the SVM Classifier with stochastic gradient descent optimization reach the convergence point at iteration 350. With fractional gradient descent optimization,it reaches a convergence point of 50 iterations smaller than the SVM Classifier with stochastic gradient descent.

Original languageEnglish
Title of host publicationProceeding - 2020 3rd International Conference on Vocational Education and Electrical Engineering
Subtitle of host publicationStrengthening the framework of Society 5.0 through Innovations in Education, Electrical, Engineering and Informatics Engineering, ICVEE 2020
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781728174341
DOIs
Publication statusPublished - 3 Oct 2020
Event3rd International Conference on Vocational Education and Electrical Engineering, ICVEE 2020 - Virtual, Surabaya, Indonesia
Duration: 3 Oct 20204 Oct 2020

Publication series

NameProceeding - 2020 3rd International Conference on Vocational Education and Electrical Engineering: Strengthening the framework of Society 5.0 through Innovations in Education, Electrical, Engineering and Informatics Engineering, ICVEE 2020

Conference

Conference3rd International Conference on Vocational Education and Electrical Engineering, ICVEE 2020
Country/TerritoryIndonesia
CityVirtual, Surabaya
Period3/10/204/10/20

Keywords

  • Data Mining
  • Fractional Gradient Descent
  • Optimization
  • Supervised learning
  • Support Vector Machine

Fingerprint

Dive into the research topics of 'Fractional Gradient Descent Optimizer for Linear Classifier Support Vector Machine'. Together they form a unique fingerprint.

Cite this