Project Management Ticket Category Classification Using Machine Learning Method: A Comparative Study

Julius Alekhine, Ratih Nur Esti Anggraini, Riyanarto Sarno, Abullah Faqih Septiyanto, Agus Tri Haryono

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

JIRA Software is used to monitor projects and track errors or bugs. Generally, JIRA tickets issued by the operational team consists of 2: EI tickets to report any issues and EACR tickets intended for enhancements or developing new report requesting by clients. However, in its usage, there is often mistakes made in classifying JIRA tickets, which impacts the quality and time delivery to clients. It can be ascertained that the errors were solely human errors, not system errors. To predict categorization errors, we have attempted to apply machine learning using several classifiers and compare the results. From various literature studies, we have tried the 6 most commonly used classifiers for classification and prediction purposes. The classifiers we used are: Multinomial Naive Bayes, Random Forest, Logistic Regression, K-Nearest Neighbors (KNN), Support Vector Machine (SVM), and Extra Trees. Meanwhile, the training and test data comparison was set at a ratio of 70:30. The valuation score from the experiment shows that among other classifier, the Extra Trees classifier produces the highest level of accuracy, F1 score, and recall with values of 0.9950, 0.9950, and 0.9899 respectively. To improve the classifier predictive accuracy, we proposed Extra Trees parameter adjustment.

Original languageEnglish
Title of host publicationInternational Conference on Artificial Intelligence and Mechatronics System, AIMS 2024
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9798350350524
DOIs
Publication statusPublished - 2024
Event2024 International Conference on Artificial Intelligence and Mechatronics System, AIMS 2024 - Virtual, Online, Indonesia
Duration: 22 Feb 202423 Feb 2024

Publication series

NameInternational Conference on Artificial Intelligence and Mechatronics System, AIMS 2024

Conference

Conference2024 International Conference on Artificial Intelligence and Mechatronics System, AIMS 2024
Country/TerritoryIndonesia
CityVirtual, Online
Period22/02/2423/02/24

Keywords

  • JIRA
  • machine learning,Extra Trees

Cite this