Comparison of stemming algorithms on Indonesian text processing

Afian Syafaadi Rizki*, Aris Tjahyanto, Rahmat Trialih

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

16 Citations (Scopus)

Abstract

Stemming is one of the stages performed on the process of extracting information from the text. Stemming is a process of converting words into their roots. There is an indication that the most accurate stemmer algorithm is not the only way to achieve the best performance in information retrieval (IR). In this study, seven Indonesian stemmer algorithms and an English stemmer algorithm are compared, they are Nazief, Arifin, Fadillah, Asian, Enhanched confix stripping (ECS), Arifiyanti and Porter. The data used are 2,734 tweets collected from the official twitter account of PLN. First, the aims are to analyze the correlation between stemmer accuracy and information retrieval performance in Indonesian text language. Second, is to identify the best algorithm for Indonesian text processing purpose. This research also proposed improved algorithm for stemming Indonesian text. The result shows that correlation found in the previous research does not occur for the Indonesian language. The result also shows that the proposed algorithm was the best for Indonesian text processing purpose with weighted scoring value of 0.648.

Original languageEnglish
Pages (from-to)95-102
Number of pages8
JournalTelkomnika (Telecommunication Computing Electronics and Control)
Volume17
Issue number1
DOIs
Publication statusPublished - 1 Feb 2019

Keywords

  • Confix stripping stemmer
  • Indonesian stemmer
  • Information retrieval
  • Text clustering

Fingerprint

Dive into the research topics of 'Comparison of stemming algorithms on Indonesian text processing'. Together they form a unique fingerprint.

Cite this