Automatic Assessment of Technology Readiness Level Using LLDA-Helmholtz for Ranking University

Bagus Setya Rintyarna*, Riyanarto Sarno, Eko Putro Fitrianto, Anugerah Yulindra Satyaji

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review


The assessment process of Technology Readiness Level using the questionnaire-based tool for Indonesian university's academic papers is considered to be labor-intensive. This paper introduces a new method of determining the TRL of an academic paper based on a text mining technique. The content of the research paper represented by their abstract published by university lecturers is justified to represent the technology maturity of research. Abstracts of papers were collected from the nine most reputable universities in Indonesia. By utilizing Labelled Latent Dirichlet Allocation, the abstracts were categorized into 1 of 9 levels of TRL. To determine the prior label of LLDA, we built a corpus of keywords representing each TRL level based on Bloom Taxonomy. Beforehand, Helmoltz principle was utilized to select the text feature. Since Bloom Taxonomy has only six levels, we split the keywords into 9 level. Afterward, the reputation score is calculated using our formula. Lastly, the university ranking is generated according to the extracted academic reputation score. To evaluate the proposed method, we compare our rank with QS's. We calculate the ranking gap and Pearson correlation to evaluate the result. Helmholtz has successfully pruned 86% of features. The utilization of Helmholtz significantly improves the Pearson correlation of our proposed method. In short, the new insight of university ranking introduced in this work is promising. For all indicator experiments, LLDA-Helmholtz performed better results indicated by 0.95 Pearson correlation between two rankings, while for LLDA without Helmhotz, the correlation is 0.78.

Original languageEnglish
Pages (from-to)2416-2421
Number of pages6
JournalInternational Journal on Advanced Science, Engineering and Information Technology
Issue number6
Publication statusPublished - 2021


  • Helmholtz principle
  • Pearson correlation
  • Technology readiness level
  • bloom taxonomy
  • labeled latent Dirichlet allocation


Dive into the research topics of 'Automatic Assessment of Technology Readiness Level Using LLDA-Helmholtz for Ranking University'. Together they form a unique fingerprint.

Cite this