Abstract
Multi-label classification of scientific publications against the United Nations Sustainable Development Goals (SDGs) is an increasingly important bibliometric task, yet existing approaches force a trade-off between accuracy, computational cost, and interpretability. Conventional models that rely on static word embeddings under-perform on this task because of the heavy semantic overlap between goals, while large language models reach competitive accuracy only at the cost of billions of parameters and opaque decisions. This paper proposes a hybrid pipeline that combines Sentence-BERT keyword retrieval from an Elsevier SDG dictionary, a finetuned SciBERT multi-label classifier, and a per-class threshold calibration step that adapts the operating point of each goal to its support distribution. The pipeline is evaluated on 5,765 publications from Universitas Airlangga, with five-fold multilabel-stratified cross-validation. The proposed method reaches a macro-averaged F1 of 0.746 (precision of 0.748, recall of 0.751). Under matched conditions on the same corpus and folds, it outperforms a re-implemented TF-IDF and logisticregression baseline (macro-F1 of 0.631) by 11.5 absolute F1 points and a re-implemented Word2Vec and logistic-regression baseline (macro-F1 of 0.477) by 26.9 absolute F1 points. A published zero-shot large language model baseline (Zephyr 7B, 0.717 on a ZORA-derived corpus) is discussed as a reference point but is not replicated here due to the compute it requires. Because every prediction is paired with the matched keywords from the dictionary, the system also produces a human-readable justification for each assignment, which addresses the transparency gap of LLM-based classifiers and makes the pipeline usable in institutional reporting pipelines.
| Original language | English |
|---|---|
| Title of host publication | 27th International Seminar on Intelligent Technology and Its Applications, ISITIA 2026 |
| Publisher | Institute of Electrical and Electronics Engineers Inc. |
| Pages | 774-779 |
| Number of pages | 6 |
| ISBN (Electronic) | 9798319521576 |
| DOIs | |
| Publication status | Published - 2026 |
| Event | 27th International Seminar on Intelligent Technology and Its Applications, ISITIA 2026 - Hybrid, Bali, Indonesia Duration: 22 Jul 2026 → 24 Jul 2026 |
Conference
| Conference | 27th International Seminar on Intelligent Technology and Its Applications, ISITIA 2026 |
|---|---|
| Country/Territory | Indonesia |
| City | Hybrid, Bali |
| Period | 22/07/26 → 24/07/26 |
UN SDGs
This output contributes to the following UN Sustainable Development Goals (SDGs)
-
SDG 7 Affordable and Clean Energy
Keywords
- Sustainable Development Goals
- extraction
- multi-label classification
- semantic similarity
Fingerprint
Dive into the research topics of 'Classifying Multi-Labels of SDGs on Scientific Articles Using Keyword Extraction with Semantic Similarities'. Together they form a unique fingerprint.Cite this
- APA
- Author
- BIBTEX
- Harvard
- Standard
- RIS
- Vancouver