Skip to main navigation Skip to search Skip to main content

Trends and Gaps in Transformer-Based EEG Modeling: A Review of Recent Developments

  • Yuri Pamungkas*
  • , Abdul Karim
  • , Myo Min Aung
  • , Muhammad Nur Afnan Uda
  • , Uda Hashim
  • *Corresponding author for this work
  • Hallym University
  • Department of Mechatronics Engineering
  • Rajamangala University of Technology Thanyaburi
  • Department of Electronic Engineering (Computer)
  • Universiti Malaysia Sabah
  • Department of Electrical and Electronics Engineering

Research output: Contribution to journal › Article › peer-review

Abstract

In recent years, Transformer-based deep learning architectures have emerged as a powerful paradigm for modeling EEG signals, offering superior capability in capturing spatial–temporal dependencies compared to traditional convolutional or recurrent networks. However, the diversity of model designs, limited dataset generalization, and lack of standardization have created challenges in evaluating their true potential for real-world applications. This review addresses these issues by systematically examining the evolution, performance, and methodological trends of Transformer-based EEG models published between 2022 and 2024, highlighting both achievements and research gaps. The main contribution of this study is to provide a comprehensive mapping and critical analysis of Transformer architectures applied to EEG classification, feature extraction, and signal decoding tasks. Using the Scopus database, a structured search was conducted following specific inclusion criteria (English, peer-reviewed, open-access journal papers from 2022–2024) and a well-defined query combining EEG and Transformer-related keywords. Data from 63 eligible studies were extracted and categorized according to authorship, dataset, architecture type, EEG application, and evaluation metrics. Results show that hybrid Transformer models dominate recent research, achieving accuracies above 90% in tasks such as motor imagery, emotion recognition, seizure detection, and sleep staging. Pure Transformers like ViT and BERT-like models also demonstrate competitive performance but face scalability and interpretability challenges. In conclusion, Transformer-based EEG modeling is advancing rapidly, yet future efforts must focus on model efficiency, explainability, and benchmark standardization to enable broader clinical and real-world adoption.

Original languageEnglish
Pages (from-to)561-575
Number of pages15
JournalBuletin Ilmiah Sarjana Teknik Elektro
Volume8
Issue number2
DOIs
Publication statusPublished - Apr 2026

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

  1. SDG 7 - Affordable and Clean Energy
    SDG 7 Affordable and Clean Energy

Keywords

  • Attention-Based Modeling
  • Brain-Computer Interface (BCI)
  • Deep Learning
  • Electroencephalography (EEG)
  • Transformer Architecture

Fingerprint

Dive into the research topics of 'Trends and Gaps in Transformer-Based EEG Modeling: A Review of Recent Developments'. Together they form a unique fingerprint.

Cite this