Loading Papermog
Preparing the latest research view.
Frontier Research Intelligence
Preparing the latest research view.
Research Paper
Decoding mental states from non-invasive neural recordings is central to brain-computer interface research. Multimodal acquisition that combines electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) couples the high temporal resolution of EEG with the spatial specificity of fNIRS, compensating for the individual limitations of each modality. While such hybrid systems achieve strong intra-subject performance, cross-subject generalization remains constrained by inter-individual variability in neural responses. This study introduces the Eigenvalue-Guided Positional Encoding Classification Transformer (EPECT), an architecture that integrates eigenvalue-aware multi-head self-attention with sinusoidal positional encoding to capture both the spectral structure of the learned feature representations and the temporal ordering of multimodal sequences. Stacked one-dimensional convolutions extract local patterns prior to transformer encoding, and global average pooling aggregates the final representation for classification. EPECT was evaluated on two publicly available EEG-fNIRS datasets covering motor imagery (MI), n-back, discrimination/selection response (DSR), and word generation (WG) paradigms under a cross-subject protocol. The model achieved classification accuracies of 97.3%, 96.3%, 98.1%, and 97.9% on the MI, n-back, DSR, and WG tasks, respectively. Ablation studies quantified the contribution of each architectural component, and integrated gradients analysis revealed structured modality-specific attribution patterns aligned with task-relevant cortical regions. Additional experiments with synthetic cortical perturbations demonstrate the sensitivity of EPECT to subtle activity changes, indicating potential utility for tracking neurorehabilitation outcomes in future clinical applications.
In-App Reader
This is a preprint publication or lacks formal peer review. It is part of the research pipeline but needs caution.