COMPARISON OF PRE-TRAINED BERT-BASED TRANSFORMER MODELS FOR REGIONAL LANGUAGE TEXT SENTIMENT ANALYSIS IN INDONESIA

Taufiq Dwi Purnomo ; Joko Sutopo
International Journal Science and Technology (IJST... 📅 2024 Vol 3, No 3 🔗 DOI: 10.56127/ijst.v3i3.1739
Abstract
This study compared the performance of eight pre-trained BERT-based models for sentiment analysis across ten regional languages in Indonesia. The objective was to identify the most effective model for analyzing sentiment in low-resource Indonesian languages, given the increasing need for automated sentiment analysis tools. The study utilized the NusaX dataset and evaluated the performance of IndoBERT (IndoNLU), IndoBERT (IndoLEM), Multilingual BERT, and NusaBERT, each in both base and large variants. Model performance was assessed using the F1-score metric. The results indicated that models pre-trained on Indonesian data, specifically IndoBERT (IndoNLU) and NusaBERT, generally outperformed the multilingual BERT and IndoBERT (IndoLEM) models. IndoBERT-large (IndoNLU) achieved the highest overall F1-score of 0.9353. Performance varied across the different regional languages. Javanese, Minangkabau, and Banjar consistently showed high F1 scores, while Batak Toba proved more challenging for all models. Notably, NusaBERT-base underperformed compared to IndoBERT-base (IndoNLU) across all languages, despite being retrained on Indonesian regional languages. This research provides valuable insights into the suitability of different pre-trained BERT models for sentiment analysis in Indonesian regional languages.
Keywords
Sentiment Analysis; BERT; Indonesian Regional Languages; IndoBERT; NusaBERT Article
How to Cite

Taufiq Dwi Purnomo & Joko Sutopo (2024). COMPARISON OF PRE-TRAINED BERT-BASED TRANSFORMER MODELS FOR REGIONAL LANGUAGE TEXT SENTIMENT ANALYSIS IN INDONESIA . International Journal Science and Technology (IJST), 3(3). https://doi.org/10.56127/ijst.v3i3.1739

Taufiq Dwi Purnomo; Joko Sutopo, "COMPARISON OF PRE-TRAINED BERT-BASED TRANSFORMER MODELS FOR REGIONAL LANGUAGE TEXT SENTIMENT ANALYSIS IN INDONESIA ," International Journal Science and Technology (IJST), vol. 3, no. 3, 2024.

Taufiq Dwi Purnomo; Joko Sutopo. "COMPARISON OF PRE-TRAINED BERT-BASED TRANSFORMER MODELS FOR REGIONAL LANGUAGE TEXT SENTIMENT ANALYSIS IN INDONESIA ." International Journal Science and Technology (IJST), vol. 3, no. 3, 2024.

Taufiq Dwi Purnomo; Joko Sutopo. "COMPARISON OF PRE-TRAINED BERT-BASED TRANSFORMER MODELS FOR REGIONAL LANGUAGE TEXT SENTIMENT ANALYSIS IN INDONESIA ." International Journal Science and Technology (IJST) 3, no. 3 (2024).

Taufiq Dwi Purnomo & Joko Sutopo (2024) 'COMPARISON OF PRE-TRAINED BERT-BASED TRANSFORMER MODELS FOR REGIONAL LANGUAGE TEXT SENTIMENT ANALYSIS IN INDONESIA ', International Journal Science and Technology (IJST), 3(3). doi: 10.56127/ijst.v3i3.1739.

Taufiq Dwi Purnomo; Joko Sutopo. COMPARISON OF PRE-TRAINED BERT-BASED TRANSFORMER MODELS FOR REGIONAL LANGUAGE TEXT SENTIMENT ANALYSIS IN INDONESIA . International Journal Science and Technology (IJST). 2024;3(3).

Artikel Terkait

Heart Disease Prediction Using Logistic Regression and K-Nearest Neighbor: A Comparative Study of Classification Algorithm Performance

Sururi, Yan Risa Aspi; Ghozi, M. Asadullah Al

Perception and Behavior of Farmers Towards the Use of Organic Fertilizers in Rice Plants in Kewayuhan Village, Pejagoan District, Kebumen Regency

Furqon, Ngafiful; Aprilia, Rennanti Lunnadiyah

Integrated Technical, Thermal, and Techno-Economic Assessment of Hot-Oil and Electric Heating Systems for 15–22 MT Asphalt Storage Tanks

Arifuddin, Arifuddin; Wiseno, Elbi

Generative AI Risk Governance in Organizational Information Systems: A Conceptual Model Integrating Security, Ethics, and Digital Trust

Nurdiyanto Yusuf

Design of a SCADA-Based Control System for Hybrid Power Generation Integrating a Screw Turbine and Solar Panels

Mekel, Jonah Alfred; Bawano, Franklin; Mekel, Alfred Noufie; Saroinsong, Tineke

Performance Evaluation of an N₂ Membrane Generator under Different Operating Temperatures

Pradito, Okttu Kristi; Korawan, Agus Dwi; Mawarni, Drajat Indah
Tren Sitasi Jurnal