Engineering Commons^™

A Transformer Based Architecture For Indonesian Sentiment Analysis - Exploring Indobert Variations, Training Size, And Self-Supervised Model Training, Connor F. Shaw

Theses and Dissertations

There is strong motivation in both civilian and military circles to understand the attitudes, motivations, feelings, and emotions of a population of interest. Social media is a rich source of self-disclosed information by individuals from all walks of life about virtually every domain of the human experience, but the vast quantity of data is impossible to effectively analyze without advanced natural language processing algorithms. This research creates a transfer learning based emotion classification model for Indonesian language Twitter data. Transfer learning consists of two steps: pre-training and fine tuning. Three variations of Indonesian Bidirectional Encoder Representations from Transformers (IndoBERT) are …