Open Access. Powered by Scholars. Published by Universities.®
Physical Sciences and Mathematics Commons™
Open Access. Powered by Scholars. Published by Universities.®
Articles 1 - 1 of 1
Full-Text Articles in Physical Sciences and Mathematics
Dictionary-Based Data Generation For Fine-Tuning Bert For Adverbial Paraphrasing Tasks, Mark Anthony Carthon
Dictionary-Based Data Generation For Fine-Tuning Bert For Adverbial Paraphrasing Tasks, Mark Anthony Carthon
Theses and Dissertations
Recent advances in natural language processing technology have led to the emergence of
large and deep pre-trained neural networks. The use and focus of these networks are on transfer
learning. More specifically, retraining or fine-tuning such pre-trained networks to achieve state
of the art performance in a variety of challenging natural language processing/understanding
(NLP/NLU) tasks. In this thesis, we focus on identifying paraphrases at the sentence level using
the network Bidirectional Encoder Representations from Transformers (BERT). It is well
understood that in deep learning the volume and quality of training data is a determining factor
of performance. The objective of …