Open Access. Powered by Scholars. Published by Universities.®
- Discipline
- Institution
- Publication Type
Articles 1 - 4 of 4
Full-Text Articles in Computational Linguistics
A Proposed Ehrenfeucht-Fraïssé Game Model For Natural Language Processing Generative Adversarial Networks, Don Li
Anthós
Large Language Models (LLM’s) (e.g., ChatGPT) constitute both a significant research area and commercial application of AI. Current major LLM’s are built on Generative Pre-Trained Transformer (GPT) neural network architecture to perform natural language processing (NLP) tasks. Generative Adversarial Network (GAN) is another popular neural network architecture, which leverages a zero-sum game between constituent neural networks within the architecture to train the GAN, and is widely used for visual data applications. This article proposes a new GAN architecture for NLP: an EF-GAN whose underlying algorithm uses Ehrenfeucht–Fraïssé (EF) games, a game-theoretic approach from model theory to determine elementary equivalence of …
Empirical Analysis Of Cbow And Skip Gram Nlp Models, Tejas Menon
Empirical Analysis Of Cbow And Skip Gram Nlp Models, Tejas Menon
University Honors Theses
CBOW and Skip Gram are two NLP techniques to produce word embedding models that are accurate and performant. They were invented in the seminal paper by T. Mikolov et al. and have since observed optimizations such as negative sampling and subsampling. This paper implements a fully-optimized version of these models using Py-Torch and runs them through a toy sentiment/subject analysis. It is weakly observed that different corpus types affect the skew of word embeddings such that fictional corpus are better suited for sentiment analysis and non-fictional for subject analysis.
Automatic Keyphrase Extraction From Russian-Language Scholarly Papers In Computational Linguistics, Yves Wienecke
Automatic Keyphrase Extraction From Russian-Language Scholarly Papers In Computational Linguistics, Yves Wienecke
University Honors Theses
The automatic extraction of keyphrases from scholarly papers is a necessary step for many Natural Language Processing (NLP) tasks, including text retrieval, machine translation, and text summarization. However, due to the different grammatical and semantic intricacies of languages, this is a highly language-dependent task. Many free and open source implementations of state-of-the-art keyphrase extraction techniques exist, but they are not adapted for processing Russian text. Furthermore, the multi-linguistic character of scholarly papers in the field of Russian computational linguistics and NLP introduces additional complexity to keyphrase extraction. This paper describes a free and open source program as a proof of …
A Classifier To Evaluate Language Specificity In Medical Documents, Trudi Miller '08, Gondy A. Leroy, Samir Chatterjee, Jie Fan, Brian Thoms '09
A Classifier To Evaluate Language Specificity In Medical Documents, Trudi Miller '08, Gondy A. Leroy, Samir Chatterjee, Jie Fan, Brian Thoms '09
CGU Faculty Publications and Research
Consumer health information written by health care professionals is often inaccessible to the consumers it is written for. Traditional readability formulas examine syntactic features like sentence length and number of syllables, ignoring the target audience's grasp of the words themselves. The use of specialized vocabulary disrupts the understanding of patients with low reading skills, causing a decrease in comprehension. A naive Bayes classifier for three levels of increasing medical terminology specificity (consumer/patient, novice health learner, medical professional) was created with a lexicon generated from a representative medical corpus. Ninety-six percent accuracy in classification was attained. The classifier was then applied …