Open Access. Powered by Scholars. Published by Universities.®
Physical Sciences and Mathematics Commons™
Open Access. Powered by Scholars. Published by Universities.®
- Keyword
-
- Chatbots (2)
- Apache HBase (1)
- Collaborative filtering (1)
- Database security (1)
- Differential privacy (1)
-
- Discussion Boards (1)
- Document Classification (1)
- Feature size reduction (1)
- Headline Generation (1)
- Machine Learning (1)
- Named entity recognition (1)
- Natural Language Processing (1)
- Neural Nets (1)
- Open source (1)
- Query latency (1)
- Question Answering (1)
- Recommendation systems (1)
- Semantic Web Crawler (1)
- Stop words (1)
- Text Summarization (1)
- Text classification (1)
Articles 1 - 10 of 10
Full-Text Articles in Physical Sciences and Mathematics
Question Type Recognition Using Natural Language Input, Aishwarya Soni
Question Type Recognition Using Natural Language Input, Aishwarya Soni
Master's Projects
Recently, numerous specialists are concentrating on the utilization of Natural Language Processing (NLP) systems in various domains, for example, data extraction and content mining. One of the difficulties with these innovations is building up a precise Question and Answering (QA) System. Question type recognition is the most significant task in a QA system, for example, chat bots. Organization such as National Institute of Standards (NIST) hosts a conference series called as Text REtrieval Conference (TREC) series which keeps a competition every year to encourage and improve the technique of information retrieval from a large corpus of text. When a user …
Improving Text Classification With Word Embedding, Lihao Ge
Improving Text Classification With Word Embedding, Lihao Ge
Master's Projects
One challenge in text classification is that it is hard to make feature reduction basing upon the meaning of the features. An improper feature reduction may even worsen the classification accuracy. Word2Vec, a word embedding method, has recently been gaining popularity due to its high precision rate of analyzing the semantic similarity between words at relatively low computational cost. However, there are only a limited number of researchers focusing on feature reduction using Word2Vec. In this project, we developed a Word2Vec based method to reduce the feature size while increasing the classification accuracy. The feature reduction is achieved by loosely …
Adding Differential Privacy In An Open Board Discussion Board System, Pragya Rana
Adding Differential Privacy In An Open Board Discussion Board System, Pragya Rana
Master's Projects
This project implements a privacy system for statistics generated by the Yioop search and discussion board system. Statistical data for such a system consists of various counts, sums, and averages that might be displayed for groups, threads, etc. When statistical data is made publicly available, there is no guarantee of preserving the privacy of an individual. Ideally, any data extracted should not reveal any sensitive information about an individual. In order to help achieve this, we implemented a Differential Privacy mechanism for Yioop. Differential privacy preserves privacy up to some controllable parameters of the number of items or individuals being …
An Open Source Discussion Group Recommendation System, Sarika Padmashali
An Open Source Discussion Group Recommendation System, Sarika Padmashali
Master's Projects
A recommendation system analyzes user behavior on a website to make suggestions about what a user should do in the future on the website. It basically tries to predict the “rating” or “preference” a user would have for an action. Yioop is an open source search engine, wiki system, and user discussion group system managed by Dr. Christopher Pollett at SJSU. In this project, we have developed a recommendation system for Yioop where users are given suggestions about the threads and groups they could join based on their user history. We have used collaborative filtering techniques to make recommendations and …
Document Classification Using Machine Learning, Ankit Basarkar
Document Classification Using Machine Learning, Ankit Basarkar
Master's Projects
To perform document classification algorithmically, documents need to be represented such that it is understandable to the machine learning classifier. The report discusses the different types of feature vectors through which document can be represented and later classified. The project aims at comparing the Binary, Count and TfIdf feature vectors and their impact on document classification. To test how well each of the three mentioned feature vectors perform, we used the 20-newsgroup dataset and converted the documents to all the three feature vectors. For each feature vector representation, we trained the Naïve Bayes classifier and then tested the generated classifier …
Headline Generation Using Deep Neural Networks, Dhruven Vora
Headline Generation Using Deep Neural Networks, Dhruven Vora
Master's Projects
News headline generation is one of the important text summarization tasks. Human generated news headlines are generally intended to catch the eye rather than provide useful information. There have been many approaches to generate meaningful headlines by either using neural networks or using linguistic features. In this report, we are proposing a novel approach based on integrating Hedge Trimmer, which is a grammar based extractive summarization system with a deep neural network abstractive summarization system to generate meaningful headlines. We analyze the results against current recurrent neural network based headline generation system.
A Chatbot Framework For Yioop, Harika Nukala
A Chatbot Framework For Yioop, Harika Nukala
Master's Projects
Over the past few years, messaging applications have become more popular than Social networking sites. Instead of using a specific application or website to access some service, chatbots are created on messaging platforms to allow users to interact with companies’ products and also give assistance as needed. In this project, we designed and implemented a chatbot Framework for Yioop. The goal of the Chatbot Framework for Yioop project is to provide a platform for developers in Yioop to build and deploy chatbot applications. A chatbot is a web service that can converse with users using artificial intelligence in messaging platforms. …
Named Entity Recognition And Classification For Natural Language Inputs At Scale, Shreeraj Dabholkar
Named Entity Recognition And Classification For Natural Language Inputs At Scale, Shreeraj Dabholkar
Master's Projects
Natural language processing (NLP) is a technique by which computers can analyze, understand, and derive meaning from human language. Phrases in a body of natural text that represent names, such as those of persons, organizations or locations are referred to as named entities. Identifying and categorizing these named entities is still a challenging task, research on which, has been carried out for many years. In this project, we build a supervised learning based classifier which can perform named entity recognition and classification (NERC) on input text and implement it as part of a chatbot application. The implementation is then scaled …
Reducing Query Latency For Information Retrieval, Swapnil Satish Kamble
Reducing Query Latency For Information Retrieval, Swapnil Satish Kamble
Master's Projects
As the world is moving towards Big Data, NoSQL (Not only SQL) databases are gaining much more popularity. Among the other advantages of NoSQL databases, one of their key advantage is that they facilitate faster retrieval for huge volumes of data, as compared to traditional relational databases. This project deals with one such popular NoSQL database, Apache HBase. It performs quite efficiently in cases of retrieving information using the rowkey (similar to a primary key in a SQL database). But, in cases where one needs to get information based on non-rowkey columns, the response latency is higher than what we …
Intelligent Web Crawler For Semantic Search Engine, Shujia Zhang
Intelligent Web Crawler For Semantic Search Engine, Shujia Zhang
Master's Projects
A Semantic Search Engine (SSE) is a program that produces semantic-oriented concepts from the Internet. A web crawler is the front end of our SSE; its primary goal is to supply important and necessary information to the data analysis component of SSE. The main function of the analysis component is to produce the concepts (moderately frequent finite sequences of keywords) from the input; it uses some variants of TF-IDF as a primary tool to remove stop words. However, it is a very expensive way to filter out stop words using the idea of TF-IDF. The goal of this project is …