Digital Commons Network^™

Scavenger: A Junk Mail Classification Program, Rohan V. Malkhare

USF Tampa Graduate Theses and Dissertations

The problem of junk mail, also called spam, has reached epic proportions and various efforts are underway to fight spam. Junk mail classification using machine learning techniques is a key method to fight spam. We have devised a machine learning algorithm where features are created from individual sentences in the subject and body of a message by forming all possible word-pairings from a sentence. Weights are assigned to the features based on the strength of their predictive capabilities for spam/legitimate determination. The predictive capabilities are estimated by the frequency of occurrence of the feature in spam/legitimate collections as well as …

Machine Learning Techniques For Efficient Query Processing In Kowledge Base Systems, Kevin Paul Grant

LSU Doctoral Dissertations

In this dissertation we propose a new technique for efficient query processing in knowledge base systems. Query processing in knowledge base systems poses strong computational challenges because of the presence of combinatorial explosion. This arises because at any point during query processing there may be too many subqueries available for further exploration. Overcoming this difficulty requires effective mechanisms for choosing from among these subqueries good subqueries for further processing. Inspired by existing works on stochastic logic programs, compositional modeling and probabilistic heuristic estimates we create a new, nondeterministic method to accomplish the task of subquery selection for query processing. Specifically, …

A New Approach To Robot’S Imitation Of Behaviors By Decomposition Of Multiple-Valued Relations, Uland Wong, Marek Perkowski

Electrical and Computer Engineering Faculty Publications and Presentations

Relation decomposition has been used for FPGA mapping, layout optimization, and data mining. Decision trees are very popular in data mining and robotics. We present relation decomposition as a new general-purpose machine learning method which generalizes the methods of inducing decision trees, decision diagrams and other structures. Relation decomposition can be used in robotics also in place of classical learning methods such as Reinforcement Learning or Artificial Neural Networks. This paper presents an approach to imitation learning based on decomposition. A Head/Hand robot learns simple behaviors using features extracted from computer vision, speech recognition and sensors.

Development Of An Intelligent Data Analysis System For Knowledge Management In Environmental Data Bases, Miquel Sànchez-Marrè, Karina Gibert, Ignasi Rodríguez-Roda, Eva Bueno, Lidia Mozo, Aleix Clavell, Mario Martína, Philippe Rougé

International Congress on Environmental Modelling and Software

In this work, the goals of the ongoing research project “Development of an Intelligent Data Analysis System for Knowledge Management in Environmental Data Bases” are presented. This project started in 2000, and the Spanish Government will finance it until 2003. Its main goal is to design and develop a prototype of a tool for intelligent data analysis and implicit knowledge management of databases, with special focus on environmental databases. It is remarkable the high quantity of information and knowledge patterns implicit in large databases coming from the monitoring of any system or dynamical environmental process. For instance, historical data collected …

Machine-Learned Contexts For Linguistic Operations In German Sentence Realization, Eric K. Ringger, Simon Corston-Oliver, Michael Gamon, Robert Moore

Faculty Publications

We show that it is possible to learn the contexts for linguistic operations which map a semantic representation to a surface syntactic tree in sentence realization with high accuracy. We cast the problem of learning the contexts for the linguistic operations as classification tasks, and apply straightforward machine learning techniques, such as decision tree learning. The training data consist of linguistic features extracted from syntactic and semantic representations produced by a linguistic analysis system. The target features are extracted from links to surface syntax trees. Our evidence consists of four examples from the German sentence realization system code-named Amalgam: case …

Modular Machine Learning Methods For Computer-Aided Diagnosis Of Breast Cancer, Mia Kathleen Markey '94

Doctoral Dissertations

The purpose of this study was to improve breast cancer diagnosis by reducing the number of benign biopsies performed. To this end, we investigated modular and ensemble systems of machine learning methods for computer-aided diagnosis (CAD) of breast cancer. A modular system partitions the input space into smaller domains, each of which is handled by a local model. An ensemble system uses multiple models for the same cases and combines the models' predictions.

Five supervised machine learning techniques (LDA, SVM, BP-ANN, CBR, CART) were trained to predict the biopsy outcome from mammographic findings (BIRADS™) and patient age based on a …

Machine Learning And Small Robot Navigation, Christopher Ireland

Senior Scholar Papers

Developing successful navigation and mapping strategies is an essential part of autonomous robot research. However, hardware limitations often make for inaccurate systems. This project serves to investigate efficient alternatives to mapping an environment, by first creating a mobile robot, and then applying machine learning to the robot and controlling systems to increase the robustness of the robot system. My mapping system consists of a semi-autonomous robot drone in communication with a stationary Linux computer system. There are learning systems running on both the robot and the more powerful Linux system. The first stage of this project was devoted to designing …

An Analysis Of The Effectiveness Of A Constructive Induction-Based Virus Detection Prototype, Kevin T. Damp

Theses and Dissertations

Computer viruses remain a tangible threat to systems both within the Department of Defense and throughout the greater international data communications infrastructure on which the DoD increasingly depends. This threat is exacerbated continually, as new viruses are introduced at an alarming rate by the growing collection of connected machines and their operators. Unfortunately, current antivirus solutions are ill-equipped to address these issues in the long term. This thesis documents an investigation into the use of constructive induction, a form of machine learning, as a supplemental antivirus technique theoretically capable of detecting previously unknown viruses through generalized decision-making techniques. A group …

Multiple Stochastic Learning Automata For Vehicle Path Control In An Automated Highway System, Cem Unsal, Pushkin Kachroo, John S. Bay

Electrical & Computer Engineering Faculty Research

This paper suggests an intelligent controller for an automated vehicle planning its own trajectory based on sensor and communication data. The intelligent controller is designed using the learning stochastic automata theory. Using the data received from on-board sensors, two automata (one for lateral actions, one for longitudinal actions) can learn the best possible action to avoid collisions. The system has the advantage of being able to work in unmodeled stochastic environments, unlike adaptive control methods or expert systems. Simulations for simultaneous lateral and longitudinal control of a vehicle provide encouraging results

Constructive Induction Machines For Data Mining, Marek Perkowski, Stanislaw Grygiel, Qihong Chen, Dave Mattson

Electrical and Computer Engineering Faculty Publications and Presentations

"Learning Hardware" approach involves creating a computational network based on feedback from the environment (for instance, positive and negative examples from the trainer), and realizing this network in an array of Field Programmable Gate Arrays (FPGAs). Computational networks can be built based on incremental supervised learning (Neural Net training) or global construction (Decision Tree design). Here we advocate the approach to Learning Hardware based on Constructive Induction methods of Machine Learning (ML) using multivalued functions. This is contrasted with the Evolvable Hardware (EHW) approach in which learning/evolution is based on the genetic algorithm only. Various approaches to supervised inductive learning …

Simulation Study Of Learning Automata Games In Automated Highway Systems, Cem Unsal, Pushkin Kachroo, John S. Bay

Electrical & Computer Engineering Faculty Research

One of the most important issues in Automated Highway System (AHS) deployment is intelligent vehicle control. While the technology to safely maneuver vehicles exists, the problem of making intelligent decisions to improve a single vehicle’s travel time and safety while optimizing the overall traffic flow is still a stumbling block. We propose an artificial intelligence technique called stochastic learning automata to design an intelligent vehicle path controller. Using the information obtained by on-board sensors and local communication modules, two automata are capable of learning the best possible (lateral and longitudinal) actions to avoid collisions. This learning method is capable of …

Data-Driven Process Discovery: A Discrete Time Algebra For Relational Signal Analysis, David M. Conrad

Theses and Dissertations

This research presents an autonomous and computationally tractable method for scientific process analysis, combining an iterative algorithmic search and a recognition technique to discover multivariate linear and non-linear relations within experimental data series. These resultant data-driven relations provide researchers with a potentially real-time insight into experimental process phenomena and behavior. This method enables the efficient search of a potentially infinite space of relations within large data series to identify relations that accurately represent process phenomena. Proposed is a time series transformation that encodes and compresses real-valued data into a well-defined, discrete-space of 13 primitive elements where comparative evaluation between variables …

On The Impact Of Forgetting On Learning Machines, Rūsiņš Freivalds, Efim Kinber, Carl H. Smith

School of Computer Science & Engineering Faculty Publications

People tend not to have perfect memories when it comes to learning, or to anything else for that matter. Most formal studies of learning, however, assume a perfect memory. Some approaches have restricted the number of items that could be retained. We introduce a complexity theoretic accounting of memory utilization by learning machines. In our new model, memory is measured in bits as a function of the size of the input. There is a hierarchy of learnability based on increasing memory allotment. The lower bound results are proved using an unusual combination of pumping and mutual recursion theorem arguments. For …

Convergence Properties Of Perceptrons, Ratnasri Krishna Adharapurapu

Theses Digitization Project

No abstract provided.

A Fortran Based Learning System Using Multilayer Back-Propagation Neural Network Techniques, Gregory L. Reinhart

Theses and Dissertations

An interactive computer system which allows the researcher to build an optimal neural network structure quickly, is developed and validated. This system assumes a single hidden layer perceptron structure and uses the back- propagation training technique. The software enables the researcher to quickly define a neural network structure, train the neural network, interrupt training at any point to analyze the status of the current network, re-start training at the interrupted point if desired, and analyze the final network using two- dimensional graphs, three-dimensional graphs, confusion matrices and saliency metrics. A technique for training, testing, and validating various network structures and …

Using Discovery-Based Learning To Prove The Behavior Of An Autonomous Agent, David N. Mezera

Theses and Dissertations

Computer-generated autonomous agents in simulation often behave predictably and unrealistically. These characteristics make them easy to spot and exploit by human participants in the simulation, when we would prefer the behavior of the agent to be indistinguishable from human behavior. An improvement in behavior might be possible by enlarging the library of responses, giving the agent a richer assortment of tactics to employ during a combat scenario. Machine learning offers an exciting alternative to constructing additional responses by hand by instead allowing the system to improve its own performance with experience. This thesis presents NOSTRUM, a discovery-based learning DBL system …

Procase: A Prototype Of Intelligent Case-Based Process Planning System With Simulation Environment, Hao Yang, Wen F. Lu

Mechanical and Aerospace Engineering Faculty Research & Creative Works

An intelligent case-based process planning system with interactive graphic simulation environment, PROCASE, is developed lo demonstrate an integrated methodology of case-based process planning system. In PROCASE, both the mechanical part features and the machining operations are represented with a frame-based scheme. PROCASE contains a retriever, a modifier, a simulator and a repairer. It distinguishes itself from traditional rule-based process planning systems by representing the process planning knowledge through previous process planning cases instead of production rules. It therefore can overcome some problems in the traditional rule-based expert systems. PROCASE currently resides in IRIS Indigo workstation. With a user-friendly graphic environment, …

Multiple Learner Systems Using Resampling Methods, Binyun Xie

Computer Science Theses & Dissertations

The N-Learners Problem deals with combining a number of learners such that the resultant system is "better", under some criterion, than the best of the individual learners. We consider a system of probably approximately correct concept learners. Depending on the available information, there are several methods to make the composite system better than the best of the individual learners. If a sample and an oracle that generates data points (but, not their classification) is available, then we show that we can achieve arbitrary levels of the normalized confidence of the composite system if (a) a robust learning algorithm is available, …

An Examination And Analysis Of The Boltzmann Machine, Its Mean Field Theory Approximation, And Learning Algorithm, Vincent Clive Phillips

Theses : Honours

It is currently believed that artificial neural network models may form the basis for inte1ligent computational devices. The Boltzmann Machine belongs to the class of recursive artificial neural networks and uses a supervised learning algorithm to learn the mapping between input vectors and desired outputs. This study examines the parameters that influence the performance of the Boltzmann Machine learning algorithm. Improving the performance of the algorithm through the use of a naïve mean field theory approximation is also examined. The study was initiated to examine the hypothesis that the Boltzmann Machine learning algorithm, when used with the mean field approximation, …

Learning Algorithms For Artificial Neural Networks: A Closer Look At Back Propagation, Simplex And Monte Carlo, Sergio Alberto Cedeño

Graduate Theses and Dissertations

No abstract provided.

Real Time Maze Traversal, Robert Spina

Theses

This thesis investigates the application of artificial intelligence to real time control in combination with image analysis techniques. The system consists of a "mouse" and a "cheese" in a two dimensional maze which are viewed by a video camera connected to a frame grabber board in a personal computer (PC). The maze is designed to be alterable during the mouse's navigation towards the "cheese" or target. The pc runs the frame grabber software which analyzes the maze to find the cheese, mouse and movement options during traversal. Parameters about the mouse's position, the maze constraints in the vicinity of the …

Intelligent Knowledge Acquisition System, Bong-Soo Youn

Theses

IKAS (Intelligent Knowledge Acquisition System) is an expert system building shell with a machine-assisted concept checker for easy integrated rule-entry. Unlike most expert system shells currently available, IKAS not only performs rule syntax checking, but also maintains semantic integration of the knowledge base by using a Concept Base. The Concept Base is incrementally grown during the cycle of expert system application development and safeguards the whole domain from conceptually conflicting rules by finding possible inconsistencies or duplications of concepts and giving recommendations for possible solutions. Also automatic generalized concept forming using the Inductive Extension Generalization method gives IKAS a capability …

Learning System, Bhavesh T. Adani

Theses

Many rule-based learning systems have been implemented which generate and update rules/facts from illustrative examples provided by the user. But very few of them have succeeded in achieving the efficiency and accuracy of an ideal system.

The approach made here is to continuously update the hierarchical structure of rules/facts of a knowledge-base so that efficient and accurate solutions to any query can be achieved easily and immediately from the many possible solutions to the query. As the rule-based systems deal with a very large knowledge-base, it is sometimes necessary to apply a learning technique that finds optimum solutions efficiently.

The …

Artificial Intelligence: Myths And Realities, Hugo D'Alarcao

Bridgewater Review

Artificial intelligence the name conjures images of mechanical monsters, the Golem, Dr. Frankenstein’s creation and the rebellious computer Hal. We have always been fascinated by the possibility of creating a machine in our image, but this fascination is often accompanied by apprehension. We fear losing control of our creation and suspect that it might turn against us. It is this duality, this conflict between the desire to create and the fear of the consequences of the creation that has been so successfully exploited by writers. It is also, in part, this fascination that has recently brought the field of Artificial …

A Design Methodology For Automated Inspection, Donald Henrik Kylin

Research Reports from the Department of Operations

A class of industrial inspection problems, important because it often causes production bottlenecks, is posed as a pattern recognition problem. A typical member of this class is the inspection of surface quality in flat-rolled steel. Varying inspection requirements, the limitations of manual visual inspection, and the production potential of modern plants motivate research into automatic inspection. Operations research methodologies are applied to three outstanding problems in applied pattern recognition in the context of the automatic inspection system design problem. The design methodology for the inspection system, as proposed in block diagram form, is based on the solutions to these three …