Open Access. Powered by Scholars. Published by Universities.®

Digital Commons Network

Open Access. Powered by Scholars. Published by Universities.®

Computer Sciences

PDF

Georgia State University

2006

Best first crawler

Articles 1 - 1 of 1

Full-Text Articles in Entire DC Network

A Domain Based Approach To Crawl The Hidden Web, Milan Pandya Dec 2006

A Domain Based Approach To Crawl The Hidden Web, Milan Pandya

Computer Science Theses

There is a lot of research work being performed on indexing the Web. More and more sophisticated Web crawlers are been designed to search and index the Web faster. But all these traditional crawlers crawl only the part of Web we call “Surface Web”. They are unable to crawl the hidden portion of the Web. These traditional crawlers retrieve contents only from surface Web pages which are just a set of Web pages linked by some hyperlinks and ignoring the hidden information. Hence, they ignore tremendous amount of information hidden behind these search forms in Web pages. Most of the …