Web Crawler Design Issues: A Review
Journal Title: International Journal of Management, IT and Engineering - Year 2012, Vol 2, Issue 8
Abstract
The large size and the dynamic nature of the Web increase the need for updating Web based information retrieval systems. Crawlers facilitate the process by following the hyperlinks in Web pages to automatically download a partial snapshot of the Web. While some systems rely on crawlers that exhaustively crawl the Web, others focus on topic specific collections. In present paper the various types of crawlers are discussed. The paper also discusses several web crawler design issues along with their solutions.
Authors and Affiliations
Deepika And Dr Ashutosh Dixit
Keywords
Related Articles
- EP ID EP18526
- DOI -
- Views 373
- Downloads 13
Management Control Systems in Insurance Companies of Nepal
Purpose – The purpose of this study is to examine whether the mechanisms of MCS have been adequately developed and applied in the Nepalese Insurance Companies or not Methodology Used – Descriptive and analytical resear...
Entrepreneurship in the Emirates
The global community is experiencing a wave of entrepreneurship today. It has swept into many countries and societies. Today, employees in all sectors of the economy are being asked to become self-starting, as well as...
An efficient and simple technique of data migration
Every type of system may replace or enhance the functionality currently delivered by legacy systems to new system, regardless of the type of project/application; some data conversion may take place. Difficulties arise...
Strategic Management in Indian MSMEs- A Literature Review
Large corporations across globe are following strategic management practices to achieve continuous growth. Though size of a business corporation is not a determining factor for strategic approach to business practices,...
slugATTITUDE OF TEACHERS TOWARDS EDUCATIONAL TECHNOLOGY
Teacher is an effective and dominating factor among the ones contributing to educational improvements. Mainly, the teacher effectiveness depends on the teachers' attitude, characteristics and the classroom phenomena su...