An Appraisal of Web Crawling Algorithms

Journal Title: International Journal of Engineering and Science Invention - Year 2018, Vol 7, Issue 4

Abstract

Central To Any Research Work Or Data-Mining Project Is Having Sufficient Amounts Of Data That Can Be Processed To Provide Meaningful And Statistically Relevant Information. It Is Almost Impossible For Anybody Using The World Wide Web To Get Meaningful Information Without Having To Use A Search Engine. In This Study, We Appraisal Different Crawling Algorithms; Their Strength And Weakness And Also Present The Ideology Behind The Development Of These Algorithms. We Then Go A Step Further To Discuss The Architecture Of A Web Crawler And The General Crawling Policy Of Web Crawlers.

Authors and Affiliations

Oni O. A. , Chinedu Ukeje

Keywords

Related Articles

Dynamic Model of Windings Parameters for Electrical Machines with a Non-Symmetric Magnetic System

Electrical Machines that are having clearly expressed poles in rotor or in stator possess nonsymmetric magnetic systems. In this paper we study main winding inductances at the example of magnetic system with salient roto...

Temperature Effect on Drying And Phytochemicals of Basil Leaves

Basil is a most popular aromatic and annual herb. Immediately after its harvesting, the highly perishable raw material, i.e. leaves, have to be preserved against deterioration and spoilage. More often, during peak period...

Image Segementation using Neural VLSI Systems

Segmentation of specific objects in an image is a key task in computer vision, for which various algorithms have been proposed. However, most of these algorithms are software-oriented and have high computational complexi...

Influence Of pH And Temperature On The Activities Of AlphaAmylase In Maltodextrin Production From Breadfruit Starch

Maltodextrin is a starch-derived food additive used to add bulk and sweetness to packaged foods. The study was carried out toinvestigatethe influence of pH and temperature on the activities of alpha-amylase in maltodextr...

Download PDF file
  • EP ID EP396706
  • DOI -
  • Views 73
  • Downloads 0

How To Cite

Oni O. A. , Chinedu Ukeje (2018). An Appraisal of Web Crawling Algorithms. International Journal of Engineering and Science Invention, 7(4), 42-50. https://www.europub.co.uk/articles/-A-396706