Big Data Analysis and Its Scheduling Policy – Hadoop
Journal Title: IOSR Journals (IOSR Journal of Computer Engineering) - Year 2015, Vol 17, Issue 1
Abstract
Abstract: This paper is deals with Parallel Distributed system. Hadoop has become a central platform tostore big data through its Hadoop Distributed File System (HDFS) as well as to run analytics on this stored bigdata using its MapReduce component. Map Reduce programming model have shown great value inprocessing huge amount of data. Map Reduce is a common framework for data-intensive distributedcomputing of batch jobs. Hadoop Distributed File System (HDFS) is a Java-based file system that providesscalable and reliable data storage that is designed to span large clusters of commodity servers. In all Hadoopimplementations, the default FIFO scheduler is available where jobs are scheduled in FIFO order with supportfor other priority based schedulers also. During this paper, we are going to study a Hadoop framework, HDFSdesign and Map reduce Programming model. And also various schedulers possible with Hadoop and providedsome behavior of the current scheduling schemes in Hadoop on a locally deployed cluster is described.
Authors and Affiliations
Divya S , Kanya Rajesh R , Rini Mary NithilaI , Vinothini M
Keywords
Related Articles
- EP ID EP89192
- DOI -
- Views 132
- Downloads 0
Improved Product Ranking For Recommendation Systems
Abstract: In the new area of information technology, the most important and recognition machine learning technique is Recommender engine. Vast numbers of knowledge discovery techniques are applied by recommender system t...
DDOS Anomaly Detection And Mitigation In Software Defined Networking (SDN)
The introduction of Software Defined Networking as a panacea to the global demand for a more secure and highly dependable internet infrastructure has also brought along security issues. The adoption of OpenFlow Protocol...
Analysis on Data Integrity in Cloud Environment
Abstract: Cloud Computing privileges convenient, easy on-demand access to a collection of configurable resources and services. The services and resources on the cloud can be robustly deployed with low maintenance cost, e...
Enhancing the Usability of Library System at CSIBER using QRCode
Abstract: With the advancement in information technology, the information is no longer confined to a singlephysical location. With the parallel advancement in mobile technology, the information is available anywher...
Low-Cost Bus Tracking System Using Area-Trace Algorithm
This paper proposes a low-cost Bus Tracking System that uses GPS and allows the user to know the bus location on their mobile phone. It has an advantage that it does not use any internet data for the users to be,notified...