Beyond Hadoop: The Paradigm Shift of Data From Stationary to Streaming Data for Data Analytics
Journal Title: Saudi Journal of Engineering and Technology - Year 2017, Vol 2, Issue 6
Abstract
Abstract: The paradigm shift of data from static to fast flowing data is an important move in the industry, to accommodate growing size of data. The velocity and volume of data are continuing to expand which has started to make its impact in business and other applications of Big Data. The paper describes the paradigm shift of data from static data to streaming data for data analytics beyond Hadoop. It describes how the first generation of Hadoop applications were largely built for batch-oriented paradigm . Streaming data is essentially different from traditional data handling patterns and comes with its own set of challenges and requirements. New applications such as Storm, Flume, Kafka, and other technologies are evolving to bring in an era of real-time analytics Data is generated incessantly from thousands of sources simultaneously and it can be of various type such as log files, mobile and web data, transaction etc. The sections of my paper are Introduction followed by Streaming data, Hadoop, Streaming data analytics, Apache Spark, Comparing Streaming models and Streaming analytics use cases followed by conclusion. The information presented is from secondary source i.e. journal, conference proceedings and websites. Keywords: paradigm, Hadoop, Apache Spark.
Authors and Affiliations
Affreen Ara, Aftab Ara
Keywords
Related Articles
- EP ID EP401729
- DOI -
- Views 148
- Downloads 0
Smart Home Energy Management System Using Least Square Regression Analysis
Abstract: Smart home is a residence with several electrical and electronic appliances that are capable of communicating with each other and can be controlled remotely from any room in the home or from any location in the...
Thermodynamic (Energy-Exergy) Analysis of Combined Coal based Thermal Power Plant and Solar Integrated Double Bed Vapor Adsorption System for Heat Recovery and Space Cooling
Abstract:The thermal performance of proposed model deals with combined double bed vapor adsorption refrigeration system and 9MW of Rankine thermal cycle .The provision of evacuated tube type solar collector (ETC) is avai...
Reliability and Life Data Analysis on the Components of Pump
Abstract:The purpose of this study is to highlight the importance of reliability and life data analysis in manufacturing facility which allows the maintenance and reliability professionals to analyse the equipment breakd...
A Simple Procedure for Preconcentration of Trace Amounts of Co (II), Cu (II) and Ni (II) Using A New Chelating Resin
Abstract: A new method for preconcentration of ultratrace amounts of Co (II), Ni(II) and Cu(II) ions in various matrices has been proposed. The method is based on the adsorption and chelation of the metal ions on Amberli...
Effect of Additive Type and Percent on Soil Plasticity
Abstract:In the current study, the effects of three types of additive (lime, cement and cement kiln dust) on the plasticity of a soil are studied. The results of the study indicate plasticity index are affected by the ad...