A Cloud-Based Platform for Democratizing and Socializing the Benchmarking Process
Journal Title: International Journal of Advanced Computer Science & Applications - Year 2016, Vol 7, Issue 2
Abstract
Performances evaluation, benchmarking and re-producibility represent significant aspects for evaluating the practical impact of scientific research outcomes in the Computer Science field. In spite of all the benefits (e.g., increasing visibility, boosting impact, improving the research quality) which can be obtained from conducting comprehensive and extensive experi-mental evaluations or providing reproducible software artifacts and detailed description of experimental setup, the required effort for achieving these goals remains prohibitive. In this article, we present the design and the implementation details of the Liquid Benchmarking platform as a social and cloud-based platform for democratizing and socializing the software benchmarking processes. Particularly, the platform facilitates the process of sharing the experimental artifacts (computing resources, datasets, software implementations, benchmarking tasks) as services where the end users can easily design, mashup, execute the experiments and visualize the experimental results with zero installation or configuration efforts. Moreover, the social features of the platform enable the users to share and provide feedback on the results of the executed experiments in a form that can guarantee a transparent scientific crediting process. Finally, we present four benchmarking case studies that have been realized via the Liquid Benchmarking platform in the following domains: XML compression techniques, graph indexing and querying techniques, string similarity join algorithms and reverse K nearest neighbors algorithms.
Authors and Affiliations
Fuad Bajaber, Amin Shafaat, Omar Batarfi, Radwa Elshawi, Abdulrahman Altalhi, Ahmed Barnawi, Sherif Sakr
Keywords
Related Articles
- EP ID EP90536
- DOI 10.14569/IJACSA.2016.070268
- Views 61
- Downloads 0
Tsunami Warning System with Sea Surface Features Derived from Altimeter Onboard Satellites
A tsunami warning system based on active database system with satellite derived real-time data of tidal, significant wave height and ocean wind speed as well as assimilation data of sea level changes as one of the global...
Comparison of Intelligent Methods of SOC Estimation for Battery of Photovoltaic System
It is essential to estimate the state of charge (SOC) of lead-acid batteries to improve the stability and reliability of photovoltaic systems. In this paper, we propose SOC estimation methods for a lead-acid battery usin...
Backup Communication Routing Through Internet Satellite, WINDS for Transmitting of Disaster Relief Data
A countermeasure for round trip delay which occurs in between satellite and ground with network accelerator is investigated together with operating system dependency on effectiveness of accelerator. Also disaster relief...
Area k-Coverage Optimization Protocol for Heterogeneous Dense Wireless Sensor Networks
Detecting redundant nodes and scheduling their activity is mandatory to prolong the lifetime of a densely-deployed wireless sensor network. Provided that the redundancy check and the scheduling phases both help to preser...
Nonlinear Identification and Control of Coupled Mass-Spring-Damper System using Polynomial Structures
The paper aims to identify and control the coupled mass-spring-damper system. A nonlinear discrete polynomial structure is elaborated. Its parameters are estimated using Recursive Least Squares (RLS) algorithm. Moreover,...