Research Article Open Access

MAPREDUCE CHALLENGES ON PERVASIVE GRIDS

L. A. Steffenel1, O. Flauzac1, A. S. Charao1, P. P. Barcelos2, B. Stein2, G. Cassales2, S. Nesmachnow3, J. Rey3, M. Cogorno3, M. Kirsch-Pinheiro4 and C. Souveyet4
  • 1 Universit de Reims Champagne-Ardenne, France
  • 2 Universidade Federal de Santa Maria, Brazil
  • 3 Universidad de la Republica, Uruguay
  • 4 Universite Paris 1 Pantheon-Sorbonne, France

Abstract

This study presents the advances on designing and implementing scalable techniques to support the development and execution of MapReduce application in pervasive distributed computing infrastructures, in the context of the PER-MARE project. A pervasive framework for MapReduce applications is very useful in practice, especially in those scientific, enterprises and educational centers which have many unused or underused computing resources, which can be fully exploited to solve relevant problems that demand large computing power, such as scientific computing applications, big data processing, etc. In this study, we pro-pose the study of multiple techniques to support volatility and heterogeneity on MapReduce, by applying two complementary approaches: Improving the Apache Hadoop middleware by including context-awareness and fault-tolerance features; and providing an alternative pervasive grid implementation, fully adapted to dynamic environments. The main design and implementation decisions for both alternatives are described and validated through experiments, demonstrating that our approaches provide high reliability when executing on pervasive environments. The analysis of the experiments also leads to several insights on the requirements and constraints from dynamic and volatile systems, reinforcing the importance of context-aware information and advanced fault-tolerance features to provide efficient and reliable MapReduce services on pervasive grids.

Journal of Computer Science
Volume 10 No. 11, 2014, 2194-2210

DOI: https://doi.org/10.3844/jcssp.2014.2194.2210

Submitted On: 22 April 2014 Published On: 24 July 2014

How to Cite: Steffenel, L. A., Flauzac, O., Charao, A. S., Barcelos, P. P., Stein, B., Cassales, G., Nesmachnow, S., Rey, J., Cogorno, M., Kirsch-Pinheiro, M. & Souveyet, C. (2014). MAPREDUCE CHALLENGES ON PERVASIVE GRIDS. Journal of Computer Science, 10(11), 2194-2210. https://doi.org/10.3844/jcssp.2014.2194.2210

  • 4,070 Views
  • 2,573 Downloads
  • 7 Citations

Download

Keywords

  • MapReduce
  • Fault-Tolerance
  • Pervasive Distributed Computing