Big Data applications allow to successfully analyze large amounts of data not necessarily structured, though at the same time they present new challenges. For example, predicting the performance of frameworks such as Hadoop can be a costly task, hence the necessity to provide models that can be a valuable support for designers and developers. This paper provides a new contribution in studying a novel modeling approach based on fluid Petri nets to predict MapReduce jobs execution time. The experiments we performed at CINECA, the Italian supercomputing center, have shown that the achieved accuracy is within 16% of the actual measurements on average.

Fluid Petri Nets for the Performance Evaluation of MapReduce Applications

GIANNITI, EUGENIO;RIZZI, ALESSANDRO MARIA;BARBIERATO, ENRICO;GRIBAUDO, MARCO;ARDAGNA, DANILO
2017-01-01

Abstract

Big Data applications allow to successfully analyze large amounts of data not necessarily structured, though at the same time they present new challenges. For example, predicting the performance of frameworks such as Hadoop can be a costly task, hence the necessity to provide models that can be a valuable support for designers and developers. This paper provides a new contribution in studying a novel modeling approach based on fluid Petri nets to predict MapReduce jobs execution time. The experiments we performed at CINECA, the Italian supercomputing center, have shown that the achieved accuracy is within 16% of the actual measurements on average.
2017
InfQ 2016 Workshop Proceedings
Map Reduce, Hadoop, fluid Petri nets
File in questo prodotto:
File Dimensione Formato  
InfQ16.pdf

Open Access dal 12/06/2017

Descrizione: Articolo
: Post-Print (DRAFT o Author’s Accepted Manuscript-AAM)
Dimensione 447.52 kB
Formato Adobe PDF
447.52 kB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11311/1007276
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 2
  • ???jsp.display-item.citation.isi??? ND
social impact