Experimenting with application-based benchmarks on different cloud providers via a multi-cloud execution and modeling framework

Athanasia Evangelinou, Nunzio Andrea Galante, George Kousiouris, Gabriele Giammatteo, Elton Kevani, Christoforos Stampoltas, Andreas Menychtas, Aliki Kopaneli, Kanchanna Ramasamy Balraj, Dimosthenis Kyriazis, Theodora Varvarigou, Peter Stuer, Leire Orue Echevarria Arrieta, Gorka Mikel Echevarria Velez, Alexander Bergmayr

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Cloud services are emerging today as an innovative IT provisioning model, offering benefits over the traditional approach of provisioning infrastructure. However, the occurrence of multi-tenancy, virtualization and resource sharing issues raise certain difficulties in providing performance estimation during application design or deployment time. In order to assess the performance of cloud services and compare cloud offerings, cloud benchmarks are required. The aim of this paper is to present a mechanism and a benchmarking process for measuring the performance of various cloud service delivery models, while describing this information in a machine understandable format. The suggested framework is responsible for organizing the execution and may support multiple cloud providers. In our work context, benchmarking measurement results are demonstrated from three large commercial cloud providers, Amazon EC2, Microsoft Azure and Flexiant in order to assist with provisioning decisions for cloud users. Furthermore, we present approaches for measuring service performance with the usage of specialized metrics for ranking the services according to a weighted combination of cost, performance and workload.

Original languageEnglish
Title of host publicationCloud Computing and Services Sciences - International Conference in Cloud Computing and Services Sciences, CLOSER 2014, Revised Selected Papers
EditorsMarkus Helfert, Frédéric Desprez, Donald Ferguson, Frank Leymann, Víctor Méndez Muñoz
PublisherSpringer Verlag
Pages213-227
Number of pages15
ISBN (Print)9783319254135
DOIs
Publication statusPublished - 2015
EventInternational Conference in Cloud Computing and Services Sciences, CLOSER 2014 - Barcelona, Spain
Duration: 3 Apr 20145 Apr 2014

Publication series

NameCommunications in Computer and Information Science
Volume512
ISSN (Print)1865-0929

Conference

ConferenceInternational Conference in Cloud Computing and Services Sciences, CLOSER 2014
Country/TerritorySpain
CityBarcelona
Period3/04/145/04/14

Fingerprint

Dive into the research topics of 'Experimenting with application-based benchmarks on different cloud providers via a multi-cloud execution and modeling framework'. Together they form a unique fingerprint.

Cite this