Fault-tolerant scheduling for scientific workflow with task replication method in cloud

Zhongjin Li, Jiacheng Yu, Haiyang Hu, Jie Chen, Hua Hu, Jidong Ge, Victor Chang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

Cloud computing has become a revolutionary paradigm by provisioning on-demand and low cost computing resources for customers. As a result, scientific workflow, which is the big data application, is increasingly prone to adopt cloud computing resources. However, internal failure (host fault) is inevitable in such large distributed computing environment. It is also well studied that cloud data center will experience malicious attacks frequently. Hence, external failure (failure by malicious attack) should also be considered when executing scientific workflows in cloud. In this paper, a fault-tolerant scheduling (FTS) algorithm is proposed for scientific workflow in cloud computing environment, the aim of which is to minimize the workflow cost with the deadline constraint even in the presence of internal and external failures. The FTS algorithm, based on tasks replication method, is one of the widely used fault tolerant mechanisms. The experimental results in terms of real-world scientific workflow applications demonstrate the effectiveness and practicality of our proposed algorithm.

Original languageEnglish
Title of host publicationIoTBDS 2018 - Proceedings of the 3rd International Conference on Internet of Things, Big Data and Security
EditorsVictor Mendez Munoz, Robert Walters, Farshad Firouzi, Gary Wills, Victor Chang
PublisherSciTePress
Pages95-104
Number of pages10
ISBN (Electronic)9789897582967
Publication statusPublished - 31 Mar 2018
Event3rd International Conference on Internet of Things, Big Data and Security - Maderia, Spain
Duration: 19 Mar 201821 Mar 2018
http://www.iotbds.org/?y=2018

Publication series

NameIoTBDS 2018 - Proceedings of the 3rd International Conference on Internet of Things, Big Data and Security
Volume2018-March

Conference

Conference3rd International Conference on Internet of Things, Big Data and Security
Abbreviated titleIoTBDS 2018
CountrySpain
CityMaderia
Period19/03/1821/03/18
Internet address

Fingerprint Dive into the research topics of 'Fault-tolerant scheduling for scientific workflow with task replication method in cloud'. Together they form a unique fingerprint.

Cite this