O'Reilly logo

Optimized Cloud Resource Management and Scheduling by Yong Dr. Zhao, Wenhong Dr. Tian

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

12

Toward Running Scientific Workflows in the Cloud

Cloud computing is gaining tremendous momentum in both academia and industry. The application of cloud computing, however, has mostly focused on web and business applications thus far, whereas workflow applications, especially data-intensive scientific workflows on the cloud, are still largely unexplored. In this chapter, we present the Swift scientific workflow management system (SWFMS) as a service in the cloud. We present our experience migrating the Swift SWFMS into the cloud, which supports workflow specification and submission, on-demand virtual cluster provisioning, high-throughput task scheduling and execution, and efficient and scalable cloud resource management. We discuss two integration ...

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required