Managing large-scale workflow execution from resource provisioning to provenance tracking: The CyberShake example
By: E. Deelman, S. Callaghan, E. Field, H. Francoeur, R. Graves, N. Gupta, V. Gupta, T.H. Jordan, C. Kesselman, P. Maechling, J. Mehringer, G. Mehta, D. Okaya, K. Vahi, and L. Zhao
Links
- More information: Publisher Index Page (via DOI)
- Download citation as: RIS | Dublin Core
Abstract
This paper discusses the process of building an environment where large-scale, complex, scientific analysis can be scheduled onto a heterogeneous collection of computational and storage resources. The example application is the Southern California Earthquake Center (SCEC) CyberShake project, an analysis designed to compute probabilistic seismic hazard curves for sites in the Los Angeles area. We explain which software tools were used to build to the system, describe their functionality and interactions. We show the results of running the CyberShake analysis that included over 250,000 jobs using resources available through SCEC and the TeraGrid. ?? 2006 IEEE.
Suggested Citation
Deelman, E., Callaghan, S., Field, E., Francoeur, H., Graves, R., Gupta, N., Gupta, V., Jordan, T., Kesselman, C., Maechling, P., Mehringer, J., Mehta, G., Okaya, D., Vahi, K., Zhao, L., 2006, Managing large-scale workflow execution from resource provisioning to provenance tracking: The CyberShake example, in e-Science 2006 - Second IEEE International Conference on e-Science and Grid Computing, Amsterdam, 4 December 2006 through 6 December 2006, https://doi.org/10.1109/E-SCIENCE.2006.261098.
| Publication type | Conference Paper |
|---|---|
| Publication Subtype | Conference Paper |
| Title | Managing large-scale workflow execution from resource provisioning to provenance tracking: The CyberShake example |
| ISBN | 0769527345; 9780769527345 |
| DOI | 10.1109/E-SCIENCE.2006.261098 |
| Year Published | 2006 |
| Language | English |
| Larger Work Title | e-Science 2006 - Second IEEE International Conference on e-Science and Grid Computing |
| Conference Title | e-Science 2006 - 2nd IEEE International Conference on e-Science and Grid Computing |
| Conference Location | Amsterdam |
| Conference Date | 4 December 2006 through 6 December 2006 |