Compare and Contrast Pipeline Middleware: LSST DC3 and NHPPS
Purpose
The purpose of this discussion is to compare and contrast the current LSST (as of DC3) and NOAO (NOAO High Performance Pipeline System aka FLIPPER) pipeline middleware. From this we hope to learn and understand the design philosophies and capitalize on lessons learned by these efforts. It is not a competition or a marketing of the systems nor just two separate presentations.
One vision from JeffKantor? is that the functionality of these systems might be blended into one configurable system; a system that might be useful from a single user machine, to a small cluster, to a power cluster, to a Grid application.
The structure is a series of sections where the experts from each system can illuminate the differences and similarities in a structured dialog. We encourage including reasons for various design or implementation decisions. Short examples may be useful. While this discussion is focused on the middleware rather than the science application there will be times where discussing a particular application illustrates the middleware requirement or capability.
One important section is a glossary of terms and nomenclature used by the projects. Sometimes what might appear to be a difference is simply a matter of different words and other times the same word may be used but with different meanings or assumptions.
- Glossary
- Execution Model
- Module Environment
- Pipeline Contexts
- Pipeline Description Language or Workflow Definition
- Exception Handling?
- ...
