wiki:PipelineManager
Last modified 11 years ago Last modified on 06/18/2008 10:13:50 AM

PipelineManager Design

Tasks from Use Case "Run A Pipeline"

  • Record Pipeline Execution Status
  • Configure Pipeline
    • Select Input Sources and Output Sinks
    • Set Monitoring & Control Parameters
    • Distribute Programs to Processing Nodes
    • Initialize Processing Nodes
  • Stage Input Data
    • Stage a Named Collection
    • Preload a Database
  • Pipeline Execution
    • Load Pipeline Policy
    • Record Pipeline Provenance
    • Initialize Pipeline Events
    • Start Pipeline Framework
  • Monitor Pipeline
  • Checkpoint & Restart Pipeline
  • Stop Pipeline Execution
  • Clean Up After Pipeline