Table of Contents
Data Challenge 2 Management
from: Lsst Wiki Table of Contents .
Data Challenge 2 will focus primarily on application level challenges for nightly processing.
This page collects documents related to the management and execution of Data Challenge 2.
DC2 Startup
Project Planning
Nightly Processing Use Cases
Image Processing Metrics
Data Transfer
Components
Pipeline Framework
- PipelineFramework Design
- Design Discussion: Configuring the Pipeline with Policies
- Getting Started Implementing a Stage
Association Pipeline
- Association Pipeline
- Integration of the Association Pipeline with the pipeline framework
- Simplified Association Pipeline design for DC2
Unstructured Data Management (files)
- Long term objective: Managing data at creation, rest, transfer and distribution
- Current status and executive summary
- Experiments in detail and Notes
Policies
Event Framework
- EventDesign
- DC2PipelineInterfaces: Stage and event interfaces for DC2 pipelines
Persistence Framework
Logging
Database
Running the Pipeline at NCSA
Essentials
Below the covers
The launchDC2.py script described above in the How-To handles most of the set-up and execution automatically. These links document how things work below launchDC2.py. This information is useful for testing and debugging parts of the pipelines.
