Table of Contents
- DC2 Startup
- Running the Pipeline at NCSA
- Sept 4 Integration Meeting
- DC2 Post-Mortem Meeting Agenda
- DC2 Documentation
Data Challenge 2 Management
Data Challenge 2 will focus primarily on application level challenges for nightly processing.
This page collects documents related to the management and execution of Data Challenge 2.
Nightly Processing Use Cases
Image Processing Metrics
- PipelineFramework Design
- Design Discussion: Configuring the Pipeline with Policies
- Getting Started Implementing a Stage
- Association Pipeline?
- Integration of the Association Pipeline with the pipeline framework
- Simplified Association Pipeline design for DC2
Unstructured Data Management (files)
- Long term objective: Managing data at creation, rest, transfer and distribution
- Current status and executive summary
- Experiments in detail and Notes
Running the Pipeline at NCSA
Below the covers
The launchDC2.py script described above in the How-To handles most of the set-up and execution automatically. These links document how things work below launchDC2.py. This information is useful for testing and debugging parts of the pipelines.