wiki:DC3/DC3aProductionRuns
Last modified 10 years ago Last modified on 07/21/2009 09:24:56 AM

DC3a Production Runs

This document lists particular runs of the DC3a Alert Production pipelines that marked worthy of wider review.

RunID Collection # of Visits Started Run Directory Comments
rlp1188 CFHT D3 16 May 14 21:39 PT /lustre/DC3root/rlp1188 Perf. stats; Used for debugging purposes
sk06030840 SimDeep 3 June 3 8:40 PT /lsst/DC3root/sk06030840 Debuggable run
sk06031214 SimWide 5 June 3 12:14 PT /lsst/DC3root/sk06031214 Debuggable run
rlp1213 CFHT D3 85 June 5 10:13 PT /lsst/DC3root/rlp1213 1st 31 amplifiers
IPSD: 5 slices from visit 69615 had problem during psf Determ:
"Please provide at least one Image for me to analyze"
ap: unknown communication failures:
"unable to insert element into full FIFO"
"Deadline for visit XXXXXX expired"
nightmops: a couple of MYSQL connection errors
Ran to completion
rlp1218 CFHT D3 59 June 6 12:16 PT /lsst/DC3root/rlp1218 2nd 31 amplifiers
IPSD: Slice 0 featured FATAL errors on 18 visits:
"Src list should contain at least 20 objects"
No FATAL errors on any other Slices
ap: similar failures as in rlp1213
Production hung apparently due to event queuing error
rlp1219 CFHT D4 40 June 6 9:57 PT /lsst/DC3root/rlp1219 2nd 31 amplifiers
Same Slice 0 FATAL exception as in rlp1218
Ran to completion
rlp1229 CFHT D3 5 June 18 /lsst/DC3root/rlp1229 Run to test changes to ip_diffim
ap: every visit failed in stage 2 (process): "Cannot start processing for visit 695833: visit is not in-flight",
in stage 7 (preprocess): "new object from DIASource 1494332968468498 ra,dec=(214.235, 52.7706) x,y=(9, 4577) not in any chunk overlapping FOV with center (214.867, 52.6781), radius=0.75: new object would go to chunk 9830769; distance to FOV center is 0.393728 deg"
Cause: found conflicting ap pipeline still running
Perf. stats
rlp1230 CFHT D3 5 June 18 /lsst/DC3root/rlp1230 Run to test changes to ip_diffim (same config as rlp1229)
ap: no failures
rlp1231 CFHT D3 5 June 18 /lsst/DC3root/rlp1231 Run to test changes to ip_diffim
ap: no failures
Perf. stats
rlp1232 CFHT D3 5 June 18 /lsst/DC3root/rlp1232 Run to test changes to ip_diffim
ap: no failures
Perf. stats
rlp1233 CFHT D3 85 June 19 /lsst/DC3root/rlp1233 Production run on 1st 31 amplifiers of D3
rlp1234 CFHT D3 85 June 19 /lsst/DC3root/rlp1234 Production run on 2nd 31 amplifiers of D3
rlp1235 CFHT D4 2 June 20 /lsst/DC3root/rlp1235 Failed production run on D4; unknown problem
abeipsd0069 CFHT D3 3 July 5 /lsst/DC3root/abeipsd0069 Run on NCSA Abe cluster with 37 nodes, 288 Slices processing 36*8=288 amplifiers of D3
rlp1247 CFHT D4 73 July 16 /lsst/DC3root/rlp1247 Production run on 2nd 32 amplifiers of D4
died when disk got full; no other failures
Perf. stats
rlpabe041 CFHT D3 12 July 24 /lustre/DC3root/rlpabe041 Full 288-amplifier exposures processed simultaneously
Currently, only log files available in directory

Attachments