wiki:PT1_1Report111510
Last modified 8 years ago Last modified on 12/10/2010 12:22:07 PM

Table of Contents

  1. Other Activity

Previous month PT 1.1 - Mgt/SE

Current month Mgt/SE

Next month PT1.1 - Mgt/SE

Guide on Reporting Percentage Completed:

For software development tasks:

  • use 0% if the solution is still being designed;
  • use 25% if the solution's design is completed;
  • use 50% if the solution is implemented and tested within the Ticket branch;
  • use 75% if the implementation review is complete, the Ticket branch has been merged onto the Trunk branch, and the Ticket is closed.
  • use 100% if the affected Trunk packages are tagged and released.

For level of effort tasks, use % of effort expended rounded to nearest 5%:

For other tasks, still use these increments, but apply their meaning as best as possible:

  • use 0% if the deliverable is still being designed;
  • use 25% if the deliverable's design is completed;
  • use 50% if the deliverable is implemented awaiting review/approval;
  • use 75% if the deliverable has been reviewed and in revision;
  • use 100% if the deliverable is approved and posted to appropriate repository.

Note: Please place an asterisk (*) after the percent if you updated this value in this report.

Task Start Finish Resources (lead first) % Complete Comments Last Updated
Environment and Tools Plante Ray
Support trac, svn, systems administration 8/30/10 11/1/10 Pietrowicz Steve[15%] 100% * Mon 11/29/10
ImSim Data Krughoff Simon All fields have been simulated and transferred to NCSA. Reference catalogs have been delivered to S.M. and have been ingested. Reference catalogs have also been used to rebuild indexes for astrometry.net 11/17/2010
Create ImSim Data Flow for PT 1.1 from all image generation sites 9/1/10 10/22/10 Plante Ray[25%],Krughoff Simon[25%] 100%* All fields generated and transferred to NCSA. Mon 11/29/2010
Generate reference star galaxy catalogs (turn on magnitudes, w/improved photometry) 9/20/10 11/2/10 Krughoff Simon[30%],Gibson Rob 100% Star catalog generation complete. 10% of stars flagged as variable. Galaxy generation complete to r < 23, sufficient. Delivered to Serge M. Fri 11/12/10
Import reference catalogs into Gator for comparison to output catalogs 11/3/10 11/4/10 Monkewitz Serge[50%] 0% NA
Production-Pipeline-Stage Middleware Pietrowicz Steve Runs being executed as the stack is updated; durations scripted completed; additional work on logging implemented.
Improve Logging performance, reporting, error checking 8/23/10 11/2/10 Pietrowicz Steve[10%],Daues Greg[10%] 50% Runs being executed to test new stack code; durations scripts completed so execution can be done for reports; logging system speed ups; Log statements with CPU time, Sys time, Wall time need to be implemented throughout (not just visits), and will be shortly. Mon 11/29/10 that point to
Update Event Monitor for execution statistics 9/6/10 11/2/10 Pietrowicz Steve[15%] 100% * Completed Mon 11/29/10
Improve shutdown mechanism for data stack 11/3/10 11/3/10 Daues Greg[10%],Pietrowicz Steve[35%] 0% Not required for production runs. NA
Complete JobOffice? implementation to allow integration of Source Association 9/2/10 10/22/10 Plante Ray[50%] 50% Implementation is completed; includes unit tests; need to complete integration tests Tue 10/12/10
Automate transfer of data to/from MSS for staging/storing results of a production tool 9/9/10 10/26/10 Plante Ray[10%],Adams Darren 75% Limited capability in 1.1, more extensive in 1.2 Tue 10/12/10
Data Release Production Architecture and Performance Lim KT
Data Access Middleware and Database Lim KT
Pass through comments in FITS headers 10/20/10 11/2/10 Lim KT[25%] 0% Some design done, unclear if this will make PT1.1. Requires changes to afw, exposure, persistence of them. Also would implement preserving header order with this. Sun 10/10/10
Persist image characterization matches against reference catalog 10/25/10 11/1/10 Lang Dustin, Lim KT 25% 10/25/10
Point Source Photometry Lupton Robert
Implement photometry/astrometry flag 10/20/10 11/2/10 Lang Dustin[50%] 0% NA
Implement aperture corrections 8/23/10 10/26/10 Bickerton Steve[50%] 50% Mon 10/18/10
Galaxy Photometry Bosch Jim 10/24/2010
Determine fitting code failure modes 8/23/10 10/29/10 Bosch Jim[10%],Dubcovsky Martin[50%] 90% Testing on individual CCDs, characterizing failures (progress is essentially open-ended). Wed 11/10/2010
Determine fitting outputs to be stored in database 10/28/10 10/29/10 Bosch Jim[10%],Dubcovsky Martin[50%] 100% Determining additional flags for modeling failures. Sun 10/24/2010
Update Source class for galaxy photometry, incl formatters 9/6/10 11/1/10 Monkewitz Serge[50%],Lupton Robert[50%] 25% New meas::algorithms should support this, needs to be confirmed Tue 10/12/10
Source Association Serge Monkewitz
Define SDQA metrics for Source Association 8/23/10 10/22/10 Monkewitz Serge[50%],Axelrod Tim[25%] 75% initial metrics defined Tue 11/02/10
Implement SDQA metrics for Source Association 8/26/10 11/2/10 Monkewitz Serge[50%] 50% Working on ref to object catalog matching. Tue 11/02/10
Change Source Association to use inverse variance weighting and calibrated fluxes 11/2/10 11/4/10 Monkewitz Serge[50%] 0% NA
Build and Test Allsman Robyn 11/1/10
Monitor buildbot integration and test 9/6/10 10/29/10 Allsman Robyn[25%] 80% Failure email now uses direct locator to error log; Still working on upgrade of slaves to gcc 4.4 to bring into alignment with development software environment 11/29/10
Production Runs Daues Greg
App debug/practice runs on lsst with ImSim data 10/20/10 11/2/10 Daues Greg[10%] 0% NA
Abe runs with ImSim data subsets 11/5/10 11/18/10 Daues Greg[50%] 15% A practice run has processed Imsim visit v85661762-fr (189 CCDs) using the 4.1.0.x software stack with no reported errors/exceptions. A 6-visit run will be initiated after Apps updates in response to the 1-visit run are complete. Want to freeze stack on 11/1/10, will do a series of runs between now and then. Want 3-day turn-around on fixes. Fri 10/15/10
User Support Shaw Dick
Prepare Data Challenge Handbook 8/23/10 11/2/10 Shaw Dick[50%] 65% * Awaiting requested input on details of processing algorithms. Technical review now planned for 10-Dec. 11/29/10
Organize DM User Support 9/20/10 11/9/10 Shaw Dick[50%] 65% * Most User Support issues resolved, except HelpDesk software. Planning for pre-AAS session on PT1.1 data access is underway. 11/29/10
Configure/tune catalogs 11/10/10 11/23/10 Becla Jacek[10%] 25% Loaded schema for reference catalog to EA. 11/29/10
Data Analysis Axelrod Tim A few initial tasks done. Bulk of analysis awaits larger output data sets
DM Scientist/Engineer? data analysis 10/20/10 11/2/10 Axelrod Tim[50%],Lupton Robert[50%],Bosch Jim[50%],Becker Andy[50%],Van Dyk Schuyler[25%],Shaw Dick[50%] ACB:50% ACB:Completed unified pipeline runs on phot test data; currently comparing to input catalogs. Results: completeness to 23rd magnitude; PSF flux uncertainties need to have 1.2% added in quadrature on the bright end to be commensurtae with scatter; photometry repeatibility to 1.5% on bright end. 11/29/10
Science Collaboration data analysis 11/10/10 12/7/10 Science Collaboration 0% NA
Data analysis report 12/1/10 12/7/10 Axelrod Tim[50%],Lupton Robert[50%],Bosch Jim[50%],Becker Andy[50%],Van Dyk Schuyler[25%],Shaw Dick[50%],Science Collaboration 0% NA

Other Activity