wiki:AppReport051510
Last modified 9 years ago Last modified on 05/22/2010 01:45:02 PM

Previous month Apps Middleware/Infrastructure - Current MW/Inf - Next month Apps MW/Inf

Apps Status Report for May 15, 2010

Guide on Reporting Percentage Completed:

For software development tasks,

  • use 0% if the solution is still being designed;
  • use 25% if the solution's design is completed;
  • use 50% if the solution is implemented and tested within the Ticket branch;
  • use 75% if the implementation review is complete, the Ticket branch has been merged onto the Trunk branch, and the Ticket is closed.
  • use 100% if the affected Trunk packages are tagged and released.

For other tasks, still use these increments, but apply their meaning as best as possible.

Note: Please place an asterisk (*) after the percent if you updated this value in this report.

Allsman Robyn

Reported 21 May 2010

IDPercentTaskComments
APP20075%*validate initial integration run successfully completed

*Percent updated in this report

Comments: Initial integration is ongoing. Science validation of the output products is still underway. Integration of 5 of the six pipelines into the pipeline orchestration layer is complete. The 6th pipeline is independently functional but its inclusion into the Production pipeline awaits a refinement of the handshake between differently parallelized pipelines. Testing on ABE has not begun.

Other Activities

Axelrod Tim

Reported xx/xx/xx

IDPercentTaskComments
APP1550%photometric self calibrationnot started
APP5680%defining units
APP26120%create calibration catalogs for CFHTLS
APP2910%create input data for ImSimnot started
APP26350%identify set of images for compression tests
APP26090%define DC3b data quality requirements
APP2040%identify scientists to analyze stage outputnot started
APP1990%PT1 best efforts science data analysis/validation not started
APP19150%Provide special case simulation needs (Axelrod)

*Percent updated in this report

Comments:

Other Activities

Becker Andy

Reported 05/20/10

IDPercentTaskComments
APP24650%update Diff-Im post design review (ticket 1176)
APP24525%implement correlation function for spatial kernal fit (ticket 1140)
APP1000%test difference imaging coaddsnot started
APP24740%code to measure quality of difference imaging coadds
APP123100%find CFHT fringe frames and move to NCSA*

*Percent updated in this report

Comments:

Other Activities

All time has been spend on DC3b data staging and debugging activities.

Becla Jacek

Reported 05/20/10

IDPercentTaskComments
APP5475%schema updates for all exposure related tables
APP550%synthetic sources of datanot started
APP5680%defining units

*Percent updated in this report

Comments:

Other Activities

See middleware status report

Bickerton Steve

Reported xx/xx/xx

IDPercentTaskComments
APP29525%stellar photometry
APP2560%compute statistics on a sky pixel masked imagenot started

*Percent updated in this report

Comments:

Other Activities

Dodd Suzy

Reported 5/21/10

Worked with Jeff on IPAC Statement of Work and review of proposed DM organization.

Ran May 5 Apps WG for Robert.

Review DC3b Plan and DM PDR plan

Track status on IPAC SDQA and SUI PT1 work.

Standard meetings: Apps WG, DC3b, SAT, DM management, LSST management, 2 pm stand ups

Next Month:

Run DM PMC meetings for Jeff in June

Define SUI all hands break out with Schuyler and Suzanne

Good John

Reported 5/21/10

IDPercentTaskComments
APP22650%*code PT1 SUI tools|

*Percent updated in this report

Comments: Adapted Gator and VOInventory tools for LSST PT1. Waiting on table data from KT to test/update tools.

Other Activities

Jarvis Mike

Reported 5/20/10

IDPercentTaskComments
APP10550%PSF for deep detectionCompleted review of class design. Full code review still pending.

*Percent updated in this report

Comments:

Other Activities

Krughoff Simon

Reported xx/xx/xx

IDPercentTaskComments
APP840%apply fringe frame correctionnot started
APP8375%develop camera state classes (CCDinfo and Ampinfo)
APP8225%develop calibration products database classes
APP2530%implement ccd assembly code with appropriate stage codenot started
APP2520%test camera geometry classess with ImSim LSST focal plane modelnot started
APP25118%implement datarel.IsrStageUnit? Test
APP25025%write stage dictionaries and unit tests for ValidateMetaData? and CalibrationDataProducts?
APP24925%create policy files for ImSim camera geometry
APP2540%move saturation and defect correction to the CCD assembly stagenot started

*Percent updated in this report

Comments:

Other Activities

Laher Russ

Reported 5/21/10

IDPercentTaskComments
APP900%implement SDQA tool functionality to support DC3b goalsnot started
? 75%* Thoth GUI for database visualization and statistical analysis new task
APP890%query metadata and package in C++ containernot started
APP880%implement threshold comparisionnot started
APP21175%WCS verification code
APP21075%ATpy evaluation
? 50%* Develop common SQL queries for SDQA and DC3b data validation new task
APP28350%*identify existing sdqa metrics
APP28250%code to validate ISR pipeline outputs
APP2815%code to validate IC pipeline outputsstarted
APP2800%code to validate image subtractionnot started
APP2880%code to validate detection of sources in subtracted imagenot started
APP2900%code to validate association pipelinenot started
APP2870%code to validate deep detection and measurement pipelinenot started

*Percent updated in this report

Comments: worked on SDQA metrics and queries.

Other Activities

Levine Deborah

Reported 5/21/10

IDPercentTaskComments
APP900%implement SDQA tool functionality to support DC3b goalsnot started
APP22950%*identify tools to support PT1 data analysis
APP22750%*manage PT1 data access tools tasknot started
APP23525%design and document SUI in UMLnot started

*Percent updated in this report

Comments:

Supported SDQA SPIE paper design

Tracked SUI status for PT1

Regular meetings

Other Activities

Lim KT

Reported 5/20/10

IDPercentTaskComments
APP60%interslice communicationsnot started
APP70%post spatial matching (stretch goal)not started
APP19275%translate overall production into pipeline, stages, and policies

*Percent updated in this report

Comments: I'm hoping that once PT1 production starts up I can sit down and think about a more up-to-date list of the apps tasks on my plate.

Other Activities

Lupton Robert

Reported xx/xx/xx

IDPercentTaskComments
APP1390%integrate HEALPix into software stacknot started
APP1000%test difference imaging coaddsnot started
APP12150%adapt astrometry code for DC3b use

*Percent updated in this report

Comments:

Other Activities

Mannings Vince

Reported xx/xx/xx

IDPercentTaskComments
APP2350%design and document SUI in UMLnot started

*Percent updated in this report

Comments:

Other Activities

Monet Dave

Reported xx/xx/xx

IDPercentTaskComments
APP12150%adapt astrometry code for DC3b use

*Percent updated in this report

Comments:

Other Activities

Monkewitz Serge

Reported 5/21/10

IDPercentTaskComments
APP1440%move applications code out of stage codenot started
APP1620%modify stage code to conform with new MW APInot started
APP24465%implement/wrap OPTICS source clustering algorithm
APP2430%implement Detection/Source? associationnot started (not required for PT1)
APP60%interslice communicationsnot started
APP70%post spatial matching (stretch goal)not started
APP740%characteriztion of and improvements to association cosmic ray rejection performancenot started

*Percent updated in this report

Comments: All association pipeline work for PT1

Other Activities

Mullally Fergal

Reported xx/xx/xx

IDPercentTaskComments
APP8660%implement improvements for WCS
APP15160%implement stage structure for support astrometry code

*Percent updated in this report

Comments:

Other Activities

Myers Jon

Reported 5/20/10

IDPercentTaskComments
APP14025%integrate MOPS stages with new C++ KD-Tree tools
APP12950%*run DayMOPS with solar system model
APP14190%write linkTracklets and unit tests
APP267100%update DayMOPS for new DIASource Table
APP26525% make DIASource the smallest unit of Tracks and MovingObject??
APP26425%update DayMOPS to stop using template tablesnot started
APP27025%remove DIASourceForTonight table, pass DIASource on clipboard
APP2690%pass Tracks on clipboard rather than via Tracks tablenot started
APP26850%*made a new initial stage which gets night numbers from Policy

*Percent updated in this report

Comments:

  • Plans to improve integration into DayMops? framework held up while we wait for SAT to determine appropriate methods for allowing stages to process data sets too large to fit in memory; presented a plan/algorithm for how to allow MOPS to process data sets too large to fit in memory using a database and put it up at DatabaseBackedTracklets .
  • Decided to use Cobalt, the (very) large shared-memory machine at Purdue, for testing existing C implementations which have large inputs and/or outputs. Got access through Mike Freemon and TeraGrid?.
  • Generated tracklets at at velocity ranges 0 to 0.5, 0 to 1.0, and 0 to 2.0 for full set of DC3b PT2 ephemerides with deep stack ephemerides removed. Both the C and C++ implementations of findTracklets were used.

Other Activities

  • Built new buffered TrackletVector? class used by find/linkTracklets; it can be used to buffer output for findTracklets, periodically writing it to disk, thus preventing out-of-memory errors when running findTracklets.
  • Added new TrackSet? class for linkTracklets, which has fast, useful subset/equality tests, to be used for unit testing and validation.
  • Attempted to write my first full Formatter, before it was nixed as being a bad idea until we hear back from SAT!
  • Performance and functionality improvements in C++ findTracklets

Owen Russ

Reported 5/18/10

IDPercentTaskComments
APP77100%fix ticket #873
APP1390%integrate HEALPix into software stacknot started
APP9425%code to warp images to/from sky pixel representation
APP20950%implement outlier rejection
APP9850%code to create PSF-matched difference imaging coadds (no outlier rejection)
APP25750%code to create deep monochromatic coadds
APP10475%code to detect chi-squared deep detection coadds (no outlier rejection)
APP1030%create a set of chi-squared deep detection coaddsnot started
APP1020%code to measure quality of deep detection coaddsnot started

*Percent updated in this report

Comments: Implemented convolution with adaptive linear interpolation (Mike Jarvis' algorithm). This fixes two tickets:

  • ticket #1198 Convolution is too slow with a spatially varying Linear Combination Kernel that has many basis kernels

This has been merged to afw trunk, but a new version of afw has not yet been tagged. Note that spatially varying separable kernels still use brute force for convolution; we may wish to apply linear interpolation to those at some point, but only if the current code is not deemed fast enough.

Next I intend to focus on implementing HEALPix. I also need to finish some work on testing chi squared coadd.

Other Activities

Pierfederici Francesco

Reported xx/xx/xx

IDPercentTaskComments

*Percent updated in this report

Comments:

Other Activities

Shaw Dick

Reported xx/xx/xx

IDPercentTaskComments
APP240*15% DC3b User Guide
APP2420% create user training program not started
APP2340% develop Use Cases for SUI not started
APP239*100% prepare CFHT-LS Calibration Reference Files done
APP208*100% define CFHT raw data to be used done
APP283*75% Define SDQA Metrics (and subset for PT1)

*Percent updated in this report

Comments:

Other Activities

Van Dyk Schuyler

Reported 5/21/10

IDPercentTaskComments
APP22933%identify tools to support PT1 data analysis
APP2408%DC3b User Guide
APP29650%set up helpdesk system
APP2340%develop Use Cases for SUInot started
APP2350%design and document SUI in UMLnot started
APP26075%define DC3b data quality requirementsdialed back from previous month
APP23060%complete DM system data product quality metrics document
25%develop PT1 data analysis/validation plan
APP1990%PT1 best efforts science data analysis/validation not started

*Percent updated in this report

Comments:

Met with IPAC scientists to work out PT1 validation tasks/assignments.

Ran April 21 Apps WG for Robert.

Supported regular meetings.

Other Activities

Major Accomplishments

Significant breakthroughs, issues resolved.



Objectives for the Next Period

What you expect to accomplish.



Problems Encountered and Solutions Being Pursued

Budget or schedule variance, technical issues, management issues.