wiki:AppReport041510
Last modified 9 years ago Last modified on 04/26/2010 09:55:53 AM

Previous month Apps Middleware/Infrastructure - Current MW/Inf - Next month Apps? MW/Inf

Apps Status Report for April 15, 2010

Guide on Reporting Percentage Completed:

For software development tasks,

  • use 0% if the solution is still being designed;
  • use 25% if the solution's design is completed;
  • use 50% if the solution is implemented and tested within the Ticket branch;
  • use 75% if the implementation review is complete, the Ticket branch has been merged onto the Trunk branch, and the Ticket is closed.
  • use 100% if the affected Trunk packages are tagged and released.

For other tasks, still use these increments, but apply their meaning as best as possible.

Note: Please place an asterisk (*) after the percent if you updated this value in this report.

Allsman Robyn

Reported xx/xx/xx

IDPercentTaskComments
APP2000%validate initial integration run successfully completednot started

*Percent updated in this report

Comments:

Other Activities

Axelrod Tim

Reported xx/xx/xx

IDPercentTaskComments
APP1550%photometric self calibrationnot started
APP5680%defining units
APP26120%create calibration catalogs for CFHTLS
APP2910%create input data for ImSimnot started
APP26350%identify set of images for compression tests
APP26090%define DC3b data quality requirements
APP2040%identify scientists to analyze stage outputnot started
APP1990%PT1 best efforts science data analysis/validation not started
APP19150%Provide special case simulation needs (Axelrod)

*Percent updated in this report

Comments:

Other Activities

Becker Andy

Reported 04/14/10

IDPercentTaskComments
APP24650%update Diff-Im post design review (ticket 1176)*
APP24525%implement correlation function for spatial kernal fit (ticket 1140)
APP1000%test difference imaging coaddsnot started
APP24740%code to measure quality of difference imaging coadds
APP1230%find CFHT fringe frames and move to NCSAnot started

*Percent updated in this report

Comments:

Other Activities

Becla Jacek

Reported 04/16/10

IDPercentTaskComments
APP5475%*schema updates for all exposure related tables
APP550%synthetic sources of datanot started
APP5680%defining units

*Percent updated in this report

Comments:

Other Activities

Bickerton Steve

Reported xx/xx/xx

IDPercentTaskComments
APP29525%stellar photometry
APP2560%compute statistics on a sky pixel masked imagenot started

*Percent updated in this report

Comments:

Other Activities

Dodd Suzy

Reported 4/19/10

Updated Applications plan for DC3b

Set up logistics for and attend integration week held at IPAC April 5-9. Coordinated side bar meetings on Science User Interface tool for PT1.

Established a plan for PT1 SUI/data access tool and helpdesk.

Meeting with Sidney, Tony, Don, Jeff and George regarding proposed changes to DM organization

Vacation April 12-16

Standard meetings: Apps WG, DC3b, SAT, DM management, LSST management

Next Month

Monitor development of SUI/data access tool for PT1

More DC3b Plan updates?

Good John

Reported 4/19/10

IDPercentTaskComments
APP22610%code PT1 SUI tools|

*Percent updated in this report

Comments:

Confirmed the data content that will be imported into an instance of Gator but there is as yet no example data. Waiting on KT for this. Updating the VOInventory infrastructure to support LSST.

Putting together an LSST-specific (simplified) front-end application to the VOInventory. This is warranted as the general VO interface has too many tie-ins to other VO applications (and is too NVO-specific).

Assuming we receive data, the principle activity this next month will be retrieval, vetting, ingestion, and documentation.

Other Activities

Jarvis Mike

Reported 4/13/10

IDPercentTaskComments
APP10550%PSF for deep detection C++ code is complete in ticket branch. Compiles with scons. Working on Python test code.

*Percent updated in this report

Comments:

Other Activities

Krughoff Simon

Reported xx/xx/xx

IDPercentTaskComments
APP840%apply fringe frame correctionnot started
APP8375%develop camera state classes (CCDinfo and Ampinfo)
APP8225%develop calibration products database classes
APP2530%implement ccd assembly code with appropriate stage codenot started
APP2520%test camera geometry classess with ImSim LSST focal plane modelnot started
APP25118%implement datarel.IsrStageUnit? Test
APP25025%write stage dictionaries and unit tests for ValidateMetaData? and CalibrationDataProducts?
APP24925%create policy files for ImSim camera geometry
APP2540%move saturation and defect correction to the CCD assembly stagenot started

*Percent updated in this report

Comments:

Other Activities

progress:

  • Integration of ImSim data with ISR and ccdAssembly pipelines
  • Investigation of schemes for improving SSM query performance
  • Worked with Yusra to port existing Postgres stored procedures to MS

SQL server

  • Hand reduced calibration products for input to DM pipelines

Plans

  • Continue with integration with DM
  • Begin reduction of ImSim data in earnest
  • Finish queries for SSM and Galaxy objects for Trim catalog generation
  • Continue to examine benefits of commercial DBMS options.

Laher Russ

Reported 4/19/10

IDPercentTaskComments
APP900%implement SDQA tool functionality to support DC3b goalsnot started
? 50%* Thoth GUI for database visualization and statistical analysis new task
APP890%query metadata and package in C++ containernot started
APP880%implement threshold comparisionnot started
APP21175%*WCS verification code
APP21075%ATpy evaluation
? 25%* Develop common SQL queries for SDQA and DC3b data validation new task
APP28325%*identify existing sdqa metrics
APP28250%*code to validate ISR pipeline outputs
APP2810%code to validate IC pipeline outputsnot started
APP2800%code to validate image subtractionnot started
APP2880%code to validate detection of sources in subtracted imagenot started
APP2900%code to validate association pipelinenot started
APP2870%code to validate deep detection and measurement pipelinenot started

*Percent updated in this report

Comments:

Other Activities

Levine Deborah

Reported 04/19/10

IDPercentTaskComments
APP900%implement SDQA tool functionality to support DC3b goalsnot started
APP22925%identify tools to support PT1 data analysis
APP22725%manage PT1 data access tools tasknot started
APP23525%design and document SUI in UMLnot started

*Percent updated in this report

Comments: This list for me is still not terrifically relevant

Other Activities

Supported integration week. SUI task well underway.

Lim KT

Reported xx/xx/xx

IDPercentTaskComments
APP60%interslice communicationsnot started
APP70%post spatial matching (stretch goal)not started
APP19275%translate overall production into pipeline, stages, and policies

*Percent updated in this report

Comments:

Other Activities

Lupton Robert

Reported xx/xx/xx

IDPercentTaskComments
APP1390%integrate HEALPix into software stacknot started
APP1000%test difference imaging coaddsnot started
APP12150%adapt astrometry code for DC3b use

*Percent updated in this report

Comments:

Other Activities

Mannings Vince

Reported xx/xx/xx

IDPercentTaskComments
APP2350%design and document SUI in UMLnot started

*Percent updated in this report

Comments:

Other Activities

Monet Dave

Reported xx/xx/xx

IDPercentTaskComments
APP12150%adapt astrometry code for DC3b use

*Percent updated in this report

Comments:

Other Activities

Monkewitz Serge

Reported 4/19/10

IDPercentTaskComments
APP1440%move applications code out of stage codenot started
APP1620%modify stage code to conform with new MW APInot started
APP24465%implement/wrap OPTICS source clustering algorithmOPTICS implemented, working on computing source cluster attributes
APP2430%implement Detection/Source? associationnot started (not required for PT1)
APP60%interslice communicationsnot started
APP70%post spatial matching (stretch goal)not started
APP740%characteriztion of and improvements to association cosmic ray rejection performancenot started

*Percent updated in this report

Comments:

Support Integration week

Working on Source Asscociation for PT1

Other Activities

Mullally Fergal

Reported xx/xx/xx

IDPercentTaskComments
APP8660%implement improvements for WCS
APP15160%implement stage structure for support astrometry code

*Percent updated in this report

Comments:

Other Activities

Myers Jon

Reported xx/xx/xx

IDPercentTaskComments
APP14025%integrate MOPS stages with new C++ KD-Tree tools
APP12935%run DayMOPS with solar system model
APP14190%*write linkTracklets and unit tests
APP267100%*update DayMOPS for new DIASource Table
APP2660%*Fix C-linkTracklets Python bindingsdescoped*
APP26525% make DIASource the smallest unit of Tracks and MovingObject?? planned
APP26425%*update DayMOPS to stop using template tablesnot started
APP27025%*remove DIASourceForTonight table, pass DIASource on clipboard planned
APP2690%pass Tracks on clipboard rather than via Tracks tablenot started
APP26825%*made a new initial stage which gets night numbers from Policy planned
APP2710%add debug printing to C find/linkTracklets and stage code for storingDescoped*

*Percent updated in this report

Comments:

Extensive study of C++ linkTracklets performance. Incorporated new changes which dramatically speed up C++ linkTracklets, thus removing the need to rely on wrapped C versions.

Finished implementation and (hopefully) debugging of linkTracklets. Wrote many unit tests for linkTracklets, but have more planned based on further discussion.

Wrote new roadmap for DC3b, based on using C++ find/linkTracklets. This removes the issues of dealing with logging/wrapping problems based on C versions. These tasks are marked as "descoped" and should be removed.

New versions of Inter/IntraNightlyProcessingStages? of DayMOPS are planned, which will not use DIASourceForTonight table and will pass DIASources on clipboard.

Other Activities

Much conversation about introducing "DB-backed" FindTracklets and LinkTracklets, which will read and write data to/from the DB as needed rather than attempt to store all data in memory. This is expected to prevent the out-of-memory errors which have plagued our current attempts at running DayMOPS. This design is net yet completely finalized, but more tasks will need to be added in response.

Owen Russ

Reported xx/xx/xx

IDPercentTaskComments
APP770%fix ticket #873not started
APP1390%integrate HEALPix into software stacknot started
APP9425%code to warp images to/from sky pixel representation
APP20950%implement outlier rejection
APP9850%code to create PSF-matched difference imaging coadds (no outlier rejection)
APP25750%code to create deep monochromatic coadds
APP10475%code to detect chi-squared deep detection coadds (no outlier rejection)
APP1030%create a set of chi-squared deep detection coaddsnot started
APP1020%code to measure quality of deep detection coaddsnot started

*Percent updated in this report

Comments:

Other Activities

Pierfederici Francesco

Reported xx/xx/xx

IDPercentTaskComments

*Percent updated in this report

Comments:

Other Activities

Shaw Dick

Reported 4/16/2010

IDPercentTaskComments
APP240*15% DC3b User Guide in work
APP2420% create user training program not started
APP2340% develop Use Cases for SUI not started
APP239*100% prepare CFHT-LS Calibration Reference Files done
APP208*100% define CFHT raw data to be used done
APP283*75% Define SDQA Metrics (and subset for PT1) in work

*Percent updated in this report

Comments:

  • Contributed to definition of DC3b PT1 quality assessment plan, including boot-strap analysis approach
  • Verified CFHT-LS per-amp chunking is working correctly for PT1 processing
  • Contributed to User Support planning
  • Wrote specification for image background check; source code in work

Other Activities

Van Dyk Schuyler

Reported 04/14/10

IDPercentTaskComments
APP22933%identify tools to support PT1 data analysis
APP2408%DC3b User Guide
APP29650%set up helpdesk system
APP2340%develop Use Cases for SUInot started
APP2350%design and document SUI in UMLnot started
APP26075%define DC3b data quality requirementsdialed back from previous month
APP23060%complete DM system data product quality metrics document
25%develop PT1 data analysis/validation plan
APP1990%PT1 best efforts science data analysis/validation not started

*Percent updated in this report

Comments:

Other Activities

Comments:

Other Activities

Major Accomplishments

Significant breakthroughs, issues resolved.



Objectives for the Next Period

What you expect to accomplish.



Problems Encountered and Solutions Being Pursued

Budget or schedule variance, technical issues, management issues.