| Version 9 (modified by srp, 9 years ago) (diff) |
|---|
Previous month Apps Middleware/Infrastructure - Current Apps - Next month Apps Middleware/Infrastructure
Middleware/Infrastructure? Status Report for May 15, 2010
Guide on Reporting Percentage Completed:
For software development tasks,
- use 0% if the solution is still being designed;
- use 25% if the solution's design is completed;
- use 50% if the solution is implemented and tested within the Ticket branch;
- use 75% if the implementation review is complete, the Ticket branch has been merged onto the Trunk branch, and the Ticket is closed.
- use 100% if the affected Trunk packages are tagged and released.
For other tasks, still use these increments, but apply their meaning as best as possible.
Note: Please place an asterisk (*) after the percent if you updated this value in this report.
Allsman Robyn
Reported xx/xx/xx
| ID | Percent | Task | Comments |
| MWI827 | 0% | prototype buildbot script to run pipeline unittest | not started |
*Percent updated in this report
Comments:
Other Activities
Baker Bill
Reported 4/19/10
| ID | Percent | Task | Comments |
| MWI569 | 20% | Maintain automated testing structure | avg 3-5 hours a week |
| MWI41 | 25% | Support distributable VMs for new developers | |
| MWI74 | 50% | configure test sytem for automated V&V | |
| MWI637 | 25% | Automated standards checking script | have spent about 50 hours on this |
| MWI638 | 0% | Buildbot to detect ABI changes on trunk | not started |
| MWI661 | 0% | Advanced interslice communications support | not started |
| MWI662 | 0% | Machine-readable inputs/outputs manifest | not started |
| MWI707 | 25% | Automating nightly DC3b run | have spent about 5 hours so far |
*Percent updated in this report
Comments:
Other Activities
Time spent lately (I'm 50%, averaging 20-25 hours per week on LSST):
- pex_policy - new features, maintenance, bug fixes - avg 5-8 hours a week for the last few months
- latest big time sink has been developing a web interface for Parasoft -- spent 40-50 hours on it so far, 75% finished
- Maintain buildbot (automated testing infrastructure) - about 3-5 hours a week
- Misc (meetings, email, small tasks) - maybe 3-5 hours per week
Becker Andy
Reported xx/xx/xx
| ID | Percent | Task | Comments |
| MWI838 | 0% | Chop CFHT data by amp | not started |
*Percent updated in this report
Comments:
Other Activities
Becla Jacek
Reported 04/16/10
| ID | Percent | Task | Comments |
| MWI681 | 75%* | Updates: exposure-related tables | |
| MWI691 | 20% | Partitioning: design partitioning of MovingObject? table | |
| MWI693 | 75% | Tools for partitioning data | |
| MWI831 | 60% | qserv: MyProxy? | |
| MWI832 | 25%* | DB backup and replication | |
| MWI700 | 25% | Benchmarking | |
| MWI160 | 25% | capturing full SW/HW info | |
| MWI159 | 0% | demonstrating re-creation of Calibrated Science Images | not started |
| MWI165 | 41% | support persistence and retrieval of deep detection products and inputs | |
| MWI465 | 40% | implement objectId synchronization between data releases (not DC3) |
*Percent updated in this report
Comments:
Other Activities
Daues Greg
Reported 05/20/10
| ID | Percent | Task | Comments |
| MWI656 | 50% | Pipeline shutdown mechanisms | |
| MWI664 | 0% | Freeze-drying clipboards: Harness support | not started |
| MWI106 | 0% | Work to support communication of general serializable types over MPI | not started |
| MWI107 | 0% | Develop mechanisms for identifying/accessing | not started |
| MWI113 | 50% | Improving harness exception handling | |
| MWI709 | 50% | Improve simple, interactive harness execution: interface |
*Percent updated in this report
Comments:
- For MWI656, within the context of ticket #1259, added support for the ShutdownThread? using event objects and filtering with runid. This is a crucial addition to prevent shutdown events from unintentionally affecting other running pipelines.
- For MWI113, with repect tp tickets 1271/1272, added immediate Clipboard cleanup & deletion after failure stage execution to prevent any further use of that Clipboard.
- Within the context of ticket #1259 added support to pex_harness for a command line option on run scripts to specify a unique log directory. Each worker Pipeline within a workflow/production needs to write to a unique location, and this is now ready and working within tag 3.6.8, having been tested with ctrl_orca.
Other Activities
Freemon Mike
Reported xx/xx/xx
| ID | Percent | Task | Comments |
| MWI849 | 0% | Prepare LSST10 for primary catalog database | not started |
*Percent updated in this report
Comments:
Other Activities
Gehrig David
Reported xx/xx/xx
| ID | Percent | Task | Comments |
| MWI723 | 25%* | Image file access server ready | |
| MWI724 | 25%* | Unify account management procedures - svn mysql linux svn | |
| MWI722 | 90% | Prepare LSST2 for iRODS | |
| MWI848 | 30% | Prepare LSST1 as web data server / schema browser | |
| MWI849 | 0% | Prepare LSST10 for primary catalog database | not started |
| MWI837 | 50%* | Download CFHT Data |
*Percent updated in this report
Comments:
Other Activities
- Updated MWI project plan reflecting design review scoping changes
Hanushevsky Andy
Reported xx/xx/xx
| ID | Percent | Task | Comments |
| MWI165 | 41% | support persistence and retrieval of deep detection products and inputs |
*Percent updated in this report
Comments:
Other Activities
Lim KT
Reported xx/xx/xx
| ID | Percent | Task | Comments |
| MWI691 | 20% | Partitioning: design partitioning of MovingObject? table | |
| MWI160 | 25% | capturing full SW/HW info | |
| MWI159 | 0% | demonstrating re-creation of Calibrated Science Images | not started |
| MWI165 | 41% | support persistence and retrieval of deep detection products and inputs | |
| MWI465 | 40% | implement objectId synchronization between data releases (not DC3) | |
| MWI180 | 0% | persistence framework refinement | not started |
| MWI643 | 0% | Upgrade OutputStage? to register outputs | not started |
| MWI644 | 0% | Implement simple, non-Policy retrieval | not started |
| MWI645 | 0% | App Class: remove need to declare friend classes | not started |
| MWI646 | 0% | App Class: remove intrusiveness of Boost persistence | not started |
| MWI647 | 0% | App Class: legacy file-based persistence/retrieval | not started |
| MWI648 | 0% | Python pers: investigate efficiency of methods | not started |
| MWI649 | 0% | Python pers: define app class interface | not started |
| MWI650 | 0% | Implement simple non-Policy persistence | not started |
| MWI651 | 0% | Upgrade InputStage? | not started |
| MWI652 | 0% | Generic ORM: mapping attributes to columns | not started |
| MWI653 | 0% | Generic ORM: collection persistence and retrieval | not started |
| MWI663 | 0% | Freeze-drying clipboards: design | not started |
| MWI673 | 0% | Determine, retrieve cutout areas over given sky tile | not started |
| MWI675 | 0% | Write to co-add template pixel store on sky tile basis | not started |
| MWI674 | 0% | Determine template pixels overlaying given coords | not started |
| MWI676 | 0% | Retrieve template pixels | not started |
| MWI677 | 0% | Investigate local disk use for postage stamp generation | not started |
*Percent updated in this report
Comments:
Other Activities
Monkewitz Serge
Reported xx/xx/xx
| ID | Percent | Task | Comments |
| MWI690 | 25% | Partitioning: research htm/healpix/stomp/dif | |
| MWI692 | 0% | Implement generic query partitioner | not started |
| MWI693 | 75% | Tools for partitioning data | |
| MWI696 | 0% | DC3b syntax parser and aggregation | not started |
| MWI465 | 40% | implement objectId synchronization between data releases (not DC3) | |
| MWI669 | 100% | Determine segment images over a given sky tile | |
| ? | 75% | Spatial support for qserv and corresponding MySQL UDFs |
*Percent updated in this report
Comments:
Other Activities
Pietrowicz Steve
Reported 05/20/10
| ID | Percent | Task | Comments |
| MWI658 | 0% | I/O stage for interactive pipeline launch | not started |
| MWI659 | 50% | Refactor Orca | Released and being used in testing. Working on Abe Plug-ins. Time Spent: 2 weeks |
| MWI538 | 0% | Event Monitor integration | not started |
| MWI589 | 0% | Pipeline Fault Tolerance | not started |
| MWI570 | 50%* | Events orchestration layer support | Implemented in Orca and in pex_harness. Time Spent: 2 weeks |
*Percent updated in this report
Comments:
Other Activities
Plante Ray
Reported 05/15/10
| ID | Percent | Task | Comments |
| MWI624 | 75% | User preferences directory | |
| MWI625 | 75% | Support user/server tags | |
| MWI626 | 0% | Improve packages installation/declaration | not started |
| MWI627 | 25% | Improve EUPS Docs | |
| MWI628 | 0% | Meta releases | not started |
| MWI629 | 0% | User publishing of packages to server | not started |
| MWI631 | 0% | As-built manifests into install directories | not started |
| MWI632 | 0% | Make SConsUtils dependency on EUPS optional | not started |
| MWI633 | 0% | Upgrade SConsUtils for latest Scons | not started |
| MWI641 | 50% | Logging tasks | initial pattern for logging established; some debugging/refinement needed |
| MWI840 | 25% | Update and test stack for latest product versions | |
| MWI841 | 75% | Job scheduling via JobOffice/Blackboard? | still needs data butler integration to support source association. Time spent: 2 weeks development, 1 week testing/integration |
| MWI670 | 25% | LRU cache for raw segment images | |
| MWI671 | 25% | LRU cache for calibrated science exposures | |
| MWI672 | 25% | Write/retrieve images to disk/tape | |
| MWI725 | 100% | Define directory structure | Time spent: ~3 days |
| MWI848 | 0% | Prepare LSST1 as web data server / schema browser | not started |
*Percent updated in this report
Comments:
Other Activities
- IVOA Interoperability conference: May 13-21
- Consulted with Pietrowicz and Daues on completion of orca/harness updates
- Integration testing: testing and debug joboffice middleware for actual pipelines
- package maintenance on cluster and Abe.
Wang Daniel
Reported 04/20/10
| ID | Percent | Task | Comments |
| MWI165 | 41% | support persistence and retrieval of deep detection products and inputs |
*Percent updated in this report
Comments:
Other Activities
Objectives for the Next Period
What you expect to accomplish.
NCSA
LSSTC
Database Group
Problems Encountered and Solutions Being Pursued
Budget or schedule variance, technical issues, management issues.
NCSA
LSSTC
Database Group
