| Version 8 (modified by daues, 10 years ago) (diff) |
|---|
Status Report for October 15, 2009
Guide on Reporting Percentage Completed:
For software development tasks,
- use 0% if the solution is still being designed;
- use 25% if the solution's design is completed;
- use 50% if the solution is implemented and tested within the Ticket branch;
- use 75% if the implementation review is complete, the Ticket branch has been merged onto the Trunk branch, and the Ticket is closed.
- use 100% if the affected Trunk packages are tagged and released.
For other tasks, still use these increments, but apply their meaning as best as possible.
Note: Please place an asterisk (*) after the percent if you updated this value in this report.
The "ID" number corresponds to the "Unique ID" column in the Middleware/Infrastructure?/DB project plan, a PDF of which is attached at wiki:DC3bManagement.
Allsman Robyn
Reported 15/Oct/2009
| ID | Percent | Task | Comments |
| MWI710 | 0% | Coverage Checker Release for developer use: Python | not started |
| MWI37 | 0% | Create table of Science Data Analysts | minimal progress |
| MWI725 | 75% * | Initial Release Code Standards Check | 17 modules checked and forwarded to developers; 3 non-C++; rest waiting on compilable trunk version requisite for Standards Checking |
| MWI726 | 0% | Final DC3b Code Standards Check | not started |
*Percent updated in this report
Comments:
Other Activities
- nudging holders of ancient Tickets to complete and or close them
- reviewing the C++ Coding Standards in light of the infraction reports generated by the Standards checker. Preparing TCT proposal for revision of some Rules due to inconsistency between Rules, developer resistance to 'illogical' rules, etc.
- using the EA Test Case Generator on the DC3 model to generate preliminary DC3b integration test case requirements.
Axelrod Tim
Reported xx/xx/xx
| ID | Percent | Task | Comments |
| MWI683 | 0% | Defining units | not started |
| MWI744 | 0% | Report scalability results | not started |
| MWI731 | 0% | DC3b Report | not started |
*Percent updated in this report
Comments:
Other Activities
Baker Bill
Reported 10/13/2009
| ID | Percent | Task | Comments |
| MWI569 | 10% | Maintain automated testing structure | ongoing; okay |
| MWI41 | 75% | (BB) support distributable VMs for new developers | |
| MWI74 | 50% | configure test sytem for automated V&V | |
| MWI637 | 0% | Automated standards checking script | not started |
| MWI638 | 0% | Buildbot to detect ABI changes on trunk | not started |
| MWI640 | 25% | Validated policy files | in review |
| MWI661 | 0% | Advanced interslice communications support | not started |
| MWI662 | 0% | Machine-readable inputs/outputs manifest | not started |
| MWI707 | 0% | Automating nightly DC3a run | Ray making bash script |
*Percent updated in this report
Comments:
Other Activities
Becla Jacek
Reported 10/15/09
| ID | Percent | Task | Comments |
| MWI680 | 0% | Updates: source-related tables, Object table | discussions started (Oct 6 and Oct 9 DataAcc telecons) |
| MWI681 | 0% | Updates: exposure-related tables | not started |
| MWI682 | 0% | Synthetic sources of data | not started |
| MWI684 | 25% | Standardizing names | |
| MWI686 | 5% | Evaluate hadoopDB | |
| MWI687 | 50%* | MySQL: test scalability and architect | |
| MWI688 | 100%* | Decide xrootd versus gearman | |
| MWI689 | 100%* | Run near neighbor query on lsst10 | dbSpatialJoinPerf? |
| MWI691 | 0% | Partitioning: design partitioning of MovingObject table | started, see MOPSPartitioning |
| MWI693 | 0% | Tools for partitioning data | not started |
| MWI697 | 0% | Task manager: design presentation | not started |
| MWI700 | 0% | Benchmarking | not started |
| MWI701 | 0% | Data Release tools | not started |
| MWI702 | 0% | Documentation | not started |
| MWI160 | 0% | capturing full SW/HW info | not started |
| MWI159 | 0% | demonstrating re-creation of Calibrated Science Images | not started |
| MWI165 | 0% | support persistence and retrieval of deep detection products and inputs | not started |
| MWI465 | 0% | implement objectId synchronization between data releases (not DC3) | not started |
*Percent updated in this report
Comments:
Other Activities
- LSST
- mysql performance/scalability tests for 1 billion row table, primarily to understand how to deal with the lsst reference catalog
- debugging problems with mysql authorization (for buildbot tests), see http://bugs.mysql.com/bug.php?id=47843
- multiple discussions related to scalable architecture
- documented sql sub-set to be supported in DC3b dbScalableArchSQL
- organized 3 DataAccWG telecons
- XLDB
- wrote draft XLDB report
- SciDB
- coordinating input from science about benchmark
- coordinating involvement of 3 developers from Persistent Systems (via telecons/emails)
- discussions about scidb documentation
- met with eBay
- two telecons with East Coast VCs
- Others
- gave invited talk at Los Alamos Computer Science Symposium (LACSS) 2009 (involved travel to Santa Fe, NM)
Bosch Jim
Reported xx/xx/xx
| ID | Percent | Task | Comments |
| MWI685 | 5% | Near neighbor query over 2 or 3 nodes | |
| MWI688 | 0% | Decide xrootd versus gearman | not started |
| MWI694 | 0% | Basic generic query parser in place | not started |
| MWI695 | 0% | Demonstrate joining Object table with non-partitioned tables | not started |
| MWI696 | 0% | DC3b syntax parser and aggregation | not started |
| MWI698 | 0% | Task manager: multiple queries | not started |
| MWI699 | 0% | Task manager: interations with user | not started |
| MWI701 | 0% | Data Release tools | not started |
| MWI702 | 0% | Documentation | not started |
*Percent updated in this report
Comments:
Other Activities
Cribbs Chris
Reported xx/xx/xx
| ID | Percent | Task | Comments |
| MWI721 | 0% | Update NCSA cluster for Lustre kernel | not started |
*Percent updated in this report
Comments:
Other Activities
Daues Greg
Reported xx/xx/xx
| ID | Percent | Task | Comments |
| MWI655 | 50%* | Refactor harness | |
| MWI656 | 0% | Pipeline shutdown mechanisms | not started |
| MWI664 | 0% | Freeze-drying clipboards: Harness support | not started |
| MWI106 | 0% | Work to support communication of general serializable types over MPI | not started |
| MWI107 | 0% | Develop mechanisms for identifying/accessing | not started |
| MWI113 | 0% | Improving harness exception handling | not started |
| MWI660 | 25% | Improve simple, interactive harness execution: infrastructure | |
| MWI709 | 25%* | Improve simple, interactive harness execution: interface | |
| MWI748 | 0% | Configure cluster for final release | not started |
*Percent updated in this report
- For MWI660 a large portion of Python thread based code has been merged with the code of MWI655 (for the new stage API) and is now being tested. Updated run/launching scripts are part of this code update, and so I have moved MWI709 off of "not started" to 25%
Comments:
Other Activities
Dubois-Felsmann Gregory
Reported xx/xx/xx
| ID | Percent | Task | Comments |
| MWI737 | 0% | Identify hardward platform | not started |
*Percent updated in this report
Comments:
Other Activities
Gehrig David
Reported xx/xx/xx
| ID | Percent | Task | Comments |
| MWI47 | 0% | build warnings if unittest doesn't satisfy DC3 coverage requirement | not started |
| MWI52 | 0% | any failures cause automatic 'Failed Nightly Build' ticket at high priority | not started |
| MWI54 | 0% | any failure causes automatic 'Failed Production sanity check' ticket at high priority | not started |
| MWI55 | 0% | auxiliary automatic notification to highest authority on failure (separate from ticket notification) | not started |
| MWI57 | 0% | Standards: specify requirement to version and archive build's provenance; | not started |
| MWI58 | 0% | Configuration Management: define procedure to satisfy that requirement; | not started |
| MWI59 | 0% | Configuration Management: implement its instantiation. | not started |
| MWI635 | 0% | New ticket workflow | not started |
| MWI747 | 0% | Configure platform for initial release | not started |
| MWI746 | 0% | Stage data to platform | not started |
| MWI748 | 0% | Configure cluster for final release | not started |
| MWI745 | 0% | Stage data to production platform | not started |
*Percent updated in this report
Comments:
Other Activities
Hanushevsky Andy
Reported xx/xx/xx
| ID | Percent | Task | Comments |
| MWI165 | 0% | support persistence and retrieval of deep detection products and inputs | not started |
*Percent updated in this report
Comments:
Other Activities
Krughoff Simon
Reported xx/xx/xx
| ID | Percent | Task | Comments |
| MWI665 | 75% | Expose Event API | |
| MWI228 | 0% | Event system failover | not started |
| MWI666 | 0% | Scripts to monitor for node/pipeline failures | not started |
| MWI667 | 0% | Python-based high-level event monitor scripts | not started |
| MWI658 | 0% | I/O stage for interactive pipeline launch | not started |
| 0% | life-support services | not started | |
| MWI538 | 0% | Event Monitor integration | not started |
| MWI570 | 0% | Events orchestration layer support | not started |
*Percent updated in this report
Comments:
Other Activities
Laher Russ
Reported xx/xx/xx
| ID | Percent | Task | Comments |
| MWI481 | 0% | Python | not started |
*Percent updated in this report
Comments:
Other Activities
Lim KT
Reported xx/xx/xx
| ID | Percent | Task | Comments |
| MWI688 | 0% | Decide xrootd versus gearman | not started |
| MWI691 | 0% | Partitioning: design partitioning of MovingObject? table | not started |
| MWI698 | 0% | Task manager: multiple queries | not started |
| MWI699 | 0% | Task manager: interations with user | not started |
| MWI702 | 0% | Documentation | not started |
| MWI160 | 0% | capturing full SW/HW info | not started |
| MWI159 | 0% | demonstrating re-creation of Calibrated Science Images | not started |
| MWI165 | 0% | support persistence and retrieval of deep detection products and inputs | not started |
| MWI465 | 0% | implement objectId synchronization between data releases (not DC3) | not started |
| MWI180 | 0% | persistence framework refinement | not started |
| MWI643 | 0% | Upgrade OutputStage? to register outputs | not started |
| MWI644 | 0% | Implement simple, non-Policy retrieval | not started |
| MWI645 | 0% | App Class: remove need to declare friend classes | not started |
| MWI646 | 0% | App Class: remove intrusiveness of Boost persistence | not started |
| MWI647 | 0% | App Class: legacy file-based persistence/retrieval | not started |
| MWI648 | 0% | Python pers: investigate efficiency of methods | not started |
| MWI649 | 0% | Python pers: define app class interface | not started |
| MWI650 | 0% | Implement simple non-Policy persistence | not started |
| MWI651 | 0% | Upgrade InputStage? | not started |
| MWI652 | 0% | Generic ORM: mapping attributes to columns | not started |
| MWI653 | 0% | Generic ORM: collection persistence and retrieval | not started |
| MWI663 | 0% | Freeze-drying clipboards: design | not started |
| MWI669 | 0% | Determine segment images over a given sky tile | not started |
| MWI670 | 0% | LRU cache for raw segment images | not started |
| MWI671 | 0% | LRU cache for calibrated science exposures | not started |
| MWI672 | 0% | Write/retrieve images to disk/tape | not started |
| MWI673 | 0% | Determine, retrieve cutout areas over given sky tile | not started |
| MWI675 | 0% | Write to co-add template pixel store on sky tile basis | not started |
| MWI674 | 0% | Determine template pixels overlaying given coords | not started |
| MWI676 | 0% | Retrieve template pixels | not started |
| MWI677 | 0% | Investigate local disk use for postage stamp generation | not started |
*Percent updated in this report
Comments:
Other Activities
Lupton Robert
Reported xx/xx/xx
| ID | Percent | Task | Comments |
| MWI738 | 0% | Evaluate performance of ported algorithm | not started |
| MWI740 | 0% | Determine scope of data | not started |
| MWI744 | 0% | Report scalability results | not started |
*Percent updated in this report
Comments:
Other Activities
Monkewitz Serge
Reported xx/xx/xx
| ID | Percent | Task | Comments |
| MWI690 | 0% | Partitioning: research htm/healpix/stomp/dif | not started |
| MWI692 | 0% | Implement generic query partitioner | not started |
| MWI693 | 0% | Tools for partitioning data | not started |
| MWI696 | 0% | DC3b syntax parser and aggregation | not started |
| MWI465 | 0% | implement objectId synchronization between data releases (not DC3) | not started |
*Percent updated in this report
Comments:
Other Activities
Pietrowicz Steve
Reported 10/15/09
| ID | Percent | Task | Comments |
| MWI659 | 50% | Refactor Orca | in review |
| MWI665 | 50% * | Expose Event API | This was incorrectly marked last month. This is pending design review. |
| MWI228 | 25% * | Event system failover | |
| MWI666 | 0% | Scripts to monitor for node/pipeline failures | not started |
| MWI667 | 0% | Python-based high-level event monitor scripts | not started |
| MWI658 | 0% | I/O stage for interactive pipeline launch | not started |
| MWI229 | 0% | life-support services | not started |
| MWI538 | 0% | Event Monitor integration | not started |
| MWI570 | 0% | Events orchestration layer support | not started |
*Percent updated in this report
Comments:
Other Activities
- Working on fixing problems detected by code analysis tool.
- Working on clearing tickets
- Working on solution for standalone data areas for things that need them (like ActiveMQ), so users don't step on each other using a common scratch space.
- Ticket tested fix, and released #959
- Consulting with Tim and Francesco about ActiveMQ.
Plante Ray
Reported 10/14/09
| ID | Percent | Task | Comments |
| MWI624 | 25% | User preferences directory | Implementation is complete. Because I have a few more unittests to add, I cannot yet close this ticket. Completion to 50% expected this week. |
| MWI625 | 25% | Support user/server tags | Implementation is complete; a bit more testing is needed. Completion to 50% expected this week. |
| MWI626 | 0% | Improve packages installation/declaration | most of this work is already done as part of above work, but I won't finish this off until MWI624, MWI625 are complete |
| MWI627 | 25% | Improve EUPS Docs | |
| MWI628 | 0% | Meta releases | not started |
| MWI629 | 0% | User publishing of packages to server | not started |
| MWI631 | 0% | As-built manifests into install directories | not started |
| MWI632 | 0% | Make SConsUtils dependency on EUPS optional | not started |
| MWI633 | 0% | Upgrade SConsUtils for latest Scons | not started |
| MWI641 | 0% | Logging tasks | not started |
| MWI732 | 0% | DC3b Production Run | not started |
| MWI731 | 0% | DC3b Report | not started |
*Percent updated in this report
Comments:
Other Activities
- supported Freemon and Cribbs with Infrastructure cost sheet estimates
- worked on sub-contract renewal
- reviewed file management demo plan
- code reviews
Resource_Names
Reported xx/xx/xx
| ID | Percent | Task | Comments |
| Text2 | Percent_Complete | Name |
*Percent updated in this report
Comments:
Other Activities
Science Collaboration
Reported xx/xx/xx
| ID | Percent | Task | Comments |
| MWI724 | 0% | Science Algorithm Verification | not started |
| MWI730 | 0% | Science Algorithm Verification | not started |
*Percent updated in this report
Comments:
Other Activities
TBD
Reported xx/xx/xx
| ID | Percent | Task | Comments |
| MWI739 | 0% | Perform the initial port | not started |
| MWI738 | 0% | Evaluate performance of ported algorithm | not started |
| MWI742 | 0% | Run ported algorithm | not started |
| MWI743 | 0% | Collect metrics, assess | not started |
| MWI744 | 0% | Report scalability results | not started |
*Percent updated in this report
Comments:
Other Activities
Major Accomplishments
Significant breakthroughs, issues resolved.
Objectives for the Next Period
What you expect to accomplish.
NCSA
LSSTC
Database Group
Problems Encountered and Solutions Being Pursued
Budget or schedule variance, technical issues, management issues.
NCSA
LSSTC
Database Group
