wiki:MWInfReport111509
Last modified 9 years ago Last modified on 11/24/2009 12:47:30 PM

Previous month Apps Middleware/Infrastructure - Current Apps - Next month Apps Middleware/Infrastructure

Middleware/Infrastructure? Status Report for November 15, 2009

Guide on Reporting Percentage Completed:

For software development tasks,

  • use 0% if the solution is still being designed;
  • use 25% if the solution's design is completed;
  • use 50% if the solution is implemented and tested within the Ticket branch;
  • use 75% if the implementation review is complete, the Ticket branch has been merged onto the Trunk branch, and the Ticket is closed.
  • use 100% if the affected Trunk packages are tagged and released.

For other tasks, still use these increments, but apply their meaning as best as possible.

Note: Please place an asterisk (*) after the percent if you updated this value in this report.

Baker Bill

Reported xx/xx/xx

IDPercentTaskComments
MWI56920% *Maintain automated testing structureAdded tests for trunk vs. current
MWI4175%(BB) support distributable VMs for new developers
MWI7450%configure test sytem for automated V&V
MWI6370%Automated standards checking scriptnot started
MWI6380%Buildbot to detect ABI changes on trunknot started
MWI64065% *Validated policy filesMerged and standard reviewed, but waiting for code review; may be tagged before that happens though.
MWI6610% *Advanced interslice communications supportnot started -- is this the data mapping thing? If so, it is started; design is finished, so it should be 25%. I'll be working on it next.
MWI6620%Machine-readable inputs/outputs manifestnot started
MWI7070%Automating nightly DC3a runnot started

*Percent updated in this report

Comments:

Other Activities

Becla Jacek

Reported 11/19/09

IDPercentTaskComments
MWI6800%Updates: source-related tables, Object tablenot started, note progress with the design captured at APP53
MWI6810%Updates: exposure-related tablesnot started
MWI6820%Synthetic sources of datanot started
MWI68425%Standardizing names
MWI6865%Evaluate hadoopDB
MWI687100%*MySQL: test scalability and architect
MWI6910%Partitioning: design partitioning of MovingObject? tablenot started
MWI6930%Tools for partitioning datanot started
MWI6970%Task manager: design presentationnot started
MWI7000%Benchmarkingnot started
MWI7010%Data Release toolsnot started
MWI7020%Documentationnot started
MWI1600%capturing full SW/HW infonot started
MWI1590%demonstrating re-creation of Calibrated Science Images not started
MWI1650%support persistence and retrieval of deep detection products and inputsnot started
MWI4650%implement objectId synchronization between data releases (not DC3)not started

*Percent updated in this report

Comments:

Other Activities

See my section in the middleware report

Bosch Jim

Reported xx/xx/xx

IDPercentTaskComments
MWI6855%Near neighbor query over 2 or 3 nodes
MWI6940%Basic generic query parser in placenot started
MWI6950%Demonstrate joining Object table with non-partitioned tablesnot started
MWI6960%DC3b syntax parser and aggregationnot started
MWI6980%Task manager: multiple queriesnot started
MWI6990%Task manager: interations with usernot started
MWI7010%Data Release toolsnot started
MWI7020%Documentationnot started

*Percent updated in this report

Comments:

Other Activities

Cribbs Chris

Reported xx/xx/xx

Other Activities

Daues Greg

Reported 09/24/09

IDPercentTaskComments
MWI655100%*Refactor harness
MWI6560%Pipeline shutdown mechanismsnot started
MWI6640%Freeze-drying clipboards: Harness supportnot started
MWI1060%Work to support communication of general serializable types over MPI not started
MWI1070%Develop mechanisms for identifying/accessing not started
MWI1130%Improving harness exception handlingnot started
MWI66025%Improve simple, interactive harness execution: infrastructure
MWI70925%Improve simple, interactive harness execution: interface
  • With respect to MWI655, Ticket 924 for the new Stage API has been reviewed, merged to trunk, and tagged (pex_harness 3.4).
  • Work on MWI660 MWI709 continues under the auspices of ticket 1014. Some work has been checked in but more additions are forthcoming.

*Percent updated in this report

Comments:

Other Activities

Gehrig David

Reported xx/xx/xx

IDPercentTaskComments
MWI470%build warnings if unittest doesn't satisfy DC3 coverage requirement not started
MWI520%any failures cause automatic 'Failed Nightly Build' ticket at high priority not started
MWI540%any failure causes automatic 'Failed Production sanity check' ticket at high prioritynot started
MWI550%auxiliary automatic notification to highest authority on failure (separate from ticket notification) not started
MWI570%Standards: specify requirement to version and archive build's provenance;not started
MWI580%Configuration Management: define procedure to satisfy that requirement;not started
MWI590%Configuration Management: implement its instantiation. not started

*Percent updated in this report

Comments:

Other Activities

Hanushevsky Andy

Reported xx/xx/xx

IDPercentTaskComments
MWI1650%support persistence and retrieval of deep detection products and inputsnot started

*Percent updated in this report

Comments:

Other Activities

Krughoff Simon

Reported xx/xx/xx

IDPercentTaskComments
0%life-support servicesnot started

*Percent updated in this report

Comments:

Other Activities

Laher Russ

Reported xx/xx/xx

IDPercentTaskComments
MWI4810%Pythonnot started

*Percent updated in this report

Comments:

Other Activities

Lim KT

Reported xx/xx/xx

IDPercentTaskComments
MWI6910%Partitioning: design partitioning of MovingObject? tablenot started
MWI6980%Task manager: multiple queriesnot started
MWI6990%Task manager: interations with usernot started
MWI7020%Documentationnot started
MWI1600%capturing full SW/HW infonot started
MWI1590%demonstrating re-creation of Calibrated Science Images not started
MWI1650%support persistence and retrieval of deep detection products and inputsnot started
MWI4650%implement objectId synchronization between data releases (not DC3)not started
MWI1800%persistence framework refinementnot started
MWI6430%Upgrade OutputStage? to register outputsnot started
MWI6440%Implement simple, non-Policy retrievalnot started
MWI6450%App Class: remove need to declare friend classesnot started
MWI6460%App Class: remove intrusiveness of Boost persistencenot started
MWI6470%App Class: legacy file-based persistence/retrievalnot started
MWI6480%Python pers: investigate efficiency of methodsnot started
MWI6490%Python pers: define app class interfacenot started
MWI6500%Implement simple non-Policy persistencenot started
MWI6510%Upgrade InputStage?not started
MWI6520%Generic ORM: mapping attributes to columnsnot started
MWI6530%Generic ORM: collection persistence and retrievalnot started
MWI6630%Freeze-drying clipboards: designnot started
MWI6690%Determine segment images over a given sky tilenot started
MWI6700%LRU cache for raw segment imagesnot started
MWI6710%LRU cache for calibrated science exposuresnot started
MWI6720%Write/retrieve images to disk/tapenot started
MWI6730%Determine, retrieve cutout areas over given sky tilenot started
MWI6750%Write to co-add template pixel store on sky tile basisnot started
MWI6740%Determine template pixels overlaying given coordsnot started
MWI6760%Retrieve template pixelsnot started
MWI6770%Investigate local disk use for postage stamp generationnot started

*Percent updated in this report

Comments:

Other Activities

Monkewitz Serge

Reported xx/xx/xx

IDPercentTaskComments
MWI69025%*Partitioning: research htm/healpix/stomp/dif
MWI6920%Implement generic query partitionernot started
MWI69375%*Tools for partitioning data
MWI6960%DC3b syntax parser and aggregationnot started
MWI4650%implement objectId synchronization between data releases (not DC3)not started

*Percent updated in this report

Comments:

Other Activities

Pietrowicz Steve

Reported xx/xx/xx

IDPercentTaskComments
MWI66550%Expose Event API working on adding types and reworking serialization
MWI6660%Scripts to monitor for node/pipeline failuresnot started
MWI6670%Python-based high-level event monitor scriptsnot started
MWI22825%Event system failover
MWI6580%I/O stage for interactive pipeline launchnot started
MWI65950%Refactor Orca Now working on integration with ABE with Condor and DAGman
MWI5380%Event Monitor integrationnot started
MWI5890%Pipeline Fault Tolerancenot started
MWI5700%Events orchestration layer supportnot started

*Percent updated in this report

Comments:

Other Activities

  • Reviewed Condor/Globus? documentation for pending DAGman addition to Orca
  • Added Globus/Condor? software to common area for everyone to use.

Plante Ray

Reported 11/24/09

IDPercentTaskComments
MWI62450%*User preferences directory Additional testing will be done via a release while working on other tasks below.
MWI62550%*Support user/server tags same as above
MWI6260%Improve packages installation/declaration initial planning started
MWI62725%Improve EUPS Docs
MWI6280%Meta releasesnot started
MWI6290%User publishing of packages to servernot started
MWI6310%As-built manifests into install directoriesnot started
MWI6320%Make SConsUtils dependency on EUPS optionalnot started
MWI6330%Upgrade SConsUtils for latest Sconsnot started
MWI6410%Logging tasksnot started

*Percent updated in this report

Comments:

Other Activities

  • Travel: IVOA Meeting in Munich; 11/9-13
  • Preparations for December Review took priority over DC3 tasks
  • assisting Freemon in assessment of available hardware resources

Major Accomplishments

Significant breakthroughs, issues resolved.



Objectives for the Next Period

What you expect to accomplish.

NCSA

LSSTC

Database Group



Problems Encountered and Solutions Being Pursued

Budget or schedule variance, technical issues, management issues.

NCSA

LSSTC

Database Group