wiki:MSEReport091510
Last modified 9 years ago Last modified on 09/27/2010 09:38:50 PM

Table of Contents

    Previous month Apps - MW/Inf - Mgt/SE

    Current month PT1.1

    Next month PT1.1 - Mgt/SE

    Guide on Reporting Percentage Completed:

    FFor software development tasks,

    • use 0% if the solution is still being designed;
    • use 25% if the solution's design is completed;
    • use 50% if the solution is implemented and tested within the Ticket branch;
    • use 75% if the implementation review is complete, the Ticket branch has been merged onto the Trunk branch, and the Ticket is closed.
    • use 100% if the affected Trunk packages are tagged and released.

    For level of effort tasks, use % of effort expended rounded to nearest 5%

    For other tasks, still use these increments, but apply their meaning as best as possible.

    • use 0% if the deliverable is still being designed;
    • use 25% if the deliverable's design is completed;
    • use 50% if the deliverable is implemented awaiting review/approval;
    • use 75% if the deliverable has been reviewed and in revision;
    • use 100% if the deliverable is approved and posted to appropriate repository.

    Note: Please place an asterisk (*) after the percent if you updated this value in this report.

    Management/System? Engineering Status Report for September 15, 2010

    Task Start Finish Resources (lead first) % Complete Comments Last Updated
    Update DM MREFC Cost Estimates 10/29/2010 11/18/2010 Kantor Jeff 0% Monthly
    Update UML-based Application, Middleware Estimates 11/5/2010 11/11/2010 Kantor Jeff 0%
    Update Application, Middleware Cost Estimate and BOE 11/12/2010 11/18/2010 Kantor Jeff 0%
    Update Infrastructure Cost Estimate and BOE 10/29/2010 11/11/2010 Freemon Mike[15%] 0% 9/20/2010
    Publish Estimates via Primavera Web Export 11/12/2010 11/12/2010 Kantor Jeff[50%] 0%
    Update PMCS II Final Design, Construction, Commissioning Plans 10/10/2008 9/16/2010 Kantor Jeff 1% Reviewed PMCS II with David Scott, external consultant from Prime PM Solutions. David will provide support for achieving PDR readiness in PMCS plans. Met with Erik Gottschalk to discuss potential areas of collaboration with FermiLab in Data Management. 20100917
    Update FDP projects 9/3/2010 9/16/2010 Kantor Jeff[5%],Claver Chuck[5%],Jacoby Suzanne[5%],Krabbendam Victor[5%],Kurita Nadine[5%] 0%
    Update T&S MREFC Project 10/10/2008 12/4/2008 Krabbendam Victor[20%] 0%
    Update DM MREFC Project 10/10/2008 12/4/2008 Kantor Jeff[20%] 0%
    Update Camera MREFC Project 10/10/2008 1/1/2009 Kurita Nadine[20%] 0%
    Update PMO, EPO MREFC Projects 10/10/2008 10/16/2008 Kantor Jeff[10%],Krabbendam Victor[10%],Jacoby Suzanne[20%] 0%
    Update Commissioning MREFC Project 10/10/2008 10/16/2008 Kantor Jeff[10%],Krabbendam Victor[10%],Claver Chuck[20%] 0%
    Publish plans via Primavera Web Export 10/10/2008 10/10/2008 Kantor Jeff[50%] 0%
    Database and Data Access Analyses 5/1/2008 11/2/2010 Becla Jacek 80%* Final preparations for large scale tests of qserv. SSD database tests run so far show mysql myisam is unable to efficiently use SSD. Met with commercial vendor/supporter of Hadoop/Hive? to discuss tests with hadoop/hive we run, and how to take advantage of hadoop/hive for lsst. 9/27/2010
    Improve trac db documentation for PDR 9/2/2009 9/14/2010 Becla Jacek[10%] 60%
    Research new db technologies - LOE 5/1/2008 10/26/2010 Becla Jacek[2%],Lim KT[2%],Hanushevsky Andy[2%] 95%* Met with Cloudera, discussed pros/cons of hadoop/hive for LSST, mtg notes will be published in the next few days 9/27/2010
    Interact with sciCollab chairs, refresh list of common queries 12/10/2008 10/27/2010 Becla Jacek[10%] 90% 9/10/2010
    Scalability tests phase II (up to 100 nodes) 9/1/2010 11/2/2010 Wang Daniel 15%* Arranged access to test beds at slac (40 nodes and 100 nodes), preparing software for large scale tests, including implementing scripts for installing/managing the software 9/27/2010
    SSD Database Tests 8/2/2010 9/17/2010 Becla Jacek 80%* See SSDtests, based on tests mysql (myisam) is unable to take full advantage of SSD, we can get max ~30% of expected (raw) performance of the hardware. Next steps include removing software RAID. 9/27/2010
    Update data storage and i/o sizing estimates 9/20/2010 10/1/2010 Becla Jacek[70%],Lim KT[30%] 10% 9/10/2010
    Write design document for PDR 10/4/2010 10/29/2010 Becla Jacek[5%],Lim KT[5%],Hanushevsky Andy[20%] 0%
    MOPS Analyses 10/10/2008 12/4/2008 Axelrod Tim 0% Ran linkTracklets on raw asteroid ephemerides from the Solar System Model (roughly 1/2 years'-worth of observations over a 15x15 window). 103 nights of data generated 900 million tracks, 0.48% of tracks are true. Approximately 70,000 objects were found, yielding approximately 2,500 tracks (and thus Initial Orbit Determinations) per found object. By adjusting the maximum RMS we believe this number of track will be cut in half to 450 million. With current estimates of orbit determination via ranging currently used in PS MOPS, this yields unacceptably high computational requirements (up to 100k CPU hours/day). Other approaches to orbit determination with much lower computational requirements are being evaluated. 20100927
    Test, characterize and document limitations in PS MOPS software for crowded fields, depth, etc. 10/10/2008 10/23/2008 Axelrod Tim[20%],Myers Jonathan[75%] 25% Ran findTracklets, linkTracklets on a large portion of our data sets, coarsely analyzed results and published results here: http://www.lsstcorp.org/MOPSwiki/index.php?title=August2010StatusUpdate. Closely analyzed results from one data set and published results here: http://www.lsstcorp.org/MOPSwiki/index.php?title=Sep2010RmsExperiments
    Define alternative MOPS design 10/24/2008 11/6/2008 Axelrod Tim[20%],Myers Jonathan[75%] 0%
    Prototype key algorithms in MOPS design 11/7/2008 11/20/2008 Axelrod Tim[20%],Myers Jonathan[75%] 0%
    Test, characterize and document limitations in MOPS software for crowded fields, depth, etc. 11/21/2008 12/4/2008 Axelrod Tim[20%],Myers Jonathan[75%] 0%
    Enterprise Architect Customizations 9/3/2010 9/30/2010 Kantor Jeff 0% Cirrus Consulting contacted and is providing estimate for Requirements ID numbering add-in by October 15. 20100927
    Develop Requirements Id Tool 9/3/2010 9/30/2010 Bartels Jeff[50%] 0%
    Complete DM content in OSS 4/1/2010 9/30/2010 Dubois-Felsmann Gregory 60% Scoping requirements created; framework for DQ requirements created and partially populated; remaining requirements written in offline copy of model; relationships with data products diagrammed; Center/Facility/Site? section rewritten; many diagramming and hierarchy issues corrected in DM and non-DM content 9/19/2010
    Extract quantitative requirements from Sizing Model and Data Quality Requirements Document and Scorecard 8/16/2010 9/7/2010 Dubois-Felsmann Gregory[5%] 40%* Sizing requirements created; DQ requirements written, diagrammed, framework created, partially populated 9/19/2010
    Update star and galaxy counts 9/8/2010 9/21/2010 Dubois-Felsmann Gregory[5%] 25%* Consultation with ZI initiated 9/19/2010
    Support establishment of traceability between LSR and OSS 9/1/2010 9/30/2010 Dubois-Felsmann Gregory[15%] 35%* Isolated improvements to traceability in conjunction with additions 9/19/2010
    Revise DM-FRS 9/10/2010 10/8/2010 Dubois-Felsmann Gregory 8% Small cleanups done in conjunction with OSS work 9/19/2010
    Restate existing quantitative requirements as constraint blocks 9/30/2010 10/4/2010 Dubois-Felsmann Gregory[50%] 0%
    Collect performance requirements from DM scientists 9/16/2010 10/4/2010 Dubois-Felsmann Gregory[50%] 20%
    Enter requirements into SysML as constraint blocks 9/21/2010 10/6/2010 Dubois-Felsmann Gregory[50%] 20%
    Establish traceability of FRS to OSS (or elsewhere) 9/23/2010 10/5/2010 Dubois-Felsmann Gregory[50%] 10%
    Review traceability with Tim and Chuck, clean up 10/5/2010 10/8/2010 Dubois-Felsmann Gregory[50%],Axelrod Tim[50%] 0%
    Update Structure Model 9/29/2010 10/11/2010 Dubois-Felsmann Gregory 21% Monthly
    Revise Structure Model to match SysArch? SysML standards 9/30/2010 10/8/2010 Dubois-Felsmann Gregory[50%] 25%
    Update Structure Model to match revised FRS and Reference Design 10/8/2010 10/11/2010 Dubois-Felsmann Gregory[50%] 0%
    Prepare ICDs 10/1/2010 11/16/2010 Dubois-Felsmann Gregory 31% Monthly
    Create DM internal ICD N2 diagram 10/11/2010 10/12/2010 Dubois-Felsmann Gregory[50%] 0%
    DM-EPO 10/1/2010 10/20/2010 Dubois-Felsmann Gregory 7% DM-EPO session held at AHM; significant progress in engaging larger EPO group in understanding what we need; regular DM-EPO contact initiated 9/19/2010
    Establish requirements 10/1/2010 10/13/2010 Jacoby Suzanne,Dubois-Felsmann Gregory[50%] 40%* 9/19/2010
    Adapt to agreed-upon SysML model style 10/13/2010 10/14/2010 Dubois-Felsmann Gregory[50%] 20%* 9/19/2010
    Review result with Suzanne et al. and update 10/14/2010 10/20/2010 Jacoby Suzanne,Dubois-Felsmann Gregory[50%] 0%
    DM-SDS 10/1/2010 10/22/2010 Dubois-Felsmann Gregory 65% DM-SDS session held at AHM
    Live data format and protocol 10/1/2010 10/21/2010 Marshall Stuart,Dubois-Felsmann Gregory[50%] 85%
    Buffered (3-day-store) data protocol 10/8/2010 10/22/2010 Marshall Stuart,Dubois-Felsmann Gregory[50%] 25%
    Prepare draft ICD document for Huffer review 10/21/2010 10/22/2010 100%* Prepared and reviewed by MH, some followup discussion 9/19/2010
    Respond to Huffer comments 10/12/2010 10/20/2010 Marshall Stuart 25%* Substantive discussion at AHM session, but changes not yet captured. (The 90% may have been mistranscribed from another item?) 9/19/2010
    Prepare revised draft 10/20/2010 10/20/2010 0%
    Reference design of connection to metadata 10/20/2010 10/20/2010 Lim KT 0%
    Circulate revised draft for more general review 10/20/2010 10/21/2010 0%
    DM-CCS 10/1/2010 10/25/2010 Dubois-Felsmann Gregory 75% Monthly
    Substance 10/1/2010 10/22/2010 Marshall Stuart 75%
    Documentation 10/5/2010 10/25/2010 0%
    DM-sites 10/25/2010 11/3/2010 Dubois-Felsmann Gregory 0% Monthly
    Review proposed high-level requirements with Jeff Barr and Ron Lambert 10/25/2010 10/29/2010 Barr Jeff 0%
    Revise requirements in SysML model 10/29/2010 11/1/2010 0%
    Circulate draft ICD for review 11/1/2010 11/1/2010 0%
    Respond to comments 11/1/2010 11/3/2010 0%
    Network design 10/11/2010 10/15/2010 Dubois-Felsmann Gregory 0% Monthly
    Separate network requirements and design, review with Ron Lambert 10/11/2010 10/11/2010 0%
    Capture network requirements in SysML model 10/11/2010 10/12/2010 0%
    Circulate draft ICD for review 10/12/2010 10/12/2010 0%
    Respond to comments 10/12/2010 10/14/2010 0%
    Revise network design document to mesh with requirements docgen from SysML 10/14/2010 10/15/2010 0%
    DM-TCS 10/1/2010 11/4/2010 Dubois-Felsmann Gregory 33% Monthly
    Products of DM 10/1/2010 11/4/2010 Sebag Jacques 40%
    Products of TCS 10/1/2010 11/4/2010 Sebag Jacques 25%
    Documentation 11/3/2010 11/4/2010 0%
    DM-OCS 10/1/2010 11/16/2010 Dubois-Felsmann Gregory 23% Monthly
    EFD/Conditions queries 10/1/2010 11/5/2010 Dubois-Felsmann Gregory[50%] 50%
    Live telemetry performance 11/5/2010 11/10/2010 Dubois-Felsmann Gregory[50%] 0%
    System configuration 10/8/2010 11/16/2010 Dubois-Felsmann Gregory[50%] 20%
    Computing security 9/3/2010 9/14/2010 Dubois-Felsmann Gregory 0% Monthly
    Separate requirements and design 9/3/2010 9/7/2010 0%
    Capture requirements in SysML model 9/8/2010 9/8/2010 0%
    Revise security document to mesh with requirements docgen from SysML 9/9/2010 9/9/2010 0%
    Circulate draft ICD for review 9/10/2010 9/10/2010 0%
    Respond to comments 9/10/2010 9/14/2010 0%
    Update App and MW Reference Design for DC3a, DC3b PT1 9/3/2010 10/5/2010 Allsman Robyn 0% DC3b Data Release Production Use Case/Activity? model scrubbed and ready for incorporation into DM Reference Design. 20100927
    Update reference design from DC3a and DC3b/PT1 model 9/3/2010 9/30/2010 Lim KT[50%],Axelrod Tim[50%],Kantor Jeff[25%],Plante Ray[50%],Allsman Robyn[50%],Dubois-Felsmann Gregory[10%] 0%
    Update reference design - structure model traceability 10/1/2010 10/1/2010 Dubois-Felsmann Gregory[10%] 0%
    Update reference design - FRS traceability 10/4/2010 10/5/2010 Dubois-Felsmann Gregory 0%
    Update App and MW Reference Design for PT1 Improvements 9/20/2010 11/4/2010 Allsman Robyn 0% Monthly
    Update design 10/15/2010 10/28/2010 Lim KT[50%],Axelrod Tim[10%],Kantor Jeff[25%],Plante Ray[50%],Allsman Robyn[50%] 0%
    Update traceability 10/29/2010 10/29/2010 Allsman Robyn 0%
    Compare DM app framework and middleware to ALMA, other projects 10/29/2010 11/4/2010 Plante Ray[20%],Lim KT[10%] 0%
    Pipeline Middleware workshop at NCSA 9/20/2010 9/22/2010 Dubois-Felsmann Gregory,Lim KT,Plante Ray,Kantor Jeff 25%* Workshop organized, about to be held. 9/19/2010
    Update Infrastructure Reference Design 9/3/2010 10/28/2010 Freemon Mike 0% Monthly
    Update Mountain/Base? Network Design 9/3/2010 9/16/2010 Lambert Ron[20%] 0%
    Update Long-Haul Network Acquisition Plans 9/3/2010 9/16/2010 Lambert Ron[5%],Kantor Jeff[5%] 0%
    Update Infrastructure Power, Cooling, Floor Space 9/17/2010 9/23/2010 Lambert Ron[10%],Freemon Mike[10%],Jeff Barr[10%] 0%
    Infrastructure Trends and our position (e.g. SSD, GPU, Advanced Processor Architecture, Virtual Shared Memory) 9/24/2010 10/21/2010 Freemon Mike[20%],Dubois-Felsmann Gregory[20%],Lim KT[20%] 10%* Began organization of several GPU evaluation efforts at AHM 9/19/2010
    Develop Performance Budgets, Timing/Sequence? Diagrams for Alert and Data Release 10/22/2010 10/28/2010 Kantor Jeff[20%],Dubois-Felsmann Gregory[20%],Lim KT[20%],Freemon Mike[20%] 20%* 9/10/2010
    Update Computing, Storage Reference Design Documentation 9/3/2010 9/30/2010 Freemon Mike[20%] 0% 9/20/2010
    Update DM Sizing Model 10/29/2010 11/15/2010 Dubois-Felsmann Gregory 0% Initiated review of object counts with Science Council; design for update created. 9/19/2010
    Reorganize DM Sizing Model into single workbooks for Science, Technology Trends, Computing, Storage, Network 10/29/2010 11/1/2010 Kantor Jeff[10%],Freemon Mike[10%],Dubois-Felsmann Gregory[10%],Lim KT[10%] 10%* Basic structure identified and sheet-to-sheet flow diagram created 9/15/10
    Update Science workbook and explanation document 11/2/2010 11/8/2010 Dubois-Felsmann Gregory[10%],Axelrod Tim[10%] 0%
    Update Technology Trends workbook and explanation document 11/2/2010 11/8/2010 Freemon Mike[20%] 0% 9/20/2010
    Consolidate and update Computing workbook and explanation document 11/9/2010 11/15/2010 Dubois-Felsmann Gregory[20%] 0%
    Consolidate and update Storage workbook and explanation document 11/9/2010 11/15/2010 Lim KT[10%],Becla Jacek[10%],Axelrod Tim[10%] 0%
    Update Network workbook and explanation document 11/9/2010 11/10/2010 Lambert Ron[20%] 0%
    Requirements and Design for Science User Interface 8/12/2010 11/3/2010 Van Dyk Schuyler 0% The DM team has developed an initial “best-of-breed” list of current tools/user interfaces as a basis to extract feedback for the reference design. A Science User Interface workshop is planned as a side meeting at AAS and will solicit feedback on these tools and additional requirements from the Science Collaboration leads. These will then be captured as use cases for the DMS reference design and requirements for the OSS. 9/10/2010
    SUI workshop with Science Collaborations, Best-of-Breed UI technologists 10/18/2010 10/19/2010 Van Dyk Schuyler[50%],Dubois-Felsmann Gregory[25%] 5% started 9/10/2010
    Define requirements, integrate into FRS and system requirements 8/12/2010 11/3/2010 Van Dyk Schuyler[50%],Dubois-Felsmann Gregory[25%] 0% 9/10/2010
    Develop Apps Roadmap and Data Quality Plan 9/1/2010 10/15/2010 Axelrod Tim 0% Outline of data quality plan developed. 20100924
    Develop Apps sheet of DM Roadmap 9/1/2010 9/7/2010 Axelrod Tim[20%] 0%
    Adapt DC3b Data Quality Product Requirements Document to LSS Reference Design 9/8/2010 9/17/2010 Axelrod Tim[20%] 25%* Outline of data quality plan developed. 9/11/2010
    Adapt DC3b Metrics Scorecard to LSST Reference Design 9/17/2010 9/24/2010 Axelrod Tim[20%] 0%
    Collect and incorporate Science Council and Science Collaborations review/feedback 9/24/2010 10/15/2010 Axelrod Tim[20%] 0%
    DM Test Plans 9/3/2010 11/9/2010 Allsman Robyn 0% Monthly
    Draft DM Unit Test documents 9/3/2010 9/16/2010 Allsman Robyn[25%] 20% 9/23/10
    Draft DM Integration Test documents 9/17/2010 9/30/2010 Allsman Robyn[25%] 20% 9/23/10
    Draft DM System Test documents 10/1/2010 10/5/2010 Allsman Robyn[35%] 0%
    Draft DM Acceptance Test documents 10/6/2010 10/19/2010 Allsman Robyn[25%] 0%
    Generate Integration Test Cases from DM Ref Design Use Cases/Activities? 10/20/2010 10/26/2010 Allsman Robyn[50%] 0%
    Create Performance System Test Cases from DM Subsystem Requirements Constraint Blocks 10/27/2010 11/2/2010 Allsman Robyn[50%] 0%
    Generate Functional Acceptance Test Cases from DM Subsystem Requirements 11/3/2010 11/9/2010 Allsman Robyn[50%] 0%
    Complete DM Inputs to Risk Management, System Integration, Commissioning, and Operations Plans 12/1/2008 11/11/2010 Kantor Jeff 81% Monthly
    Update DM parts of LSST System Integration Test Plan 9/3/2010 9/16/2010 Allsman Robyn[30%],Freemon Mike[10%],Kantor Jeff[5%] 0%
    Contribute DM sections to LSST Risk Management, Commissioning, I&T, and Operations Plans 4/16/2010 10/14/2010 Kantor Jeff[10%],Allsman Robyn[20%],Axelrod Tim[20%],Plante Ray[20%],Freemon Mike[20%],Dubois-Felsmann Gregory[13%] 89%
    Get MOUs with resource support/commitment from DM partners 10/15/2010 11/11/2010 Kantor Jeff[5%],Van Dyk Schuyler[5%],Freemon Mike[5%],Becla Jacek[5%],Lupton Robert[5%],Lambert Ron[5%] 0%
    PDR final material preparation 11/19/2010 12/10/2010 Kantor Jeff 0% Monthly
    Ensure all documents in docushare updated 11/19/2010 11/24/2010 Kantor Jeff[25%],Axelrod Tim[25%],Plante Ray[25%],Freemon Mike[25%],Dubois-Felsmann Gregory[25%],Allsman Robyn[25%],Becla Jacek[25%],Lim KT[25%] 0%
    Create PDR presentations 11/25/2010 11/30/2010 Kantor Jeff[25%],Axelrod Tim[25%],Plante Ray[25%],Freemon Mike[25%],Dubois-Felsmann Gregory[25%],Allsman Robyn[25%],Becla Jacek[25%],Lim KT[25%] 0%
    Dry Run DM Presentations 12/1/2010 12/6/2010 Kantor Jeff[25%],Axelrod Tim[25%],Plante Ray[25%],Freemon Mike[25%],Dubois-Felsmann Gregory[25%],Allsman Robyn[25%],Becla Jacek[25%],Lim KT[25%] 0%
    Update DM Presentations for Final Version for PDR 12/7/2010 12/10/2010 Kantor Jeff[25%],Axelrod Tim[25%],Plante Ray[25%],Freemon Mike[25%],Dubois-Felsmann Gregory[25%],Allsman Robyn[25%],Becla Jacek[25%],Lim KT[25%] 0%
    Conduct Preliminary Design Review 12/13/2010 12/17/2010 Kantor Jeff[80%],Axelrod Tim[80%],Van Dyk Schuyler[80%],Plante Ray[80%],Freemon Mike[80%],Dubois-Felsmann Gregory[80%],Allsman Robyn[80%],Becla Jacek[80%],Lim KT[80%] 0%