Changes between Version 38 and Version 39 of db/obsolete/ActionItems


Ignore:
Timestamp:
11/16/2007 10:58:28 PM (12 years ago)
Author:
jbecla
Comment:

major cleanup of old (done) action items, added today's action items

Legend:

Unmodified
Added
Removed
Modified
  • db/obsolete/ActionItems

    v38 v39  
    22 
    33[wiki:LSSTDatabase LSST Database] 
     4 
     5'''2007-11-16, DataAccWG''' 
     6 * document results from decimal compression tests [KT] 
     7 * schedule meeting !DataAcc-ApplicationWG [Jacek] 
     8 * come up with specific deliverables for DC3-scalable architecture [Jacek] 
     9 * research hadoop [Andy] 
     10 
     11 
     12 
    413 
    514'''2007-07-11, DataAccWG''' 
     
    1726 
    1827'''2007-06-29, DataAccWG''' 
    19  * look into pipeline/harness [KT] 
     28 * ~~look into pipeline/harness [KT]~~ 
    2029 * document Alert email discussion [Lynne] 
    2130 
     
    2837 
    2938 
    30 '''2007-06-20, DataAccWG''' 
     39~~'''2007-06-20, DataAccWG'''~~ 
    3140 * ~~schema change: flagging provisional objects [Jacek]~~ 
    3241 * ~~follow up with transient working group [Lynne, Serge]~~ 
     
    3746 * redo schema for Source Classification table, add probability [Jacek] 
    3847 
    39 '''DBMSStorage [K-T]''' 
     48~~'''DBMSStorage [K-T]'''~~ 
    4049 * ~~Create realistic (but not fully real) test cases.  Probably Exposure and DIASource for output; maybe DIASource or Object for input.~~ 
    4150 * ~~Import code into SVN.~~ 
     
    4453 
    4554 
    46 '''2007-05-25, DataAccWG''' 
     55~~'''2007-05-25, DataAccWG'''~~ 
    4756 * ~~propose metadata definition [Tim, by June 1st]~~ 
    4857 
    4958 
    50 '''2007-05-23, DataAccWG''' 
     59~~'''2007-05-23, DataAccWG'''~~ 
    5160 * ~~find why we need historical DIASource for Association Pipeline [Jacek]~~ 
    5261 * ~~merge MOPS schema with Precursor Schema [Jacek, Francesco]~~ 
     
    6574 * ~~db software installation on ncsa hardware: Coral, MySQL [due June 30, Jacek]~~ 
    6675 * performance tests of ncsa hardware [July 15 Serge] 
    67  * ~~deployment of CIS, DBMSStorage [July 31, K-T] 
     76 * ~~deployment of CIS, DBMSStorage [July 31, K-T]~~ 
    6877 * db and underlying file system tuning (ncsa  hardware) [Aug 30, all] 
    6978 * ~~integration of schema with application code and input image data [Aug 30, Jacek]~~ 
    7079 
    7180'''Schema related changes for DC2 and beyond [Jacek]''' 
    72  * merge Object_photoZ with Object for nightly 
     81 * ~~merge Object_photoZ with Object for nightly~~ 
    7382 * rework source classif - move to provenance, add probability 
    74  * add column to DIASource to keep track of data source (dc2 only) 
    75  * flag "dirty" in Object Catalog to mark rows that need to be writen from in-memory table to disk 
    76  * match table 
    77  * need a flag in Object table to mark provisional objects (objects produced at the base camp, not by deep detection) 
    78  * schema for DIASourceIdTonight table 
    79  * Source table: add scalar value(s) to capture short term variability (discussed at DataAccWG, 2007/07/11) 
    80  * rework image metadata for DC2: "flat" model at CCD level, not Amp level 
     83 * ~~add column to DIASource to keep track of data source (dc2 only)~~ 
     84 * ~~flag "dirty" in Object Catalog to mark rows that need to be writen from in-memory table to disk~~ 
     85 * ~~match table~~ 
     86 * ~~need a flag in Object table to mark provisional objects (objects produced at the base camp, not by deep detection)~~ 
     87 * ~~schema for DIASourceIdTonight table~~ 
     88 * ~~Source table: add scalar value(s) to capture short term variability (discussed at DataAccWG, 2007/07/11)~~ 
     89 * ~~rework image metadata for DC2: "flat" model at CCD level, not Amp level~~ 
    8190 * ~~object table: xyColor should be "NULL", not "NOT NULL"~~ 
    8291   * ~~muRA, muDecl and parallax too?~~ 
     
    113122 
    114123 
    115 '''2007-05-11, DataAccWG''' 
    116  * document in trac issue about binding queries [K-T] 
     124~~'''2007-05-11, DataAccWG'''~~ 
     125 * ~~document in trac issue about binding queries [K-T]~~ 
    117126 * ~~rebuild CORAL [K-T/Jacek]~~ 
    118  * document in UML: formatters / thread safety [K-T] 
    119  * get coral approved [Jacek] 
     127 * ~~document in UML: formatters / thread safety [K-T]~~ 
     128 * ~~get coral approved [Jacek]~~ 
    120129 * ~~measure CORAL performance overhead [K-T]~~ 
    121130 * ~~check when Maria is back [Ani]~~ 
     
    123132 
    124133 
    125 '''2007-05-09, DataAccWG telecon about metadata''' 
     134~~'''2007-05-09, DataAccWG telecon about metadata'''~~ 
    126135 
    127 For Jeff Bartels, check on May 23 
    128  * use cases 
    129  * which columns in current schema belong to metadata 
    130  * sizes, in particular 
    131    * average number of metadata elements per Object, Source and DIASource 
    132    * distinct values vs values shared between many Objects/Sources/DIASources 
    133  * flexibility vs speed 
    134  * interaction between pipelines ad metadata stored in database, in particular during Alert Generation 
    135  * schema design: what to store in metadata, what to store in main "core" tables 
     136~~For Jeff Bartels, check on May 23~~ 
     137 * ~~use cases~~ 
     138 * ~~which columns in current schema belong to metadata~~ 
     139 * ~~sizes, in particular~~ 
     140   * ~~average number of metadata elements per Object, Source and DIASource~~ 
     141   * ~~distinct values vs values shared between many Objects/Sources/DIASources~~ 
     142 * ~~flexibility vs speed~~ 
     143 * ~~interaction between pipelines ad metadata stored in database, in particular during Alert Generation~~ 
     144 * ~~schema design: what to store in metadata, what to store in main "core" tables~~ 
    136145 
    137146Unassigned 
     
    140149 
    141150 
    142 '''2007-05-08, discussion with Tim''' 
    143  * add flag "data source" to Object catalog - for DC2 only [Jacek] 
     151~~'''2007-05-08, discussion with Tim'''~~ 
     152 * ~~add flag "data source" to Object catalog - for DC2 only [Jacek]~~ 
    144153 
    145 '''2007-05-04, DataAccWG telecon''' 
     154~~'''2007-05-04, DataAccWG telecon'''~~ 
    146155 
    147 nightly processing 
    148  * understand poor-disk performance during loading chunks from disk to memory [Serge] 
    149  * try doing cross match using extract from Object table (objId, ra, decl, x,y,z) [Serge] 
     156~~nightly processing~~ 
     157 * ~~understand poor-disk performance during loading chunks from disk to memory [Serge]~~ 
     158 * ~~try doing cross match using extract from Object table (objId, ra, decl, x,y,z) [Serge]~~ 
    150159 * ~~check with application people about cross matching against var object [Jacek]~~  
    151160 * ~~try doing cross match first against variable objects first [Serge]~~ 
    152161 * ~~document requirements / assumptions [Jacek]~~ 
    153162 * ~~investigate why dropping in-memory table slow [Serge]~~ 
    154  * test number of tables per db to find sweet spot [Serge] 
     163 * ~~test number of tables per db to find sweet spot [Serge]~~ 
    155164 * ~~check with Tim whether proper motion adjustment will be made only during deep detection, or during nightly processing too [Jacek]~~ 
    156165 
     
    162171 * sql stored procedures coding standards [Jeff] 
    163172 * ~~check existing standards related to stored procedures [Ani]~~ 
    164  * investigate how easy is to move disks/RAM from lsst-dev03 to lsst-dev02 [Jacek] 
     173 * ~~investigate how easy is to move disks/RAM from lsst-dev03 to lsst-dev02 [Jacek]~~ 
    165174 
    166175