Ticket #511 (closed new functionality: fixed)

Opened 11 years ago

Last modified 7 years ago

automated run cleanup

Reported by: jbecla Owned by: jbecla
Priority: normal Milestone:
Component: database Keywords:
Cc: smm Blocked By:
Blocking: #460 Project: LSST
Version Number:
How to repeat:

not applicable

Description

During DC2, per-run databases were deleted using a "delete a run when its creator remembers to do so" policy. Considering that the debugging process often resulted in tens of databases for failed runs, each containing a complete copy of the input Object catalog, this seems like a good (and easy) target for improvement.

Let's keep a database table which contains the following fields for each run:

  • run database name
  • expiration date

Run initialization would be modified to include the following steps

  • perform cleanup actions for every run in the global run table that expired
  • insert run information into the global run table, setting the expiration date to a default value (say one week)

Developers would also be provided with a trivial convenience script to extend run expiration date. Super-users would be able to set the expiration date to infinitely, effectively permanently preventing selected runs from deletion.

Note that performing cleanup immediately prior to launching a run ensures that the run has access to as much free space as possible, and avoids run/cleanup database contention that could occur when cleanup is scheduled to occur periodically. On the other hand, run initialization time could be adversely affected.

Change History

comment:1 Changed 11 years ago by jbecla

  • Blocking 460 added

comment:2 Changed 11 years ago by jbecla

  • Status changed from new to assigned

Related document: dbProvInDC3

comment:3 Changed 11 years ago by jbecla

  • Status changed from assigned to inTicketWork

comment:4 Changed 11 years ago by jbecla

  • Status changed from inTicketWork to inStandardsReview
  • Owner changed from jbecla to smm

This is implemented now in DMS/cat/trunk/sql

comment:5 Changed 10 years ago by robyn

  • Owner changed from smm to jbecla
  • Status changed from inStandardsReview to inTrunkMerge

Jacek agrees this ticket is ready to close.

comment:6 Changed 10 years ago by robyn

  • Status changed from inTrunkMerge to inQaReview
  • Owner changed from jbecla to robyn

comment:7 Changed 10 years ago by robyn

  • Status changed from inQaReview to closed
  • Resolution set to fixed

comment:8 Changed 10 years ago by robyn

  • Owner changed from robyn to jbecla

comment:9 Changed 7 years ago by robyn

  • Milestone DC3a MW DB deleted

Milestone DC3a MW DB deleted

Note: See TracTickets for help on using tickets.