Version 2 (modified by jbecla, 6 years ago) (diff)


Database Ingest


  • Custom loader that takes input data from pipelines and loads to qserv
  • Input data: pipelines will be delivering data in chunks as produced by individual pipeline processes. Format: most likely fits tables.
  • The loader loads data atomically, e.g. entire chunk either loaded successfully, or not loaded at all.
  • Loader dependencies: afw (because of fits tables, and qserv loader API)