wiki:db/tests/MySql/LargeTables
Last modified 6 years ago Last modified on 04/27/2013 01:42:33 PM

Large tables

Test data: skinny version of DC Winter2013 RunDeepForcedSource table, 3 billion rows, created as:

create table rdfs (
  `id` bigint(20) NOT NULL PRIMARY KEY,
  `objectId` bigint(20) NOT NULL,
  `coord_ra` double DEFAULT NULL,
  `coord_decl` double DEFAULT NULL,
  `coord_htmId20` bigint(20) DEFAULT NULL,
  `parent` bigint(20) DEFAULT NULL,
  `exposure_id` bigint(20) NOT NULL,
  `exposure_filter_id` int(11) NOT NULL
);

INSERT INTO rdfs 
  SELECT id, objectId, coord_ra, coord_decl, 
         coord_htmId20, parent, exposure_id, 
         exposure_filter_id 
  FROM DC_W13_Stripe82.RunDeepForcedSource 
  LIMIT 3000000000;

(the above took 15 hours 10 min 12.21 sec on lsst10, size: 171 GB MYD, 49 GB MYI)