wiki:FileIOBenchmarks
Last modified 9 years ago Last modified on 04/26/2010 09:21:19 PM

All tests using Sysbench, 16 threads, 80GB total size, 128 files, 640MB/file, block-size 16KB

At A Glance

Reading server-direct-to-SAN: 153MB/s
Reading server-to-NFS-to-SAN:  65MB/s
Writing server-direct-to-SAN: 122MB/s
Writing server-to-NFS-to-SAN:  48MB/s

Sequential Read

Server-to-SAN

Apr 24, 2010; on lsst10 using /usr/data/mysql1/mfreemon

sysbench --test=fileio --file-total-size=80G prepare
sysbench --num-threads=16 --test=fileio --file-total-size=80G \
         --file-test-mode=seqrd --max-time=600 --max-requests=100000000 \
         --file-block-size=16384 --file-fsync-freq=100 \
         run
sysbench 0.4.12:  multi-threaded system evaluation benchmark

Running the test with following options:
Number of threads: 16

Extra file open flags: 0
128 files, 640Mb each
80Gb total file size
Block size 16Kb
Periodic FSYNC enabled, calling fsync() each 100 requests.
Calling fsync() at the end of test, Enabled.
Using synchronous I/O mode
Doing sequential read test
Threads started!
Done.

Operations performed:  5242880 Read, 0 Write, 0 Other = 5242880 Total
Read 80Gb  Written 0b  Total transferred 80Gb  (153.22Mb/sec)
 9806.09 Requests/sec executed

Test execution summary:
    total time:                          534.6555s
    total number of events:              5242880
    total time taken by event execution: 8546.2173
    per-request statistics:
         min:                                  0.01ms
         avg:                                  1.63ms
         max:                                220.71ms
         approx.  95 percentile:               2.69ms

Threads fairness:
    events (avg/stddev):           327680.0000/262.27
    execution time (avg/stddev):   534.1386/0.00

Server-to-NFS-to-SAN

Apr 24, 2010; on lsst10 using /lsst/mfreemon

sysbench --test=fileio --file-total-size=80G prepare
sysbench --num-threads=16 --test=fileio --file-total-size=80G \
         --file-test-mode=seqrd --max-time=600 --max-requests=100000000 \
         --file-block-size=16384 --file-fsync-freq=0 \
         run
sysbench 0.4.12:  multi-threaded system evaluation benchmark

Running the test with following options:
Number of threads: 16

Extra file open flags: 0
128 files, 640Mb each
80Gb total file size
Block size 16Kb
Calling fsync() at the end of test, Enabled.
Using synchronous I/O mode
Doing sequential read test
Threads started!
Time limit exceeded, exiting...
(last message repeated 15 times)
Done.

Operations performed:  2482889 Read, 0 Write, 0 Other = 2482889 Total
Read 37.886Gb  Written 0b  Total transferred 37.886Gb  (64.658Mb/sec)
 4138.11 Requests/sec executed

Test execution summary:
    total time:                          600.0055s
    total number of events:              2482889
    total time taken by event execution: 9595.4235
    per-request statistics:
         min:                                  0.46ms
         avg:                                  3.86ms
         max:                                295.20ms
         approx.  95 percentile:               9.97ms

Threads fairness:
    events (avg/stddev):           155180.5625/198.42
    execution time (avg/stddev):   599.7140/0.01

Sequential Write

Server-to-SAN

Apr 24, 2010; on lsst10 using /usr/data/mysql1/mfreemon

sysbench --num-threads=16 --test=fileio --file-total-size=80G \
         --file-test-mode=seqwr --max-time=600 --max-requests=100000000 \
         --file-block-size=16384 --file-fsync-freq=100 \
         run
sysbench 0.4.12:  multi-threaded system evaluation benchmark

Running the test with following options:
Number of threads: 16

Extra file open flags: 0
128 files, 640Mb each
80Gb total file size
Block size 16Kb
Periodic FSYNC enabled, calling fsync() each 100 requests.
Calling fsync() at the end of test, Enabled.
Using synchronous I/O mode
Doing sequential write (creation) test
Threads started!
Time limit exceeded, exiting...
(last message repeated 15 times)
Done.

Operations performed:  0 Read, 4702092 Write, 0 Other = 4702092 Total
Read 0b  Written 71.748Gb  Total transferred 71.748Gb  (122.45Mb/sec)
 7836.81 Requests/sec executed

Test execution summary:
    total time:                          600.0010s
    total number of events:              4702092
    total time taken by event execution: 8604.2200
    per-request statistics:
         min:                                  0.04ms
         avg:                                  1.83ms
         max:                               5398.96ms
         approx.  95 percentile:               1.16ms

Threads fairness:
    events (avg/stddev):           293880.7500/1381.39
    execution time (avg/stddev):   537.7637/0.01

Server-to-NFS-to-SAN

Apr 24, 2010; on lsst10 using /lsst/mfreemon

sysbench --num-threads=16 --test=fileio --file-total-size=80G \
         --file-test-mode=seqwr --max-time=600 --max-requests=100000000 \
         --file-block-size=16384 --file-fsync-freq=100 \
         run
sysbench 0.4.12:  multi-threaded system evaluation benchmark

Running the test with following options:
Number of threads: 16

Extra file open flags: 0
128 files, 640Mb each
80Gb total file size
Block size 16Kb
Periodic FSYNC enabled, calling fsync() each 100 requests.
Calling fsync() at the end of test, Enabled.
Using synchronous I/O mode
Doing sequential write (creation) test
Threads started!
Time limit exceeded, exiting...
(last message repeated 15 times)
Done.

Operations performed:  0 Read, 1845507 Write, 0 Other = 1845507 Total
Read 0b  Written 28.16Gb  Total transferred 28.16Gb  (48.029Mb/sec)
 3073.84 Requests/sec executed

Test execution summary:
    total time:                          600.3904s
    total number of events:              1845507
    total time taken by event execution: 7151.3658
    per-request statistics:
         min:                                  0.01ms
         avg:                                  3.88ms
         max:                               4480.60ms
         approx.  95 percentile:               0.45ms

Threads fairness:
    events (avg/stddev):           115344.1875/2400.44
    execution time (avg/stddev):   446.9604/0.11