利用sysbench进行MySQL OLTP基准测试

 

Preface

 

    In order to know clearly about the real performance threshold of database server,we usually do database benchmarks.What's it?It's similar with preasure test of database in the whole system.The difference is that the database benchmark may not care about the real business performance but the direct performance with virtual data.It's simple and convenient to implement whereas what is more complex in presure test.The items what we really care about in database benchmark is TPS/QPS/RT(Response Time)/Concurrency,etc.I'm gonna use sysbench(one of the benchmark test tools) to do some basic oltp read write test of MySQL database today.

 

Introduce

 

    sysbench is a common tool used in database bentchmark to test MySQL database(of cource,it supports PostgreSQL and Oracle,too).It provide many test case through several built-in lua scripts by specifying option of "testname".We can use the tool to get performance statistics about CPU,IO,Memory,etc.

 

Procedure

 

Official web site:

https://github.com/akopytov/sysbench

 

Git clone address:

https://github.com/akopytov/sysbench.git

 

Download it from github.

 [root@zlm1 :: ~]
 #cd /vagrant

 [root@zlm1 :: ~]
 #wget https://github.com/akopytov/sysbench/archive/1.0.zip -O "sysbench-1.0.zip"

Install sysbench.

 [root@zlm1 :: /vagrant]
 #cp -R sysbench-1.0 ~

 [root@zlm1 :: ~]
 #cd sysbench-1.0/

 [root@zlm1 :: ~/sysbench-1.0]
 #./autogen.sh
 ./autogen.sh: running `libtoolize --copy --force'
 libtoolize: putting auxiliary files in AC_CONFIG_AUX_DIR, `config'.
 libtoolize: copying file `config/ltmain.sh'
 libtoolize: putting macros in AC_CONFIG_MACRO_DIR, `m4'.
 libtoolize: copying file `m4/libtool.m4'
 libtoolize: copying file `m4/ltoptions.m4'
 libtoolize: copying file `m4/ltsugar.m4'
 libtoolize: copying file `m4/ltversion.m4'
 libtoolize: copying file `m4/lt~obsolete.m4'
 ./autogen.sh: running `aclocal -I m4'
 ./autogen.sh: running `autoheader'
 ./autogen.sh: running `automake -c --foreign --add-missing'
 configure.ac:: installing 'config/ar-lib'
 configure.ac:: installing 'config/compile'
 configure.ac:: installing 'config/config.guess'
 configure.ac:: installing 'config/config.sub'
 configure.ac:: installing 'config/install-sh'
 configure.ac:: installing 'config/missing'
 src/Makefile.am: installing 'config/depcomp'
 parallel-tests: installing 'config/test-driver'
 ./autogen.sh: running `autoconf'
 Libtoolized with: libtoolize (GNU libtool) 2.4.
 Automade with: automake (GNU automake) 1.13.
 Configured with: autoconf (GNU Autoconf) 2.69

 [root@zlm1 :: ~/sysbench-1.0]
 #./configure && make && make install
 //Omitted.
 [root@zlm1 :: ~/sysbench-1.0]
 #sysbench --version
 sysbench: error while loading shared libraries: libmysqlclient.so.: cannot open shared object file: No such file or directory

 [root@zlm1 :: ~/sysbench-1.0]
 #whereis sysbench
 sysbench: /usr/local/bin/sysbench

 [root@zlm1 :: ~/sysbench-1.0]
 #ldd /usr/local/bin/sysbench
     linux-vdso.so. =>  (0x00007fff2abfe000)
     libmysqlclient.so. => not found //Only lack this lib.
     libpthread.so. => /lib64/libpthread.so. (0x00007f86e2986000)
     librt.so. => /lib64/librt.so. (0x00007f86e277e000)
     libdl.so. => /lib64/libdl.so. (0x00007f86e257a000)
     libaio.so. => /lib64/libaio.so. (0x00007f86e2377000)
     libm.so. => /lib64/libm.so. (0x00007f86e2075000)
     libgcc_s.so. => /lib64/libgcc_s.so. (0x00007f86e1e5f000)
     libc.so. => /lib64/libc.so. (0x00007f86e1a9d000)
     /lib64/ld-linux-x86-.so. (0x00007f86e2bab000)

 [root@zlm1 :: ~/sysbench-1.0]
 #find / -name libmysqlclient //There's no result found.

 [root@zlm1 :: ~/sysbench-1.0]
 #

Solve the lack of mysqlclient.so.20 file.

 [root@zlm1 :: ~/sysbench-1.0]
 #vim /etc/ld.so.conf.d/mysql.conf

 [root@zlm1 :: ~/sysbench-1.0]
 #cat /etc/ld.so.conf.d/mysql.conf
 /usr/local/mysql/lib

 [root@zlm1 :: ~/sysbench-1.0]
 #ldconfig

 [root@zlm1 :: ~/sysbench-1.0]
 #ldd /usr/local/bin/sysbench
     linux-vdso.so. =>  (0x00007fff767fe000)
     libmysqlclient.so. => /usr/local/mysql/lib/libmysqlclient.so. (0x00007fb2ca8a8000)
     libpthread.so. => /lib64/libpthread.so. (0x00007fb2ca68b000)
     librt.so. => /lib64/librt.so. (0x00007fb2ca483000)
     libdl.so. => /lib64/libdl.so. (0x00007fb2ca27f000)
     libaio.so. => /lib64/libaio.so. (0x00007fb2ca07d000)
     libm.so. => /lib64/libm.so. (0x00007fb2c9d7a000)
     libgcc_s.so. => /lib64/libgcc_s.so. (0x00007fb2c9b64000)
     libc.so. => /lib64/libc.so. (0x00007fb2c97a3000)
     libstdc++.so. => /lib64/libstdc++.so. (0x00007fb2c949b000)
     /lib64/ld-linux-x86-.so. (0x00007fb2caec7000)

 [root@zlm1 :: ~/sysbench-1.0]
 #sysbench --version
 sysbench 1.0.

Lua scripts of sysbench.

 [root@zlm1 :: ~/sysbench-1.0/src/lua]
 #ls -l
 total
 -rwxr-xr-x  root root   Jul   : bulk_insert.lua
 drwxr-xr-x  root root   Jul   : internal
 -rw-r--r--  root root  Jul   : Makefile
 -rwxr-xr-x  root root   Jul   : Makefile.am
 -rw-r--r--  root root  Jul   : Makefile.in
 -rwxr-xr-x  root root  Jul   : oltp_common.lua
 -rwxr-xr-x  root root   Jul   : oltp_delete.lua
 -rwxr-xr-x  root root   Jul   : oltp_insert.lua
 -rwxr-xr-x  root root   Jul   : oltp_point_select.lua
 -rwxr-xr-x  root root   Jul   : oltp_read_only.lua
 -rwxr-xr-x  root root   Jul   : oltp_read_write.lua
 -rwxr-xr-x  root root   Jul   : oltp_update_index.lua
 -rwxr-xr-x  root root   Jul   : oltp_update_non_index.lua
 -rwxr-xr-x  root root   Jul   : oltp_write_only.lua
 -rwxr-xr-x  root root   Jul   : select_random_points.lua
 -rwxr-xr-x  root root   Jul   : select_random_ranges.lua

Usage

 sysbench [options]... [testname] [command]
 Commands implemented by most tests: prepare run cleanup help

Parameters

 //Common Options.
 --threads //Specify the threads to use(default 1).
 --time //Specify the execution time in seconds(default 10s).
 --events //Specify the number of events(default 0).
 --rate //Speicify the transactions rate(default 0).
 --db-driver //Specify the database driver(default mysql).
 --rand-type //Specify the random numbers distribution(defautl "special",others "uniform","gaussian","pareto").
 --warmup-time //Specify the time to warmup before real execution to avoid inaccurate result(default 0).
 --report-interval //Specify the time about the report interval(default 0,means disable intermediate report).
 --table //Specify the number of tables in test database.
 --table-size //Specify the number of records in each test table.

 //MySQL Driver Options.
 --mysql-host //Specify the host(default localhost).
 --mysql-port //Specify the port(default 3306).
 --mysql-socket //Specify the socket.
 --mysql-user //Default sbtest.
 --mysql-password //Specify the password of user.
 --mysql-db //Specify the test db(default sbtest).
 --mysql-dry-run //It does not really run but treat MySQL client API calls are successful.

 //Command Options(depends on "testname").
 prepare //creates necessary files or data that the peticular test need.
 run //actually runs the specific test which is specified by "testname" option.
 cleanup //Removes all the test files or data which are relevant with.
 help //Shows the information of particular test.

Example

 

Prepare

 [root@zlm1 :: ~/sysbench-1.0/src/lua]
 #sysbench oltp_read_write.lua --mysql-host=192.168.56.100 --mysql-port= --mysql-user=zlm --mysql-password=aaron8219 --mysql-db=sysbench --tables= --table-size= --mysql-storage-engine=innodb prepare
 sysbench 1.0. (using bundled LuaJIT 2.1.-beta2)

 Creating table 'sbtest1'...
 Inserting  records into 'sbtest1'
 Creating a secondary index on 'sbtest1'...
 Creating table 'sbtest2'...
 Inserting  records into 'sbtest2'
 Creating a secondary index on 'sbtest2'...
 Creating table 'sbtest3'...
 Inserting  records into 'sbtest3'
 Creating a secondary index on 'sbtest3'...
 Creating table 'sbtest4'...
 Inserting  records into 'sbtest4'
 Creating a secondary index on 'sbtest4'...
 Creating table 'sbtest5'...
 Inserting  records into 'sbtest5'
 Creating a secondary index on 'sbtest5'...
 Creating table 'sbtest6'...
 Inserting  records into 'sbtest6'
 Creating a secondary index on 'sbtest6'...
 Creating table 'sbtest7'...
 Inserting  records into 'sbtest7'
 Creating a secondary index on 'sbtest7'...
 Creating table 'sbtest8'...
 Inserting  records into 'sbtest8'
 Creating a secondary index on 'sbtest8'...
 Creating table 'sbtest9'...
 Inserting  records into 'sbtest9'
 Creating a secondary index on 'sbtest9'...
 Creating table 'sbtest10'...
 Inserting  records into 'sbtest10'
 Creating a secondary index on 'sbtest10'...

 //Create 10 tables with 10w rows each.
 [root@zlm1 :: ~/sysbench-1.0/src/lua]
 #

 Run

 [root@zlm1 :: ~/sysbench-1.0/src/lua]
 #sysbench oltp_read_write.lua --mysql-host=192.168.56.100 --mysql-port= --mysql-user=zlm --mysql-password=aaron8219 --mysql-db=sysbench --threads= --time= --warmup-time= --report-interval= --rand-type=uniform run
 sysbench 1.0. (using bundled LuaJIT 2.1.-beta2)

 invalid option: --warmup-time= //It's not supported in my version.

 [root@zlm1 :: ~/sysbench-1.0/src/lua]
 #sysbench oltp_read_write.lua --mysql-host=192.168.56.100 --mysql-port= --mysql-user=zlm --mysql-password=aaron8219 --mysql-db=sysbench --threads= --time= --report-interval= --rand-type=uniform run
 sysbench 1.0. (using bundled LuaJIT 2.1.-beta2)

 Running the test with following options:
 Number of threads:  //There're three threads.
 Report intermediate results every  second(s) //Show report every 10s.
 Initializing random number generator from current time

 Initializing worker threads...

 Threads started!

 [ 10s ] thds:  tps: 134.07 qps: 2684.74 (r/w/o: 1879.80/536.59/268.34) lat (ms,%): 48.34 err/s: 0.00 reconn/s: 0.00 //Notice the low value here.
 [ 20s ] thds:  tps: 273.74 qps: 5473.50 (r/w/o: 3831.29/1094.64/547.57) lat (ms,%): 15.00 err/s: 0.00 reconn/s: 0.00
 [ 30s ] thds:  tps: 273.30 qps: 5467.40 (r/w/o: 3827.60/1093.20/546.60) lat (ms,%): 14.73 err/s: 0.00 reconn/s: 0.00
 [ 40s ] thds:  tps: 250.50 qps: 5009.82 (r/w/o: 3506.61/1002.20/501.00) lat (ms,%): 17.95 err/s: 0.00 reconn/s: 0.00
 [ 50s ] thds:  tps: 261.07 qps: 5222.57 (r/w/o: 3656.33/1044.09/522.15) lat (ms,%): 16.41 err/s: 0.00 reconn/s: 0.00
 [ 60s ] thds:  tps: 264.52 qps: 5289.24 (r/w/o: 3702.14/1058.07/529.03) lat (ms,%): 15.55 err/s: 0.00 reconn/s: 0.00
 SQL statistics:
     queries performed:
         read:                             //Executions of writing.
         write:                            //Executions of reading.
         other:                            //Operations excetp CURD.
         total:
     transactions:                          (242.76 per sec.) //TPS is 242.
     queries:                              (4855.30 per sec.) //QPS is 4855.
     ignored errors:                            (0.00 per sec.)
     reconnects:                                (0.00 per sec.)

 General statistics:
     total time:                          .0155s
     total number of events:               //Total transactions.

 Latency (ms):
          min:                                    3.17
          avg:                                   12.35
          max:                                  887.76
          95th percentile:                       16.41 //Response time of former 95%
          sum:                               179957.65

 Threads fairness:  //Statistics of concurrency.
     events (avg/stddev):           4856.6667/21.23
     execution time (avg/stddev):   59.9859/0.00

 [root@zlm1 :: ~/sysbench-1.0/src/lua]
 #

 summary

• sysbench is more powerful than mysqlslap(built-in program of MySQL).
• Be ware of  the diffrence between database benchmark test and presure test.
• There're also some other tools can be used to test database performance such as mysql-tpcc,YCSB,etc.
• Database benchmark really helps us to have a explicit overview about our newly arrived server.More test is necessary.