postgresql-pgbench(转)

pgbench测试：

 

pg9.6.2的pgbench报错：

[thunisoft@localhost ~]$ pgbench -S -c 8 -t 60 pgbenchdb

Segmentation fault (core dumped)：

https://www.postgresql-archive.org/BUG-14580-pgbench-bug-td5947948.html

 

1简介

 

PG数据库提供了一款轻量级的压力测试工具叫pgbench, 测试模型是TPC-B.

 

2安装

 

略

 

3.参数介绍

 

[postgres@localhost bin]$ pgbench --help

 

pgbench is a benchmarking tool for PostgreSQL.

 

Usage: pgbench [OPTION]... [DBNAME]

 

Initialization options:

 

-i, --initialize invokes initialization mode(调用初始化模式)

 

-F, --fillfactor=NUM set fill factor(填充因子-对表的填充因子，类似oracle的pctfree作用)

 

-n, --no-vacuum do not run VACUUM after initialization(初始化完成后不VACUUM)

 

-q, --quiet quiet logging (one message each 5 seconds)

 

-s, --scale=NUM scaling factor（比例因子-控制表的数据大小）

 

--foreign-keys create foreign key constraints between tables(表之间创建外键约束)

 

--index-tablespace=TABLESPACE create indexes in the specified tablespace(索引创建在指定表空间)

 

--tablespace=TABLESPACE create tables in the specified tablespace(表创建在指定表空间)

 

--unlogged-tables create tables as unlogged tables(创建表为unlogged表)

 

Benchmarking options:

 

-c, --client=NUM number of concurrent database clients (default: 1) 客户端个数(默认: 1)

 

-C, --connect establish new connection for each transaction为每一个事务建立一个新的连接

 

-D, --define=VARNAME=VALUE define variable for use by custom script通过客户脚本为用户定义变量

 

-f, --file=FILENAME read transaction script from FILENAME指定测试脚本的位置，不指定为自带的默认脚本

 

-j, --jobs=NUM number of threads (default: 1) 启动线程数(default: 1)

 

-l, --log write transaction times to log file向日志文件中输入每个事务时间

 

-L, --latency-limit=NUM count transactions lasting more than NUM ms as late

 

-M, --protocol=simple|extended|prepared

 

protocol for submitting queries (default: simple) 向服务器提交查询的协议 (default: simple)

 

-n, --no-vacuum do not run VACUUM before tests测试前不执行VACUUM

 

-N, --skip-some-updates skip updates of pgbench_tellers and pgbench_branches不执行update操作

 

-P, --progress=NUM show thread progress report every NUM seconds

 

-r, --report-latencies report average latency per command报告中显示每个命令的平均延迟

 

-R, --rate=NUM target rate in transactions per second

 

-s, --scale=NUM report this scale factor in output报告中显示每个命令的平均延迟

 

-S, --select-only perform SELECT-only transactions只执行查询的事务

 

-t, -transactions=NUM number of transactions each client runs (default: 10) 每个客户端执行的事务次数(default: 10)

 

-T, --time=NUM duration of benchmark test in seconds测试时间，单位为秒

 

-v, --vacuum-all vacuum all four standard tables before tests测试前对库中默认的4个基准表进行vacuum操作

 

--aggregate-interval=NUM aggregate data over NUM seconds

 

--sampling-rate=NUM fraction of transactions to log (e.g. 0.01 for 1%)

 

Common options:

 

-d, --debug print debugging output

 

-h, --host=HOSTNAME database server host or socket directory

 

-p, --port=PORT database server port number

 

-U, --username=USERNAME connect as specified database user

 

-V, --version output version information, then exit

 

-?, --help show this help, then exit

 

4测试方式

 

1采用默认基准表默认脚本测试

 

(1)创建名为pgbench数据库:create database pgbench;

 

(2)初始化测试数据[postgres@pg2 ~]$pgbench -i -F 100 -s 500 -h localhost -U dba -d pgbench

 

(3)检查初始化之后的pgbench数据库

 

pgbench=# select count(1) from pgbench_accounts;

 

pgbench=# select count(1) from pgbench_branches;

 

pgbench=# select count(1) from pgbench_history;

 

pgbench=# select count(1) from pgbench_tellers;

 

pgbench=# \d+ pgbench_accounts

 

pgbench=# \d+ pgbench_branches

 

pgbench=# \d+ pgbench_history

 

pgbench=# \d+ pgbench_tellers

 

查数据库大小：pgbench=# select pg_database_size('pgbench')/1024/1024||'M';

 

(4)利用基准表，默认脚本测试

 

自带脚本

 

BEGIN;

 

UPDATE pgbench_accounts SET abalance = abalance + :delta WHERE aid = :aid;

 

SELECT abalance FROM pgbench_accounts WHERE aid = :aid;

 

UPDATE pgbench_tellers SET tbalance = tbalance + :delta WHERE tid = :tid;

 

UPDATE pgbench_branches SET bbalance = bbalance + :delta WHERE bid = :bid;

 

INSERT INTO pgbench_history (tid, bid, aid, delta, mtime) VALUES

 

(:tid, :bid, :aid, :delta, CURRENT_TIMESTAMP);

 

END;

 

测试语句

 

1只读

 

nohup pgbench -c 50 -j 10 -M prepared -n -s 500 -S -T 120 -r -h localhost -p 5432 -U dba -d pgbench> /pgdb/pgbenchtest/readonly.out 2>&1

 

2更新，查询，插入

 

nohup pgbench -c 50 -j 10 -M prepared -n -s 500 -T 120 -r -h localhost -p 5432 -U dba -d pgbench> /pgdb/pgbenchtest/all.out 2>&1

 

3不执行更新

 

nohup pgbench -c 50 -j 10 -M prepared -n -N -s 500 -T 120 -r -h localhost -p 5432 -U dba -d pgbench> /pgdb/pgbenchtest/noupdate.out 2>&1

 

说明：我们主要关心的是最后的输出报告中的两个TPS值,一个是包含网络开销(including),另一个是不包含网络开销的 (excluding),这个值是反映的是每秒处理的事务数，反过来也可以查出每个事务数所消耗的平均时间，一般认为能将硬件用到极致，速度越快越好。

 

2利用默认基准表，自定义脚本测试

 

分别测试3种脚本：(只读，读写，读写函数)

 

2.1只读测试

 

--脚本内容

 

vi /pgdb/pgbenchtest/read.sql

 

\set naccounts 100000 * :scale

 

\setrandom aid 1 :naccounts

 

SELECT abalance FROM pgbench_accounts WHERE aid = :aid;

 

--测试时间段内的操作系统负载

 

Linux命令top

 

--测试语句

 

[postgres@pg2 ~]$pgbench -c 50 -j 10 -M prepared -n -s 500 -T 120 -f /pgdb/pgbenchtest/read.sql -h localhost -p 5432 -U dba -d pgbench>/pgdb/pgbenchtest/readonly.out 2>&1

 

2.2读写测试

 

--脚本内容

 

vi /pgdb/pgbenchtest/readwrite.sql

 

\set nbranches :scale

 

\set ntellers 10 * :scale

 

\set naccounts 100000 * :scale

 

\setrandom aid 1 :naccounts

 

\setrandom bid 1 :nbranches

 

\setrandom tid 1 :ntellers

 

\setrandom delta -5000 5000

 

BEGIN;

 

UPDATE pgbench_accounts SET abalance = abalance + :delta WHERE aid = :aid;

 

SELECT abalance FROM pgbench_accounts WHERE aid = :aid;

 

UPDATE pgbench_tellers SET tbalance = tbalance + :delta WHERE tid = :tid;

 

UPDATE pgbench_branches SET bbalance = bbalance + :delta WHERE bid = :bid;

 

INSERT INTO pgbench_history (tid, bid, aid, delta, mtime) VALUES (:tid, :bid, :aid, :delta, CLOCK_TIMESTAMP());

 

END;

 

--测试时间段内的操作系统负载

 

Linux命令top

 

--测试语句

 

[postgres@pg2 ~]$pgbench -c 50 -j 10 -M prepared -n -s 500 -T 120 -f /pgdb/pgbenchtest/readwrite.sql -h localhost -p 5432 -U dba -d pgbench>/pgdb/pgbenchtest/readwrite.out 2>&1

 

2.3读写函数的测试

 

--主要是为了对比调用函数和直接使用SQL的性能差别

 

--创建如下函数

 

pgbench=# create or replace function pgbench(i_aid int,i_bid int,i_tid int,i_delta int) returns setof int as $BODY$

 

declare

 

begin

 

UPDATE pgbench_accounts SET abalance = abalance + i_delta WHERE aid = i_aid;

 

UPDATE pgbench_tellers SET tbalance = tbalance + i_delta WHERE tid = i_tid;

 

UPDATE pgbench_branches SET bbalance = bbalance + i_delta WHERE bid = i_bid;

 

INSERT INTO pgbench_history (tid, bid, aid, delta, mtime) VALUES (i_tid, i_bid, i_aid, i_delta, CURRENT_TIMESTAMP);

 

return query SELECT abalance FROM pgbench_accounts WHERE aid = i_aid;

 

end;

 

$BODY$ language plpgsql;

 

--脚本内容

 

vi /pgdb/pgbenchtest/readwritefunction.sql

 

\set nbranches :scale

 

\set ntellers 10 * :scale

 

\set naccounts 100000 * :scale

 

\setrandom aid 1 :naccounts

 

\setrandom bid 1 :nbranches

 

\setrandom tid 1 :ntellers

 

\setrandom delta -5000 5000

 

select pgbench(:aid,:bid,:tid,:delta);

 

--测试时间段内的操作系统负载

 

Linux命令top

 

--测试语句

 

[postgres@pg2 ~]$ pgbench -c 50 -j 10 -M prepared -n -s 500 -T 120 -f /pgdb/pgbenchtest/readwritefunction.sql -h localhost -p 5432 -U dba -d pgbench>/pgdb/pgbenchtest/readwritefunction.out 2>&1

 

3自定义测试表，数据与脚本

 

3.1测试查询

 

--表准备

 

pgbench=#create table testtb1(id int,name text);

 

pgbench=#insert into testtb1(id,name) select n,n||'_test' from generate_series(1,5000000) n;

 

pgbench=#alter table testtb1 add primary key(id);

 

--测试脚本 SQL

 

[postgres@pg2 ~]$ cat /pgdb/pgbenchtest/testtb1.sql

 

\setrandom v_id 1 5000000

 

select name from testtb1 where id=:v_id;

 

--测试语句

 

pgbench -c 2 -T 20 -n -M prepared -d pgbench -U dba -f /pgdb/pgbenchtest/ testtb1.sql >/pgdb/pgbenchtest/testtb1.out 2>&1

 

2测试插入

 

--表准备

 

pgbench=#create table testintodata(data text);

 

--测试脚本 SQL内容：

 

[postgres@pg2 ~]$ cat /pgdb/pgbenchtest/testintodata.sql

 

insert into testintodata (data) values (repeat('xyz',:scale));

 

--测试语句

 

pgbench -s 100 -c 50 -j 10 -M prepared -T 120 -f /pgdb/pgbenchtest/testintodata.sql -h localhost -p 5432 -U dba -d pgbench>/pgdb/pgbenchtest/testintodata.out 2>&1

 

完成。

---------------------

作者：treacle田

来源：CSDN

原文：https://blog.csdn.net/sunziyue/article/details/50997867

版权声明：本文为博主原创文章，转载请附上博文链接！