v3.0-performance-benchmarking-with-tpcc.md

title	aliases
TiDB TPC-C Performance Test Report -- v3.0 vs. v2.1	/docs/dev/benchmark/v3.0-performance-benchmarking-with-tpcc/ /docs/dev/benchmark/tpcc/

TiDB TPC-C Performance Test Report -- v3.0 vs. v2.1

Test purpose

This test aims to compare the TPC-C performance of TiDB 3.0 and TiDB 2.1.

Test version, time, and place

TiDB version: v3.0.0 vs. v2.1.13

Time: June, 2019

Place: Beijing

Test environment

IDC machine:

Type	Name
OS	Linux (CentOS 7.3.1611)
CPU	40 vCPUs, Intel(R) Xeon(R) CPU E5-2630 v4 @ 2.20GHz
RAM	128GB
DISK	1.5TB SSD * 2

This test uses the open-source BenchmarkSQL 5.0 as the TPC-C testing tool and adds the support for the MySQL protocol. You can download the testing program by using the following command:

{{< copyable "shell-regular" >}}

git clone -b 5.0-mysql-support-opt https://github.com/pingcap/benchmarksql.git

Test plan

Use BenchmarkSQL to load the data of 1000 warehouses into the TiDB cluster. By using HAProxy, send concurrent requests to the cluster at an incremental number. A single concurrent test lasts 10 minutes.

TiDB version information

v3.0.0

Component	GitHash
TiDB	46c38e15eba43346fb3001280c5034385171ee20
TiKV	a467f410d235fa9c5b3c355e3b620f81d3ac0e0c
PD	70aaa5eee830e21068f1ba2d4c9bae59153e5ca3

v2.1.13

Component	GitHash
TiDB	6b5b1a6802f9b8f5a22d8aab24ac80729331e1bc
TiKV	b3cf3c8d642534ea6fa93d475a46da285cc6acbf
PD	886362ebfb26ef0834935afc57bcee8a39c88e54

TiDB parameter configuration

[log]
level = "error"
[performance]
max-procs = 20
[prepared_plan_cache]
enabled = true

TiKV parameter configuration

The default TiKV configuration is used in both v2.1 and v3.0.

Cluster topology

Machine IP	Deployment instance
172.16.4.75	2*TiDB 2*TiKV 1*pd
172.16.4.76	2*TiDB 2*TiKV 1*pd
172.16.4.77	2*TiDB 2*TiKV 1*pd

Test result

Version	Threads	tpmC
v3.0	128	44068.55
v3.0	256	47094.06
v3.0	512	48808.65
v2.1	128	10641.71
v2.1	256	10861.62
v2.1	512	10965.39

According to the testing statistics, the performance of TiDB 3.0 has increased by 450% than that of TiDB 2.1.