MySQL Cluster 4个数据节点压力测试--mysqlslap工具压400W写
锅巴哥的个人建议:cluster叫电信运营商版本,所以基本上在很大的用户并发量的情况下才会用到,对连接数的线性增长要求高的场景,千兆就不用想了, 没万兆就不用玩了。
很不幸,我的就是千兆网络,我的数据节点是16 core,32G内存,sql节点是16core,16G内存,做了raid10
PS: 水平所限,环境所限,测试结果仅供参考,欢迎大家一起交流提出宝贵的意见,让我更进一步。
【】一:测试
20.30.50.107 3307
mysql -utim -mcgxxxxx -P3307 -h20.30.50.107 --default-character-set=utf8
1 查询测试 100W
1.1 ndbcluster 100W测试,并发分别为--concurrency=800,1200,1500
(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307 -utim -mcgxxxxx --auto-generate-sql-guid-primary --concurrency=800,1200,1500 --number-of-queries=1000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=rdb10 --auto-generate-sql-load-type=read ) 1> r101.log 2> r102.log
-- 20.30.50.31
(time mysqlslap --engine=ndbcluster --auto-generate-sql-guid-primary --concurrency=800,1200,1500 --number-of-queries=1000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=rdb10 --auto-generate-sql-load-type=read ) 1> /root/r101.log 2> /root/r102.log
1.2 innodb 100W测试,并发分别为--concurrency=800,1200,1500
-- 20.30.50.37
(time mysqlslap --engine=innodb -h20.30.50.37 -P3307 -utim -mcgxxxxx --auto-generate-sql-guid-primary --concurrency=800,1200,1500 --number-of-queries=1000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=idb10 --auto-generate-sql-load-type=read ) 1> /root/rin101.log 2> /root/rin102.log
mixed 混合读写压力测试
2 ndbcluster 10W
【===================10W 写 =================】
2.1 ndbcluster 在集群里面测试,并发分别为--concurrency=500,1000,1500
(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307 -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary --concurrency=500 --number-of-queries=100000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb10 –-commint=100 --auto-generate-sql-load-type=write)
(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307 -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary --concurrency=1000 --number-of-queries=100000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb10 –-commint=100 --auto-generate-sql-load-type=write)
(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307 -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary --concurrency=1500 --number-of-queries=100000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb10 –-commint=100 --auto-generate-sql-load-type=write)
Benchmark
Running for engine ndbcluster
Average number of seconds to run all queries: 3.735 seconds
Minimum number of seconds to run all queries: 3.629 seconds
Maximum number of seconds to run all queries: 3.841 seconds
Number of clients running queries: 500
Average number of queries per client: 200
Benchmark
Running for engine ndbcluster
Average number of seconds to run all queries: 3.577 seconds
Minimum number of seconds to run all queries: 3.535 seconds
Maximum number of seconds to run all queries: 3.619 seconds
Number of clients running queries: 1000
Average number of queries per client: 100
Benchmark
Running for engine ndbcluster
Average number of seconds to run all queries: 7.998 seconds
Minimum number of seconds to run all queries: 7.513 seconds
Maximum number of seconds to run all queries: 8.483 seconds
Number of clients running queries: 1500
Average number of queries per client: 66
2.2 innodb 在20.30.50.52里面测试,并发分别为--concurrency=500,1000,1500
(time mysqlslap --engine=innodb -h127.0.0.1 -P3307 -uadmin -pMBpassw0rd --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary --concurrency=500,1000,1500 --number-of-queries=100000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=indbw2 –-commint=100 --auto-generate-sql-load-type=write) 1> idb11w.log 2> indb12w.log
Benchmark
Running for engine innodb
Average number of seconds to run all queries: 14.494 seconds
Minimum number of seconds to run all queries: 13.995 seconds
Maximum number of seconds to run all queries: 14.994 seconds
Number of clients running queries: 500
Average number of queries per client: 200
Benchmark
Running for engine innodb
Average number of seconds to run all queries: 15.575 seconds
Minimum number of seconds to run all queries: 15.427 seconds
Maximum number of seconds to run all queries: 15.724 seconds
Number of clients running queries: 1000
Average number of queries per client: 100
Benchmark
Running for engine innodb
Average number of seconds to run all queries: 14.275 seconds
Minimum number of seconds to run all queries: 13.989 seconds
Maximum number of seconds to run all queries: 14.561 seconds
Number of clients running queries: 1500
Average number of queries per client: 66
3【===================50W 写 =================】
3.1 ndbcluster,并发分别为--concurrency=500,1000,1500
(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307 -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary --concurrency=500 --number-of-queries=500000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb50 –-commint=100 --auto-generate-sql-load-type=write) 1> 51-500.log 2> 52-500.log
(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307 -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary --concurrency=1000 --number-of-queries=500000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb50 –-commint=100 --auto-generate-sql-load-type=write) 1> 51-1000.log 2> 52-1000.log
(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307 -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary --concurrency=1500 --number-of-queries=500000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb50 –-commint=100 --auto-generate-sql-load-type=write) 1> 51-1500.log 2> 52-1500.log
Benchmark
Running for engine ndbcluster
Average number of seconds to run all queries: 15.950 seconds
Minimum number of seconds to run all queries: 15.797 seconds
Maximum number of seconds to run all queries: 16.104 seconds
Number of clients running queries: 500
Average number of queries per client: 1000
Benchmark
Running for engine ndbcluster
Average number of seconds to run all queries: 16.325 seconds
Minimum number of seconds to run all queries: 16.080 seconds
Maximum number of seconds to run all queries: 16.570 seconds
Number of clients running queries: 1000
Average number of queries per client: 500
Benchmark
Running for engine ndbcluster
Average number of seconds to run all queries: 25.563 seconds
Minimum number of seconds to run all queries: 24.996 seconds
Maximum number of seconds to run all queries: 26.130 seconds
Number of clients running queries: 1500
Average number of queries per client: 333
3.2 innodb,并发分别为--concurrency=500,1000,1500
(time mysqlslap --engine=innodb -h127.0.0.1 -P3307 -uadmin -pMBpassw0rd --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary --concurrency=500 --number-of-queries=500000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=indb52 –-commint=100 --auto-generate-sql-load-type=write) 1> idb51-500.log 2> idb52-500.log
(time mysqlslap --engine=innodb -h127.0.0.1 -P3307 -uadmin -pMBpassw0rd --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary --concurrency=1000 --number-of-queries=500000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=indb52 –-commint=100 --auto-generate-sql-load-type=write) 1> idb51-1000.log 2> idb52-1000.log
(time mysqlslap --engine=innodb -h127.0.0.1 -P3307 -uadmin -pMBpassw0rd --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary --concurrency=1500 --number-of-queries=500000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=indb52 –-commint=100 --auto-generate-sql-load-type=write) 1> idb51-1500.log 2> idb52-1500.log
Benchmark
Running for engine innodb
Average number of seconds to run all queries: 72.366 seconds
Minimum number of seconds to run all queries: 72.271 seconds
Maximum number of seconds to run all queries: 72.461 seconds
Number of clients running queries: 500
Average number of queries per client: 1000
Benchmark
Running for engine innodb
Average number of seconds to run all queries: 75.593 seconds
Minimum number of seconds to run all queries: 75.500 seconds
Maximum number of seconds to run all queries: 75.687 seconds
Number of clients running queries: 1000
Average number of queries per client: 500
Benchmark
Running for engine innodb
Average number of seconds to run all queries: 70.388 seconds
Minimum number of seconds to run all queries: 69.999 seconds
Maximum number of seconds to run all queries: 70.777 seconds
Number of clients running queries: 1500
Average number of queries per client: 333
4【===================100W 写 =================】
4.1 ndbcluster,并发分别为--concurrency=500,1000,1500
(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307 -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary --concurrency=500 --number-of-queries=1000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb100 –-commint=100 --auto-generate-sql-load-type=write) 1> 101-500.log 2> 102-500.log
(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307 -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary --concurrency=1000 --number-of-queries=1000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb100 –-commint=100 --auto-generate-sql-load-type=write) 1> 101-1000.log 2> 102-1000.log
(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307 -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary --concurrency=1500 --number-of-queries=1000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb100 –-commint=100 --auto-generate-sql-load-type=write) 1> 101-1500.log 2> 102-1500.log
Benchmark
Running for engine ndbcluster
Average number of seconds to run all queries: 72.162 seconds
Minimum number of seconds to run all queries: 71.001 seconds
Maximum number of seconds to run all queries: 73.323 seconds
Number of clients running queries: 500
Average number of queries per client: 2000
Benchmark
Running for engine ndbcluster
Average number of seconds to run all queries: 33.083 seconds
Minimum number of seconds to run all queries: 32.924 seconds
Maximum number of seconds to run all queries: 33.243 seconds
Number of clients running queries: 1000
Average number of queries per client: 1000
Benchmark
Running for engine ndbcluster
Average number of seconds to run all queries: 50.789 seconds
Minimum number of seconds to run all queries: 50.629 seconds
Maximum number of seconds to run all queries: 50.949 seconds
Number of clients running queries: 1500
Average number of queries per client: 666
4.2 innodb,并发分别为--concurrency=500,1000,1500
(time mysqlslap --engine=innodb -h127.0.0.1 -P3307 -uadmin -pMBpassw0rd --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary --concurrency=500 --number-of-queries=1000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=indb100 –-commint=100 --auto-generate-sql-load-type=write) 1> idb101-500.log 2> idb102-500.log
(time mysqlslap --engine=innodb -h127.0.0.1 -P3307 -uadmin -pMBpassw0rd --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary --concurrency=1000 --number-of-queries=1000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=indb100 –-commint=100 --auto-generate-sql-load-type=write) 1> idb101-1000.log 2> idb102-1000.log
(time mysqlslap --engine=innodb -h127.0.0.1 -P3307 -uadmin -pMBpassw0rd --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary --concurrency=1500 --number-of-queries=1000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=indb100 –-commint=100 --auto-generate-sql-load-type=write) 1> idb101-1500.log 2> idb102-1500.log
Benchmark
Running for engine innodb
Average number of seconds to run all queries: 144.806 seconds
Minimum number of seconds to run all queries: 144.262 seconds
Maximum number of seconds to run all queries: 145.350 seconds
Number of clients running queries: 500
Average number of queries per client: 2000
Benchmark
Running for engine innodb
Average number of seconds to run all queries: 152.853 seconds
Minimum number of seconds to run all queries: 152.369 seconds
Maximum number of seconds to run all queries: 153.337 seconds
Number of clients running queries: 1000
Average number of queries per client: 1000
Benchmark
Running for engine innodb
Average number of seconds to run all queries: 146.931 seconds
Minimum number of seconds to run all queries: 140.731 seconds
Maximum number of seconds to run all queries: 153.132 seconds
Number of clients running queries: 1500
Average number of queries per client: 666
5 100W write压力,并发分别为--concurrency=600,800,1000
【===================100W 更新 =================】
(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307 -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary --concurrency=600,800,1000 --number-of-queries=1000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=udb100 –-commint=100 --auto-generate-sql-load-type=update) 1> u101.log 2> u102.log
6【===================200W 写 =================】
6.1 ndbcluster,并发分别为--concurrency=500,1000,1500
(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307 -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary --concurrency=500 --number-of-queries=2000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb200 –-commint=100 --auto-generate-sql-load-type=write) 1> 201.log 2> 202.log
(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307 -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary --concurrency=1000 --number-of-queries=2000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb200 –-commint=100 --auto-generate-sql-load-type=write) 1> 201-1000.log 2> 202-1000.log
(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307 -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary --concurrency=1500 --number-of-queries=2000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb200 –-commint=100 --auto-generate-sql-load-type=write) 1> 201-1500.log 2> 202-1500.log
Benchmark
Running for engine ndbcluster
Average number of seconds to run all queries: 62.062 seconds
Minimum number of seconds to run all queries: 60.812 seconds
Maximum number of seconds to run all queries: 63.313 seconds
Number of clients running queries: 500
Average number of queries per client: 4000
Benchmark
Running for engine ndbcluster
Average number of seconds to run all queries: 65.292 seconds
Minimum number of seconds to run all queries: 64.708 seconds
Maximum number of seconds to run all queries: 65.876 seconds
Number of clients running queries: 1000
Average number of queries per client: 2000
Benchmark
Running for engine ndbcluster
Average number of seconds to run all queries: 101.242 seconds
Minimum number of seconds to run all queries: 99.702 seconds
Maximum number of seconds to run all queries: 102.783 seconds
Number of clients running queries: 1500
Average number of queries per client: 1333
6.2 innodb ,并发分别为--concurrency=600,800,1000
(time mysqlslap --engine=innodb -h20.30.50.107 -P3307 -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary --concurrency=500 --number-of-queries=2000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb200 –-commint=100 --auto-generate-sql-load-type=write) 1> 201.log 2> 202.log
(time mysqlslap --engine=innodb -h20.30.50.107 -P3307 -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary --concurrency=1000 --number-of-queries=2000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb200 –-commint=100 --auto-generate-sql-load-type=write) 1> 201-1000.log 2> 202-1000.log
(time mysqlslap --engine=innodb -h20.30.50.107 -P3307 -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary --concurrency=1500 --number-of-queries=2000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb200 –-commint=100 --auto-generate-sql-load-type=write) 1> 201-1500.log 2> 202-1500.log
卡住了,长时间无结果,所以我果断ctrl + c
7【===================400W 写 =================】
7.1 ndbcluster,并发分别为--concurrency=500,1000,1500
(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307 -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary --concurrency=500 --number-of-queries=4000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb400 –-commint=100 --auto-generate-sql-load-type=write) 1> 401-500.log 2> 402-500.log
(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307 -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary --concurrency=1000 --number-of-queries=4000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb400 –-commint=100 --auto-generate-sql-load-type=write) 1> 401-1000.log 2> 402-1000.log
(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307 -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary --concurrency=1500 --number-of-queries=4000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb400 –-commint=100 --auto-generate-sql-load-type=write) 1> 401-1500.log 2> 402-1500.log
Benchmark
Running for engine ndbcluster
Average number of seconds to run all queries: 125.639 seconds
Minimum number of seconds to run all queries: 124.601 seconds
Maximum number of seconds to run all queries: 126.677 seconds
Number of clients running queries: 500
Average number of queries per client: 8000
PS:只执行了500的并发,1000,1500的卡住了,没有结果,果断ctrl + C
7.2 innodb,并发分别为--concurrency=500,1000,1500
(time mysqlslap --engine=innodb -h20.30.50.107 -P3307 -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary --concurrency=500 --number-of-queries=4000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb400 –-commint=100 --auto-generate-sql-load-type=write) 1> 401-500.log 2> 402-500.log
(time mysqlslap --engine=innodb -h20.30.50.107 -P3307 -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary --concurrency=1000 --number-of-queries=4000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb400 –-commint=100 --auto-generate-sql-load-type=write) 1> 401-1000.log 2> 402-1000.log
(time mysqlslap --engine=innodb -h20.30.50.107 -P3307 -utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary --concurrency=1500 --number-of-queries=4000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb400 –-commint=100 --auto-generate-sql-load-type=write) 1> 401-1500.log 2> 402-1500.log
卡住了,长时间无结果,所以我果断ctrl + c
8 一些调试过程中的报错纪录
8.1
time mysqlslap --engine=ndbcluster --auto-generate-sql-write-number=100000 --auto-generate-sql-guid-primary --concurrency=200,400,600 --number-of-queries=2000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb –-commint=1000
报错如下:
mysqlslap: Cannot run query INSERT INTO t1 VALUES (uuid(),1124366589,1668402834,788193961,693240337,710453914,1431628572,249499286,1957253341,731708400,1783032263,'lFEughGHyWDXctISMOyE500yda24R2J4HZyp6674cCb5ymPKAGQ7GQxts0pK29GCa7th5sdi55fvr4FtKhsSzpMrh33k4KofJhCOapyXuTQdaZMm6E75wLodOsDT4t','0FbCf11eOo7iPZ7oCDuJAigyCwiHPmBP1eTZXX3vB2TcSSGYh3rrlNhxBOFd2QuwwOTRnOEyQjQuBbQke9RNO8DcOK5JmrFaFc1usFkIq351eNd8P4Xh4c9LwEgayn','85F907OcHEfM79ekHvghcd9my6sWgqHpwYqoX7OoLw3L5hxFSeo4Fxi53bbcHsHDGztn6IRK6Wh33eIX8ycFwACrlnJvXc0fcuIi4muAGbDC6Oj6MBEAMQ2zEDudqv','HIhbslLnnWM0iKGPRXTZhrzbqDhdjXY0hDRZqhKdBbTlne269XfiMfA5kriRE6JvJnS1Shef8zGvdI2mqZL4CN9pEjGKpcF0Fb1j8XEGXW48oynWX0bcNcPTKZp994','2GX3zgR5oybsyGideEdDi0i7TugIviExyetqAKvyANj8XPm9XNFDGxClrtwmR2cPgTFqp3hzQOzxhly51DAH2Nut8iYbl80PT88I3p9LD0Ame8rfM2oOPaAZHa02as','J3sRDvGEGLEQ8sRzNptB5Am7bvhbxFSGAKkNGsdOEkjMcADsrz3w9hwdcTCPdgantA312YPGG8WlAcd1RYqS6m5aFI0sqaYjkbke72nG291DdeE4AwZGiWrqgjaX9y','6lZjNZlApnKqspK7uWvJfWpMKWxmt6lzrAi6jJHY7TEzIay45mNcG5qSRnEKlrBc2mad5jA4COwNzmRwYjOogE87tFJe6W608geEOgASwyjnlBj9mzqQ5yPyDkSC6a','4F7iLNENjBMRyzWa0GZqaXhzTmbyqhOvwNT9mkZWnnxdmJBebdT1820TgbJX8kIxzn6eNX8AAxowGrRjSokSqcyM39t3tB0lrzNEMNPZC5LKwo3HcflI7bhAlaDWe6','FL5ebR1ssDpEZm2S3fzgx68WGt5MFbSXoP1Fkv8d0prQblmWOmBEsBk14hNB8jio0c4kN4LNt4pLqcr6MuC65p71MMDNxnBxNFimJv2DsraiJHgZClY9aXBouOBjBN','hReF5qA7vurLS2e9Sim0sKX38HJC1Mbip5pnnzmimT3EYaNsG9s8LF3MZMaal18QyxDmo0KaTGptq4l66TFJlIhIZ7kI0kkrZyTDqpgB5TxvPiuXC1jpBOzkOb2OJn')
ERROR : Got temporary error 1221 'REDO buffers overloaded (increase RedoBuffer)' from NDBCLUSTER
【】设置值
RedoBuffer=1024M
8.2
mysqlslap: Cannot run query INSERT INTO t1 VALUES (uuid(),493003739,1094004845,2043467988,1553979924,1267424138,2013801552,1873938704,1783263123,1384180838,447107163,'1MPJh2d9MOvi9GCrzc6vAxsqMXvyQPuJnJfLL8MbPHHaaMHPqFCsDxjRSWHmvB5aMcvbdHA2RKStilAYtFOyCzPYTaAGm7j8kWcDgm776bsgCu4x9TvDKClinnyZvZ','ZX49kkorjmQRRWLXSNsNcDcEvF1lgwJDRFF3zvuahC10bMY3dGIELmKG1LuhA5ndK2hBpRlWgeX7svAWBKcZ7wh8HRqROdxkXWnKxYiT2Dcv0eP4z1T6p2E6MwQmZN','XwtIGijzCd4gYxJptIiMOXGWWeRwPsJop46xmhoqBlXjiqPb07pOf5m9cDx1y8pnCncqLPhYA4FkmgBmg02BxoCZu9asHFXL373GOkoagvIQSTC8LEBJvNkpYBZhQ4','uL3xdSaHuEDDZhalhossznFjcfu1CDx6Q0vwKTDFcQK9zmugaeYZPf9tIvuM0rSRkON4lSBLnNMmA9Jcnj2DNByZ6to7kGQKYhPA9SNosmbunmMaTOfkbeAaNyZ76z','KXYdhh5wWpixjLb6w4MRhq5jOShpSfooAKPjtMgFCE4ncflOc8r9ypsE9Z3dCjHFvayopWw1lsoDYad0aK9Y91mJQpoWYylRYc7L6vEjovoCLPCveDRnE56gun2Ilo','d9OcNMYdyCYmOl4Sgih7Ln4KJy7L8s1dtPEGgemWqAG6wCQcu7cGmgc5XbIfJKHCdNLH17njHwpD8FivEIB0qfxLEFtZb2dDHyMI52tFyaKyh2tnC4n3bcGpj1EB3s','OKqeWogN3WpNTWIMHWJwPuOic8jqJfabrH5M5md08JNTpZsz43vTxK3PKfGfAi61zBFwploy4CRtdBshEg34syTCddjnKphB0w0qhoglszXW3F39v6Df5jraCaEONv','cGrSyPGW21LZXOhaaSZf8eEz4RQIrhDJxxnnMwHOxXqKvXuLzJ17p7zuaHCIyIdoFHbT5lt28bM368HySAxHHw3kDG24QXshgJAlwvf4N10L2HJMJHXc5bCJj6F9e7','iAQkwFXbJuTBGNKblfkG8qjK1QRGRxF9zZtvoPN0BkBR7YvkBfsJLcYMuzWMolNnJ9b7aq7laB5Zj09mX16tTWFOTee9N1wi2NicDhEfsBCRBLEiFCRkib03DeCcY0','BaOl3dI9HBKLWNjkxywPae0bh55lZTmkwALzng0wjKIDjtygjmxHHxkq2qccBMC7OayB6y0pAIul3sQmXFvoDge7MEbZSohsEfwCWw1g6vI9gcn3rir4ML4kSfIwJr')
ERROR : Got temporary error 1218 'Send Buffers overloaded in NDB kernel' from NDBCLUSTER
【】设置值
在sql节点的my.cnf里面去掉binlog
8.3
time mysqlslap --engine=ndbcluster --auto-generate-sql-write-number=100000 --auto-generate-sql-guid-primary --concurrency=200,400,600 --number-of-queries=2000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb –-commint=1000 --auto-generate-sql-load-type=write
mysqlslap: Cannot run query INSERT INTO t1 VALUES (uuid(),100669,332702450,660916487,67974802,573556837,75245562,1390598089,1028363610,1531585205,1260995960,'kXdTjGCh2PNzLoeR0527frpQDQ8uw67Ydk1K06uuNHtkxYBxT5w8plb2BbpzhwYBgPNYX9RmICWGkZD6fAESvhMzH3yqzMtXoH4BQNylbK1CmEIPGYlC6zBN3152Gz','a4GW7atxJKACYwJqDbFynLxqc0kh30YTwgz3FktQ43XTrqJ4PQ25frn7kXhfXD8RuzN1j8Rf3y8ugKy6es3IbqPJM6ylCyD6xS7YcQCfHKZxYNvB7yTahmu3lkoxjt','vgLu5xKHSTTtJuGE5F5QqmCcppCTmvFZScRZQgim93gSxwb24gKmIPEzEQStMjQiCu7WapGbkw4ilXch3xRLMhKSzgLDOovSi2qGj6rKvnuYAWDDJgaZDu24bNIrBD','Bl81tjzdvuOpQRCXgX37xGtzLKEXBIcE3k7xK7aFtqxC99jqYnpTviK83bf6lGDgsKd4R3KLmHPnI8TqnIKj1gjw7N2sXFZNS2Svyg8cpZN7atxL39w4igspvnaQuz','hMt1IrZIJMkbLAKBNNKKK2sCknzI5uHeGAgQuDd5SLgpN0smODyc7qorTo1QaI5qLl97qmCIzl0Mds81x7TxpIoJyqlY0iEDRNKA1PS0AKEn5NhuMAr3KgEIMsqMa5','SuKo4M5OM7ldvisSc6WK9rsG9E8sSixocHdgfa5uiiNTGFxkDJ4EAwWC2e4NL1BpAgWiFRcp1zIH6F1BayPdmwphatwnmzdwgzWnQ6SRxmcvtd6JRYwEKdvuWri8qB','5MAR1caTvNFXB00HKShGa1uToGCMP2ZMHjpABFg6fnTioTz8pZGNQAkEJwckr9y0kfAvvq1QWM8IkzIZOaprdPxwMaY5bW5C977wy1MKNMe7EwZeWET7fRv1tRyKpv','Yr3YntZ2DoGrwWfL91bW9Epw8iO6vDuR4xrkqOe3Dum1PPEQQpwRvmO3Kg2FtobqlQQRj4Woq8hFZvhrkWBX8bRSFLc09BiuT0L44jsvrZ2GKczwyAS6dvakGAlPDJ','BbKOfG7O3qp66Aa5yY8QelD4WL77eKIpneDJnCbq2Oo0QM6Pm6jOrxLDASCpgXWS1cnooMXjeJj5ahMCnxTXuqkxIxmyK8QLk52PJZ8ykjvAP9N46sbtiKq09SqTcH','iLEkea9eOuLJweKJjQ3IJlW1dXTSs6dbJjJpHTRZFgkBJ4XuNQ4iCRchy51r3WQEEdvNyMxDvZHEeg0164bINBsM9l54GNBM06lrTa4G8LWe1Mf8I6IiA24Jo1FwOQ')
ERROR : Got temporary error 1234 'REDO log files overloaded (increase disk hardware)' from NDBCLUSTER
【】清理磁盘data节点37的磁盘满了
/home/ndb_4_fs文件夹占据了22G,清理掉。
8.4
【】
ERROR : Got temporary error 410 'REDO log files overloaded (decrease TimeBetweenLocalCheckpoints or increase NoOfFragmentLogFiles)' from NDBCLUSTER
vim /usr/local/mysql/cluster-conf/config.ini
TimeBetweenLocalCheckpoints=10 (原值20)
NoOfFragmentLogFiles=32 (原值8)
ERROR : Got temporary error 4010 'Node failure caused abort of transaction' from NDBCLUSTER
MySQL Cluster 4个数据节点压力测试--mysqlslap工具压400W写的更多相关文章
- MySQL Cluster2个数据节点压力测试--mysqlslap工具压400W写
锅巴哥的个人建议:cluster叫电信运营商版本,所以基本上在很大的用户并发量的情况下才会用到,对连接数的线性增长要求高的场景,千兆就不用想了, 没万兆就不用玩了. 很不幸,我的就是千兆网络,我的数据 ...
- MySQL Cluster在线添加数据节点
增加或减少数据节点的数量和 NoOfReplicas(即副本数,通过管理节点的config.ini配置文件来设置)有关,一般来说NoOfReplicas是2,那么增加或减少的数量也应该是成对的,否则要 ...
- Webbench、ab命令:做压力测试的工具和性能的监控工具
DDOS攻击:???DDOS概述:分布式拒绝服务(DDoS:Distributed Denial of Service)攻击,指借助于客户/服务器技术,将多个计算机联合起来作为攻击平台,对一个或多个目 ...
- Linux内存压力测试-memtester工具
*:first-child { margin-top: 0 !important; } body>*:last-child { margin-bottom: 0 !important; } /* ...
- Windows Server 2008R2配置MySQL Cluster并将管理节点和数据节点配置成windows服务
说明:将mysql的管理节点和数据节点配置成windows服务是为了防止有人手误关闭管理节点或数据节点的dos命令窗口,管理节点或数据节点的命令窗口误关闭可能会造成mysql某台或某几台mysql不能 ...
- 压力测试+接口测试(工具jmeter)
jmeter是apache公司基于java开发的一款开源压力测试工具,体积小,功能全,使用方便,是一个比较轻量级的测试工具,使用起来非常简单.因 为jmeter是java开发的,所以运行的时候必须 ...
- 其他:压力测试Jmeter工具使用
下载路径: http://yd01.siweidaoxiang.com:8070/jmeter_52z.com.zip 配置汉化中文: 找到jmeter的安装目录:打开 \bin\jmeter.pro ...
- MySQL Cluster线上管理节点配置文件-数据节点32G内存
网上的朋友提供的,仅供参考. [NDBD DEFAULT] NoOfReplicas= 2 DataMemory=20G IndexMemory=5G MaxNoOfConcurrentTransac ...
- 一款C++写的tcp性能测试(压力测试)工具
基线终于开发完了,自己写的服务器性能和压力承受能力到底怎么样,在网上没有找到合适的测试工具可以用.于是自己基于MFC写了一款测试工具. 启动界面如下: 设置参数后,运行如下: 运行完界面如下: 源码路 ...
随机推荐
- sql server 2008 r2 出问题
1.想利用sql2008的数据挖掘功能,以为是没有安装全,所以就卸载了. (1)利用Windows Installer Clean UP将以前的卸载干净 (2)出现了Could not open ke ...
- 初识-----基于Socket的UDP和TCP编程及测试代码
一.概述 TCP(传输控制协议)和UDP(用户数据报协议是网络体系结构TCP/IP模型中传输层一层中的两个不同的通信协议. TCP:传输控制协议,一种面向连接的协议,给用户进程提供可靠的全双工的字节流 ...
- Bluebird-Collections
Promise实例方法和Promise类核心静态方法用于处理promise或者混合型(mixed)promise和值的集合. 所有的集合实例方法都等效于Promise对象中的静态方法,例如:someP ...
- php框架推荐
ThinkPHP, 国内开发的框架,特别容易入门,中文文档细致,表述准确. Laravel, 国外框架,非常高级的一个框架,特别是前端比较模块化,但入门难一些,速度不高. laravel在lampp ...
- 邮件发送服务AWS SES,Mailgun以及SendCloud(转)
原文:http://www.l4zy.com/posts/aws_ses-mailgun-sendcloud.html 电子邮件这一已经诞生很多年的互联网基础服务并没有随着时间的推移而慢慢消亡,实际上 ...
- ms-class的进化
ms-class是avalon用得最多的几个绑定之一,也正因为如此其功能一直在扩充中.根据时期的不同,分为旧风格与新风格两种. 旧风格是指正在ms-class后面跟着类外,然后在绑定值中添加表达式,即 ...
- vim之vba文件
[vim之vba文件] Vimball 官方描述: The vimball plugin facilitates creating, extracting , and listing the cont ...
- AutoCAD.NET 不使用P/Invoke方式调用acad.exe或accore.dll中的接口(如acedCommand、acedPostCommand等)
使用C#进行AutoCAD二次开发,有时候由于C#接口不够完善,或者低版本AutoCAD中的接口缺少,有些工作不能直接通过C#接口来实现,所以需要通过P/Invoke的方式调用AutoCAD的其他DL ...
- datareader几种用法总结
1.本人常用: if (reader["字段名"] != DBNull.Value) { userRegisterInfo.OrgCode = reader["字段名&q ...
- Codeforces 627 A. XOR Equation (数学)
题目链接:http://codeforces.com/problemset/problem/627/A 题意: 告诉你s 和 x,a + b = s a xor b = x a, b > ...