第三十六课 非关系统型数据库-mangodb

目录

二十四 mongodb介绍

二十五 mongodb安装

二十六 连接mongodb

二十七 mongodb用户管理

二十八 mongodb创建集合、数据管理

二十九 php的mongodb扩展

三十 php的mongo扩展

三十一 mongodb副本集介绍

三十二 mongodb副本集搭建

三十三 mongodb副本集测试

三十四 mongodb分片介绍

三十五 mongodb分片搭建

三十六 mongodb分片测试

三十七 mongodb备份恢复

三十八 扩展

二十四 mongodb介绍

官网www.mongodb.com， 截止2018年08月26日，当前最新版4.0.1

C++编写，基于分布式的，属于NoSQL的一种

在NoSQL中是最像关系型数据库的

MongoDB 将数据存储为一个文档，数据结构由键值(key=>value)对组成。MongoDB 文档类似于 JSON 对象。字段值可以包含其他文档、数组及文档数组。

关于JSON http://www.w3school.com.cn/json/index.asp

因为基于分布式，所以很容易扩展

MongoDB和关系型数据库对比

关系型数据库数据结构

mongodb数据库数据结构

##二十五 mongodb安装

官方安装文档https://docs.mongodb.com/manual/tutorial/install-mongodb-on-red-hat/

1.新建yum源

  1. [root@mangodbserver1 ~]# vim /etc/yum.repos.d/mangodb-org-4.0.repo
  2. [mongodb-org-4.0]
  3. name=MongoDB Repository
  4. baseurl=https://repo.mongodb.org/yum/redhat/$releasever/mongodb-org/4.0/x86_64/
  5. gpgcheck=1
  6. enabled=1
  7. gpgkey=https://www.mongodb.org/static/pgp/server-4.0.asc

2.查看软件包

  1. [root@mangodbserver1 ~]# yum list |grep mongodb
  2. collectd-write_mongodb.x86_64             5.8.0-4.el7                  epel
  3. mongodb.x86_64                            2.6.12-6.el7                 epel
  4. mongodb-org.x86_64                        4.0.1-1.el7                  mongodb-org-4.0
  5. mongodb-org-mongos.x86_64                 4.0.1-1.el7                  mongodb-org-4.0
  6. mongodb-org-server.x86_64                 4.0.1-1.el7                  mongodb-org-4.0
  7. mongodb-org-shell.x86_64                  4.0.1-1.el7                  mongodb-org-4.0
  8. mongodb-org-tools.x86_64                  4.0.1-1.el7                  mongodb-org-4.0
  9. mongodb-server.x86_64                     2.6.12-6.el7                 epel
  10. mongodb-test.x86_64                       2.6.12-6.el7                 epel
  11. nodejs-mongodb.noarch                     1.4.7-1.el7                  epel
  12. php-mongodb.noarch                        1.0.4-1.el7                  epel
  13. php-pecl-mongodb.x86_64                   1.1.10-1.el7                 epel
  14. poco-mongodb.x86_64                       1.6.1-3.el7                  epel
  15. syslog-ng-mongodb.x86_64                  3.5.6-3.el7                  epel

3.安装mangodb-org

  1. [root@mangodbserver1 ~]# yum -y install mongodb-org
  2. Loaded plugins: fastestmirror
  3. Loading mirror speeds from cached hostfile
  4.  * base: mirrors.aliyun.com
  5.  * epel: mirrors.tongji.edu.cn
  6.  * extras: mirrors.aliyun.com
  7.  * updates: mirrors.163.com
  8. Resolving Dependencies
  9. ...中间略...
  10. Installed:
  11.   mongodb-org.x86_64 0:4.0.1-1.el7                                                                                                                                       
  13. Dependency Installed:
  14.   mongodb-org-mongos.x86_64 0:4.0.1-1.el7   mongodb-org-server.x86_64 0:4.0.1-1.el7   mongodb-org-shell.x86_64 0:4.0.1-1.el7   mongodb-org-tools.x86_64 0:4.0.1-1.el7  
  16. Complete!

##二十六 连接mongodb

1.启动mangodb

  1. [root@mangodbserver1 ~]# systemctl start mongod.service
  2. [root@mangodbserver1 ~]# systemctl enable mongod.service
  3. [root@mangodbserver1 ~]# lsof -i :27017
  4. COMMAND  PID   USER   FD   TYPE DEVICE SIZE/OFF NODE NAME
  5. mongod  1782 mongod   11u  IPv4  22968      0t0  TCP localhost:27017 (LISTEN)

2.连接

  1. # 本机直接运行命令mongo进入到mongodb shell中
  2. -bash: mango: command not found
  3. [root@mangodbserver1 ~]# mongo
  4. MongoDB shell version v4.0.1
  5. connecting to: mongodb://127.0.0.1:27017
  6. MongoDB server version: 4.0.1
  7. Welcome to the MongoDB shell.
  8. For interactive help, type "help".
  9. For more comprehensive documentation, see
  10.         http://docs.mongodb.org/
  11. Questions? Try the support group
  12.         http://groups.google.com/group/mongodb-user
  13. Server has startup warnings:
  14. 2018-08-26T14:01:51.415+0800 I CONTROL  [initandlisten]
  15. 2018-08-26T14:01:51.415+0800 I CONTROL  [initandlisten] ** WARNING: Access control is not enabled for the database.
  16. 2018-08-26T14:01:51.415+0800 I CONTROL  [initandlisten] **          Read and write access to data and configuration is unrestricted.
  17. 2018-08-26T14:01:51.415+0800 I CONTROL  [initandlisten]
  18. ---
  19. Enable MongoDB's free cloud-based monitoring service, which will then receive and display
  20. metrics about your deployment (disk utilization, CPU, operation statistics, etc).
  22. The monitoring data will be available on a MongoDB website with a unique URL accessible to you
  23. and anyone you share the URL with. MongoDB may use this information to make product
  24. improvements and to suggest MongoDB products and deployment options to you.
  26. To enable free monitoring, run the following command: db.enableFreeMonitoring()
  27. To permanently disable this reminder, run the following command: db.disableFreeMonitoring()
  28. ---
  30. >
  31. # 如果mongodb监听端口并不是默认的27017，则在连接的时候需要加--port 选项，例如
  32. # mongo --port 27018
  33. # 连接远程mongodb，需要加--host，例如
  34. # mongo --host  192.168.1.47
  35. # 如果设置了验证，则在连接的时候需要带用户名和密码
  36. # mongo -uusername -ppasswd --authenticationDatabase db  类似于MySQL

二十七 mongodb用户管理

常用操作

  1. # 需要切换到admn库
  2. > use admin
  3. switched to db admin
  4. # 创建用户admin，user指定用户，customData为说明字段，可以省略，pwd为密码，roles指定用户的角色，db指定库名
  5. > db.createUser( { user: "admin", customData: {description: "superuser"}, pwd: "admin122", roles: [ { role: "root", db: "admin" } ] } )
  6. Successfully added user: {
  7.         "user" : "admin",
  8.         "customData" : {
  9.                 "description" : "superuser"
  10.         },
  11.         "roles" : [
  12.                 {
  13.                         "role" : "root",
  14.                         "db" : "admin"
  15.                 }
  16.         ]
  17. }
  19. # 列出所有用户，需要切换到admin库
  20. > db.system.users.find()
  21. { "_id" : "admin.admin", "user" : "admin", "db" : "admin", "credentials" : { "SCRAM-SHA-1" : { "iterationCount" : 10000, "salt" : "t3C0r5eRm8qrPrdyQwPGRw==", "storedKey" : "2FNCyDURiJKU6LnC8QvRVtUcO00=", "serverKey" : "1eyFpJkirCnUwvFTj7sLeucNZ5Q=" }, "SCRAM-SHA-256" : { "iterationCount" : 15000, "salt" : "h58+0R+lhBUZFMMRqjwRYcnOPyoCl62xb0gg5g==", "storedKey" : "G9gV0/k0nQ+KjBE/12qvtjhGNiFPBy6RRSolPZmVkNo=", "serverKey" : "/Vh31wMqLZkuxPh3zNL6QQLTfGlUcxqZx8fk1GRRugY=" } }, "customData" : { "description" : "superuser" }, "roles" : [ { "role" : "root", "db" : "admin" } ] }
  23. # 查看当前库下所有的用户
  24. > show users
  25. {
  26.         "_id" : "admin.admin",
  27.         "user" : "admin",
  28.         "db" : "admin",
  29.         "customData" : {
  30.                 "description" : "superuser"
  31.         },
  32.         "roles" : [
  33.                 {
  34.                         "role" : "root",
  35.                         "db" : "admin"
  36.                 }
  37.         ],
  38.         "mechanisms" : [
  39.                 "SCRAM-SHA-1",
  40.                 "SCRAM-SHA-256"
  41.         ]
  42. }
  43. # 创建用户kennminn
  44. > db.createUser({user: "kennminn", pwd: "123456", roles:[{role: "read", db: "test"}]})
  45. Successfully added user: {
  46.         "user" : "kennminn",
  47.         "roles" : [
  48.                 {
  49.                         "role" : "read",
  50.                         "db" : "test"
  51.                 }
  52.         ]
  53. }
  54. # 删除用户kennminn
  55. > db.dropUser('kennminn')
  56. true
  58. # 若要用户生效，还需要编辑启动脚本vim /usr/lib/systemd/system/mongod.service,在OPTIONS=后面增--auth
  59. [root@mangodbserver1 ~]# vim /usr/lib/systemd/system/mongod.service
  60. # 修改此句开启验证
  61. Environment="OPTIONS=--auth -f /etc/mongod.conf"
  62. [root@mangodbserver1 ~]# systemctl restart mongod.service
  63. Warning: mongod.service changed on disk. Run 'systemctl daemon-reload' to reload units.
  64. [root@mangodbserver1 ~]# systemctl daemon-reload
  65. [root@mangodbserver1 ~]# systemctl restart mongod.service
  66. # 未验证身份，查询失败
  67. [root@mangodbserver1 ~]# mongo
  68. MongoDB shell version v4.0.1
  69. connecting to: mongodb://127.0.0.1:27017
  70. MongoDB server version: 4.0.1
  71. > use admin
  72. switched to db admin
  73. > show users
  74. 2018-08-26T16:52:37.729+0800 E QUERY    [js] Error: command usersInfo requires authentication :
  75. _getErrorWithCode@src/mongo/shell/utils.js:25:13
  76. DB.prototype.getUsers@src/mongo/shell/db.js:1757:1
  77. shellHelper.show@src/mongo/shell/utils.js:859:9
  78. shellHelper@src/mongo/shell/utils.js:766:15
  79. @(shellhelp2):1:1
  80. # 认证身份
  81. [root@mangodbserver1 ~]# mongo -u "admin" -p "admin122" --authenticationDatabase "admin"
  82. MongoDB shell version v4.0.1
  83. connecting to: mongodb://127.0.0.1:27017
  84. MongoDB server version: 4.0.1
  85. ---
  86. Enable MongoDB's free cloud-based monitoring service, which will then receive and display
  87. metrics about your deployment (disk utilization, CPU, operation statistics, etc).
  89. The monitoring data will be available on a MongoDB website with a unique URL accessible to you
  90. and anyone you share the URL with. MongoDB may use this information to make product
  91. improvements and to suggest MongoDB products and deployment options to you.
  93. To enable free monitoring, run the following command: db.enableFreeMonitoring()
  94. To permanently disable this reminder, run the following command: db.disableFreeMonitoring()
  95. ---
  97. > use admin
  98. switched to db admin
  99. > show users
  100. {
  101.         "_id" : "admin.admin",
  102.         "user" : "admin",
  103.         "db" : "admin",
  104.         "customData" : {
  105.                 "description" : "superuser"
  106.         },
  107.         "roles" : [
  108.                 {
  109.                         "role" : "root",
  110.                         "db" : "admin"
  111.                 }
  112.         ],
  113.         "mechanisms" : [
  114.                 "SCRAM-SHA-1",
  115.                 "SCRAM-SHA-256"
  116.         ]
  117. }
  118. # 在db1库中创建用户test1，test1用户对db1库读写，对db2库只读。
  119. > use db1
  120. switched to db db1
  121. > db.createUser( { user: "test1", pwd: "123aaa", roles: [ { role: "readWrite", db: "db1" }, {role: "read", db: "db2" } ] } )
  122. Successfully added user: {
  123.         "user" : "test1",
  124.         "roles" : [
  125.                 {
  126.                         "role" : "readWrite",
  127.                         "db" : "db1"
  128.                 },
  129.                 {
  130.                         "role" : "read",
  131.                         "db" : "db2"
  132.                 }
  133.         ]
  134. }
  135. > show users
  136. {
  137.         "_id" : "db1.test1",
  138.         "user" : "test1",
  139.         "db" : "db1",
  140.         "roles" : [
  141.                 {
  142.                         "role" : "readWrite",
  143.                         "db" : "db1"
  144.                 },
  145.                 {
  146.                         "role" : "read",
  147.                         "db" : "db2"
  148.                 }
  149.         ],
  150.         "mechanisms" : [
  151.                 "SCRAM-SHA-1",
  152.                 "SCRAM-SHA-256"
  153.         ]
  154. }
  156. > use db2
  157. switched to db db2
  158. > show users
  159. > db.auth("test1", "123aaa")
  160. Error: Authentication failed.
  161. 0
  162. > use db1
  163. switched to db db1
  164. > db.auth("test1", "123aaa")

MongoDB用户角色

Read：允许用户读取指定数据库

readWrite：允许用户读写指定数据库

dbAdmin：允许用户在指定数据库中执行管理函数，如索引创建、删除，查看统计或访问system.profile

userAdmin：允许用户向system.users集合写入，可以找指定数据库里创建、删除和管理用户

clusterAdmin：只在admin数据库中可用，赋予用户所有分片和复制集相关函数的管理权限。

readAnyDatabase：只在admin数据库中可用，赋予用户所有数据库的读权限

readWriteAnyDatabase：只在admin数据库中可用，赋予用户所有数据库的读写权限

userAdminAnyDatabase：只在admin数据库中可用，赋予用户所有数据库的userAdmin权限

dbAdminAnyDatabase：只在admin数据库中可用，赋予用户所有数据库的dbAdmin权限。

root：只在admin数据库中可用。超级账号，超级权限

MongoDB库管理

  1. # 查看版本
  2. > db.version()
  3. 4.0.1
  5. # 如果库存在就切换，不存在就创建
  6. > use db1
  7. switched to db db1
  9. # 查看库，该库是空库，没有创建集合，
  10. > show dbs
  11. admin   0.000GB
  12. config  0.000GB
  13. local   0.000GB
  15. # 创建集合
  16. > db.createCollection('clo1')
  17. { "ok" : 1 }
  18. > show dbs
  19. admin   0.000GB
  20. config  0.000GB
  21. db1     0.000GB
  22. local   0.000GB
  24. # 删除当前库，要想删除某个库，必须切换到那个库下
  25. > use userdb
  26. switched to db userdb
  27. > db.createCollection('clo1')
  28. { "ok" : 1 }
  29. > db.dropDatabase()
  30. { "dropped" : "userdb", "ok" : 1 }
  32. # 查看mongodb服务器的状态
  33. > db.serverStatus()
  34. {
  35.         "host" : "mangodbserver1",
  36.         "version" : "4.0.1",
  37.         "process" : "mongod",
  38.         "pid" : NumberLong(2968),
  39.         "uptime" : 2383,
  40.         "uptimeMillis" : NumberLong(2382444),
  41.         "uptimeEstimate" : NumberLong(2382),
  42.         "localTime" : ISODate("2018-08-26T09:39:29.055Z"),
  43.         "asserts" : {
  44. ...下略...
  45.                 },
  46.                 "ttl" : {
  47.                         "deletedDocuments" : NumberLong(0),
  48.                         "passes" : NumberLong(39)
  49.                 }
  50.         },
  51.         "ok" : 1
  52. }

二十八 mongodb创建集合、数据管理

1.创建集合

  1. # 语法：db.createCollection(name,options)
  2. # name就是集合的名字，options可选，用来配置集合的参数，参数如下
  3. # capped true/false （可选）如果为true，则启用封顶集合。封顶集合是固定大小的集合，当它达到其最大大小，会自动覆盖最早的条目。如果指定true，则也需要指定尺寸参数。
  4. # autoindexID  true/false （可选）如果为true，自动创建索引_id字段的默认值是false。
  5. # size （可选）指定最大大小字节封顶集合。如果封顶如果是 true，那么你还需要指定这个字段。单位B
  6. # max （可选）指定封顶集合允许在文件的最大数量。
  7. > db.createCollection("mycol", { capped : true, size : 6142800, max : 10000 } )
  8. { "ok" : 1 }

2.数据管理

  1. # 查看集合，或者使用show  tables
  2. >  show collections
  3. clo1
  4. mycol
  5. > show  tables
  6. clo1
  7. mycol
  9. # 如果集合不存在，直接插入数据，则mongodb会自动创建集合
  10. > db.Account.insert({AccountID:1,UserName:"123",password:"123456"})
  11. WriteResult({ "nInserted" : 1 })
  12. # 更新
  13. > db.Account.update({AccountID:1},{"$set":{"Age":20}})
  14. WriteResult({ "nMatched" : 1, "nUpserted" : 0, "nModified" : 1 })
  15. # 查看所有文档
  16. > db.Account.find()
  17. { "_id" : ObjectId("5b828f3d727dfa33d5561c62"), "AccountID" : 1, "UserName" : "123", "password" : "123456", "Age" : 20 }
  18. # 根据条件查询
  19. > db.Account.find({AccountID:1})
  20. { "_id" : ObjectId("5b828f3d727dfa33d5561c62"), "AccountID" : 1, "UserName" : "123", "password" : "123456", "Age" : 20 }
  21. # 根据条件删除
  22. > db.Account.remove({AccountID:1})
  23. WriteResult({ "nRemoved" : 1 })
  24. >  db.Account.find()
  25. # 删除所有文档，即删除集合
  26. >  db.Account.drop()
  27. true
  28. # 先进入对应的库
  29. > use db1
  30. switched to db db1
  31. # 然后查看集合状态
  32. > db.printCollectionStats()
  33. clo1
  34. {
  35.         "ns" : "db1.clo1",
  36.         "size" : 0,
  37.         "count" : 0,
  38.         "storageSize" : 4096,
  39.         "capped" : false,
  40.         "wiredTiger" : {
  41.                 "metadata" : {
  42.                         "formatVersion" : 1
  43. ...中间略...
  44.        "nindexes" : 1,
  45.         "totalIndexSize" : 4096,
  46.         "indexSizes" : {
  47.                 "_id_" : 4096
  48.         },
  49.         "ok" : 1
  50. }
  51. ---

二十九 php的mongodb扩展

安装过程

  1. [root@mangodbserver1 ~]#  cd /usr/local/src/
  2. [root@mangodbserver1 src]#  git clone https://github.com/mongodb/mongo-php-driver
  3. Cloning into 'mongo-php-driver'...
  4. remote: Counting objects: 22561, done.
  5. remote: Compressing objects: 100% (2/2), done.
  6. remote: Total 22561 (delta 0), reused 2 (delta 0), pack-reused 22559
  7. Receiving objects: 100% (22561/22561), 6.64 MiB | 2.12 MiB/s, done.
  8. Resolving deltas: 100% (17804/17804), done.
  9. [root@mangodbserver1 src]# cd mongo-php-driver
  10. [root@mangodbserver1 mongo-php-driver]# git submodule update --init
  11. Submodule 'src/libmongoc' (https://github.com/mongodb/mongo-c-driver.git) registered for path 'src/libmongoc'
  12. Cloning into 'src/libmongoc'...
  13. remote: Counting objects: 104584, done.
  14. remote: Compressing objects: 100% (524/524), done.
  15. remote: Total 104584 (delta 266), reused 240 (delta 138), pack-reused 103918
  16. Receiving objects: 100% (104584/104584), 51.46 MiB | 4.84 MiB/s, done.
  17. Resolving deltas: 100% (91157/91157), done.
  18. Submodule path 'src/libmongoc': checked out 'a690091bae086f267791bd2227400f2035de99e8'
  19. [root@mangodbserver1 mongo-php-driver]# /usr/local/php-fpm/bin/php
  20. php         php-cgi     php-config  phpize
  21. [root@mangodbserver1 mongo-php-driver]# /usr/local/php-fpm/bin/phpize
  22. Configuring for:
  23. PHP Api Version:         20131106
  24. Zend Module Api No:      20131226
  25. Zend Extension Api No:   220131226
  26. [root@mangodbserver1 mongo-php-driver]# ./configure --with-php-config=/usr/local/php-fpm/bin/php-config
  27. checking for grep that handles long lines and -e... /usr/bin/grep
  28. checking for egrep... /usr/bin/grep -E
  29. checking for a sed that does not truncate output... /usr/bin/sed
  30. ...中间略...
  31. config.status: creating /usr/local/src/mongo-php-driver/src/libmongoc/src/libbson/src/bson/bson-config.h
  32. config.status: creating /usr/local/src/mongo-php-driver/src/libmongoc/src/libbson/src/bson/bson-version.h
  33. config.status: creating /usr/local/src/mongo-php-driver/src/libmongoc/src/libmongoc/src/mongoc/mongoc-config.h
  34. config.status: creating /usr/local/src/mongo-php-driver/src/libmongoc/src/libmongoc/src/mongoc/mongoc-version.h
  35. config.status: creating config.h
  36. [root@mangodbserver1 mongo-php-driver]# make && make install
  37. /bin/sh /usr/local/src/mongo-php-driver/libtool --mode=compile cc  -DBSON_COMPILATION -DMONGOC_COMPILATION -pthread
  38. ...中间略...
  39. Build complete.
  40. Don't forget to run 'make test'.
  41. Installing shared extensions:     /usr/local/php-fpm/lib/php/extensions/no-debug-non-zts-20131226/
  43. [root@mangodbserver1 mongo-php-driver]# vim /usr/local/php-fpm/etc/php.ini
  44. # 添加
  45. extension = mongodb.so
  46. [root@mangodbserver1 mongo-php-driver]# /usr/local/php-fpm/sbin/php-fpm -m | grep mongo
  47. mongodb
  48. [root@mangodbserver1 mongo-php-driver]# /etc/init.d/php-fpm restart
  49. Gracefully shutting down php-fpm . done
  50. Starting php-fpm  done

三十 php的mongo扩展

  1. [root@mangodbserver1 mongo-php-driver]# cd /usr/local/src/
  2. [root@mangodbserver1 src]# wget https://pecl.php.net/get/mongo-1.6.16.tgz
  3. --2018-08-26 20:58:55--  https://pecl.php.net/get/mongo-1.6.16.tgz
  4. Resolving pecl.php.net (pecl.php.net)... 104.236.228.160
  5. ...中间略...
  6. 2018-08-26 20:58:59 (140 KB/s) - ‘mongo-1.6.16.tgz’ saved [210341/210341]
  7. [root@mangodbserver1 src]# tar -zxvf mongo-1.6.16.tgz
  8. [root@mangodbserver1 src]# cd mongo-1.6.16/
  9. [root@mangodbserver1 mongo-1.6.16]# /usr/local/php-fpm/bin/phpize
  10. Configuring for:
  11. PHP Api Version:         20131106
  12. Zend Module Api No:      20131226
  13. Zend Extension Api No:   220131226
  15. [root@mangodbserver1 mongo-1.6.16]#  ./configure --with-php-config=/usr/local/php-fpm/bin/php-config
  16. checking for grep that handles long lines and -e... /usr/bin/grep
  17. checking for egrep... /usr/bin/grep -E
  18. checking for a sed that does not truncate output... /usr/bin/sed
  19. ...中间略...
  20. creating libtool
  21. appending configuration tag "CXX" to libtool
  22. configure: creating ./config.status
  23. config.status: creating config.h
  25. [root@mangodbserver1 mongo-1.6.16]# make && make install
  26. /bin/sh /usr/local/src/mongo-1.6.16/libtool --mode=compile cc -I./util -I. -I/usr/local/src/mongo-1.6.16 -DPHP_ATOM_INC -I/usr/local/src/mongo-1.6.16/include -I/usr/local/src/mongo-1.6.16/main -I/usr/local/src/mongo-1.6.16 -I/usr/local/php-fpm/include/php -I/usr/local/php-fpm/include/php/main -I/usr/local/php-fpm/include/php/TSRM -I/usr/local/php-fpm/include/php/Zend -I/usr/local/php-fpm/include/php/ext -I/usr/local/php-fpm/include/php/ext/date/lib -I/usr/local/src/mongo-1.6.16/api -I/usr/local/src/mongo-1.6.16/util -I/usr/local/src/mongo-1.6.16/exceptions -I/usr/local/src/mongo-1.6.16/gridfs -I/usr/local/src/mongo-1.6.16/types -I/usr/local/src/mongo-1.6.16/batch -I/usr/local/src/mongo-1.6.16/contrib -I/usr/local/src/mongo-1.6.16/mcon -I/usr/local/src/mongo-1.6.16/mcon/contrib  -DHAVE_CONFIG_H  -g -O2   -c /usr/local/src/mongo-1.6.16/php_mongo.c -o php_mongo.lo
  27. ...中间略...
  28. Build complete.
  29. Don't forget to run 'make test'.
  31. Installing shared extensions:     /usr/local/php-fpm/lib/php/extensions/no-debug-non-zts-20131226/
  33. [root@mangodbserver1 mongo-1.6.16]# vim /usr/local/php-fpm/etc/php.ini
  34. # 添加extension = mongo.so
  35. extension = mongo.so
  36. [root@mangodbserver1 mongo-1.6.16]# /usr/local/php-fpm/sbin/php-fpm -m | grep mon
  37. mongo
  38. mongodb
  39. [root@mangodbserver1 mongo-1.6.16]# /etc/init.d/php-fpm restart
  40. Gracefully shutting down php-fpm . done
  41. Starting php-fpm  done

测试mongo扩展

参考文档 https://docs.mongodb.com/ecosystem/drivers/php/

http://www.runoob.com/mongodb/mongodb-php.html

  1. # 新建测试页
  2. [root@mangodbserver1 mongo-1.6.16]# vim /usr/local/nginx/html/1.php
  3. <?php
  4. $m = new MongoClient();
  5. $db = $m->test;
  6. $collection = $db->createCollection("runoob");
  7. echo "集合创建成功";
  8. ?>
  10. [root@mangodbserver1 mongo-1.6.16]# curl localhost/1.php
  11. 集合创建成功[root@mangodbserver1 mongo-1.6.16]#

##三十一 mongodb副本集介绍

早期版本使用master-slave，一主一从和MySQL类似，但slave在此架构中为只读，当主库宕机后，从库不能自动切换为主

目前已经淘汰master-slave模式，改为副本集，这种模式下有一个主(primary)，和多个从(secondary)，只读。支持给它们设置权重，当主宕掉后，权重最高的从切换为主

在此架构中还可以建立一个仲裁(arbiter)的角色，它只负责裁决，而不存储数据

在此架构中读写数据都是在主上，要想实现负载均衡的目的需要手动指定读库的目标server

三十二 mongodb副本集搭建

环境：

三台机器 CentOS Linux release 7.5.1804 (Core)

mongodbserver1: 192.168.1.47

mongodbserver2: 192.168.1.48

mongodbserver3: 192.168.1.49

1.分别编辑三台server的配置文件

  1. net:
  2.   port: 27017
  3. # 增加绑定本机ip
  4.   bindIp: 127.0.0.1,192.168.1.49
  5. # 去掉注释，增加下两行内容
  6. replication:
  7.   oplogSizeMB: 20
  8.   replSetName: rs0
  10. [root@mongodbserver3 ~]# systemctl start mongod.service
  11. [root@mongodbserver3 ~]# netstat -nltup | grep mongo
  12. tcp        0      0 192.168.1.49:27017      0.0.0.0:*               LISTEN      2073/mongod
  13. tcp        0      0 127.0.0.1:27017         0.0.0.0:*               LISTEN      2073/mongod

2.初始化

  1. [root@mongodbserver1 ~]# mongo
  3. > config={_id:"rs0",members:[{_id:0,host:"192.168.1.47:27017"},{_id:1,host:"192.168.1.48:27017"},{_id:2,host:"192.168.1.49:27017"}]}
  4. {
  5.         "_id" : "rs0",
  6.         "members" : [
  7.                 {
  8.                         "_id" : 0,
  9.                         "host" : "192.168.1.47:27017"
  10.                 },
  11.                 {
  12.                         "_id" : 1,
  13.                         "host" : "192.168.1.48:27017"
  14.                 },
  15.                 {
  16.                         "_id" : 2,
  17.                         "host" : "192.168.1.49:27017"
  18.                 }
  19.         ]
  20. }
  21. > rs.initiate(config)
  22. {
  23.         "ok" : 1,
  24.         "operationTime" : Timestamp(1535293700, 1),
  25.         "$clusterTime" : {
  26.                 "clusterTime" : Timestamp(1535293700, 1),
  27.                 "signature" : {
  28.                         "hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="),
  29.                         "keyId" : NumberLong(0)
  30.                 }
  31.         }
  32. }
  34. rs0:PRIMARY> rs.status()
  35. {
  36.         "set" : "rs0",
  37.         "date" : ISODate("2018-08-26T14:31:21.930Z"),
  38.         "myState" : 1,
  39.         "term" : NumberLong(1),
  40.         "syncingTo" : "",
  41.         "syncSourceHost" : "",
  42.         "syncSourceId" : -1,
  43.         "heartbeatIntervalMillis" : NumberLong(2000),
  44.         "optimes" : {
  45.                 "lastCommittedOpTime" : {
  46.                         "ts" : Timestamp(1535293872, 1),
  47.                         "t" : NumberLong(1)
  48.                 },
  49.                 "readConcernMajorityOpTime" : {
  50.                         "ts" : Timestamp(1535293872, 1),
  51.                         "t" : NumberLong(1)
  52.                 },
  53.                 "appliedOpTime" : {
  54.                         "ts" : Timestamp(1535293872, 1),
  55.                         "t" : NumberLong(1)
  56.                 },
  57.                 "durableOpTime" : {
  58.                         "ts" : Timestamp(1535293872, 1),
  59.                         "t" : NumberLong(1)
  60.                 }
  61.         },
  62.         "lastStableCheckpointTimestamp" : Timestamp(1535293832, 1),
  63.         "members" : [
  64.                 {
  65.                         "_id" : 0,
  66.                         "name" : "192.168.1.47:27017",
  67.                         "health" : 1,
  68.                         "state" : 1,
  69.                         "stateStr" : "PRIMARY",
  70.                         "uptime" : 1166,
  71.                         "optime" : {
  72.                                 "ts" : Timestamp(1535293872, 1),
  73.                                 "t" : NumberLong(1)
  74.                         },
  75.                         "optimeDate" : ISODate("2018-08-26T14:31:12Z"),
  76.                         "syncingTo" : "",
  77.                         "syncSourceHost" : "",
  78.                         "syncSourceId" : -1,
  79.                         "infoMessage" : "",
  80.                         "electionTime" : Timestamp(1535293711, 1),
  81.                         "electionDate" : ISODate("2018-08-26T14:28:31Z"),
  82.                         "configVersion" : 1,
  83.                         "self" : true,
  84.                         "lastHeartbeatMessage" : ""
  85.                 },
  86.                 {
  87.                         "_id" : 1,
  88.                         "name" : "192.168.1.48:27017",
  89.                         "health" : 1,
  90.                         "state" : 2,
  91.                         "stateStr" : "SECONDARY",
  92.                         "uptime" : 181,
  93.                         "optime" : {
  94.                                 "ts" : Timestamp(1535293872, 1),
  95.                                 "t" : NumberLong(1)
  96.                         },
  97.                         "optimeDurable" : {
  98.                                 "ts" : Timestamp(1535293872, 1),
  99.                                 "t" : NumberLong(1)
  100.                         },
  101.                         "optimeDate" : ISODate("2018-08-26T14:31:12Z"),
  102.                         "optimeDurableDate" : ISODate("2018-08-26T14:31:12Z"),
  103.                         "lastHeartbeat" : ISODate("2018-08-26T14:31:21.381Z"),
  104.                         "lastHeartbeatRecv" : ISODate("2018-08-26T14:31:21.417Z"),
  105.                         "pingMs" : NumberLong(0),
  106.                         "lastHeartbeatMessage" : "",
  107.                         "syncingTo" : "192.168.1.47:27017",
  108.                         "syncSourceHost" : "192.168.1.47:27017",
  109.                         "syncSourceId" : 0,
  110.                         "infoMessage" : "",
  111.                         "configVersion" : 1
  112.                 },
  113.                 {
  114.                         "_id" : 2,
  115.                         "name" : "192.168.1.49:27017",
  116.                         "health" : 1,
  117.                         "state" : 2,
  118.                         "stateStr" : "SECONDARY",
  119.                         "uptime" : 181,
  120.                         "optime" : {
  121.                                 "ts" : Timestamp(1535293872, 1),
  122.                                 "t" : NumberLong(1)
  123.                         },
  124.                         "optimeDurable" : {
  125.                                 "ts" : Timestamp(1535293872, 1),
  126.                                 "t" : NumberLong(1)
  127.                         },
  128.                         "optimeDate" : ISODate("2018-08-26T14:31:12Z"),
  129.                         "optimeDurableDate" : ISODate("2018-08-26T14:31:12Z"),
  130.                         "lastHeartbeat" : ISODate("2018-08-26T14:31:21.381Z"),
  131.                         "lastHeartbeatRecv" : ISODate("2018-08-26T14:31:21.548Z"),
  132.                         "pingMs" : NumberLong(0),
  133.                         "lastHeartbeatMessage" : "",
  134.                         "syncingTo" : "192.168.1.47:27017",
  135.                         "syncSourceHost" : "192.168.1.47:27017",
  136.                         "syncSourceId" : 0,
  137.                         "infoMessage" : "",
  138.                         "configVersion" : 1
  139.                 }
  140.         ],
  141.         "ok" : 1,
  142.         "operationTime" : Timestamp(1535293872, 1),
  143.         "$clusterTime" : {
  144.                 "clusterTime" : Timestamp(1535293872, 1),
  145.                 "signature" : {
  146.                         "hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="),
  147.                         "keyId" : NumberLong(0)
  148.                 }
  149.         }
  150. }
  151. rs0:PRIMARY>

三十三 mongodb副本集测试

  1. # 主上操作
  2. rs0:PRIMARY> use mydb
  3. rs0:PRIMARY> use mydb
  4. switched to db mydb
  5. rs0:PRIMARY> db.acc.insert({AccountID:1,UserName:"123",password:"123456"})
  6. WriteResult({ "nInserted" : 1 })
  7. rs0:PRIMARY> show dbs
  8. admin   0.000GB
  9. config  0.000GB
  10. db1     0.000GB
  11. local   0.000GB
  12. mydb    0.000GB
  14. # 从上操作
  15. [root@mongodbserver2 ~]# mongo
  16. rs0:SECONDARY> show dbs
  17. 2018-08-26T22:45:06.594+0800 E QUERY    [js] Error: listDatabases failed:{
  18.         "operationTime" : Timestamp(1535294702, 1),
  19.         "ok" : 0,
  20.         "errmsg" : "not master and slaveOk=false",
  21.         "code" : 13435,
  22.         "codeName" : "NotMasterNoSlaveOk",
  23.         "$clusterTime" : {
  24.                 "clusterTime" : Timestamp(1535294702, 1),
  25.                 "signature" : {
  26.                         "hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="),
  27.                         "keyId" : NumberLong(0)
  28.                 }
  29.         }
  30. } :
  31. _getErrorWithCode@src/mongo/shell/utils.js:25:13
  32. Mongo.prototype.getDBs@src/mongo/shell/mongo.js:67:1
  33. shellHelper.show@src/mongo/shell/utils.js:876:19
  34. shellHelper@src/mongo/shell/utils.js:766:15
  35. @(shellhelp2):1:1
  36. rs0:SECONDARY> rs.slaveOk()
  37. rs0:SECONDARY>  show dbs
  38. admin   0.000GB
  39. config  0.000GB
  40. db1     0.000GB
  41. local   0.000GB
  42. mydb    0.000GB
  43. rs0:SECONDARY> use mydb
  44. switched to db mydb
  45. rs0:SECONDARY> show tables
  46. acc

副本集更改权重模拟主宕机

  1. # 查看当前三台主机的权重，初始权重都是1
  2. rs0:PRIMARY> rs.conf()
  3. {
  4.         "_id" : "rs0",
  5.         "version" : 1,
  6.         "protocolVersion" : NumberLong(1),
  7.         "writeConcernMajorityJournalDefault" : true,
  8.         "members" : [
  9.                 {
  10.                         "_id" : 0,
  11.                         "host" : "192.168.1.47:27017",
  12.                         "arbiterOnly" : false,
  13.                         "buildIndexes" : true,
  14.                         "hidden" : false,
  15.                         "priority" : 1,
  16.                         "tags" : {
  18.                         },
  19.                         "slaveDelay" : NumberLong(0),
  20.                         "votes" : 1
  21.                 },
  22.                 {
  23.                         "_id" : 1,
  24.                         "host" : "192.168.1.48:27017",
  25.                         "arbiterOnly" : false,
  26.                         "buildIndexes" : true,
  27.                         "hidden" : false,
  28.                         "priority" : 1,
  29.                         "tags" : {
  31.                         },
  32.                         "slaveDelay" : NumberLong(0),
  33.                         "votes" : 1
  34.                 },
  35.                 {
  36.                         "_id" : 2,
  37.                         "host" : "192.168.1.49:27017",
  38.                         "arbiterOnly" : false,
  39.                         "buildIndexes" : true,
  40.                         "hidden" : false,
  41.                         "priority" : 1,
  42.                         "tags" : {
  44.                         },
  45.                         "slaveDelay" : NumberLong(0),
  46.                         "votes" : 1
  47.                 }
  48.         ],
  49.         "settings" : {
  50.                 "chainingAllowed" : true,
  51.                 "heartbeatIntervalMillis" : 2000,
  52.                 "heartbeatTimeoutSecs" : 10,
  53.                 "electionTimeoutMillis" : 10000,
  54.                 "catchUpTimeoutMillis" : -1,
  55.                 "catchUpTakeoverDelayMillis" : 30000,
  56.                 "getLastErrorModes" : {
  58.                 },
  59.                 "getLastErrorDefaults" : {
  60.                         "w" : 1,
  61.                         "wtimeout" : 0
  62.                 },
  63.                 "replicaSetId" : ObjectId("5b82b904244cfb9393d33a63")
  64.         }
  65. }
  67. # 设置权重
  68. rs0:PRIMARY> cfg.members[0].priority = 3
  69. 3
  70. rs0:PRIMARY> cfg.members[1].priority = 2
  71. 2
  72. rs0:PRIMARY> cfg.members[2].priority = 1
  73. 1
  74. rs0:PRIMARY>  rs.reconfig(cfg)
  75. {
  76.         "ok" : 1,
  77.         "operationTime" : Timestamp(1535296028, 1),
  78.         "$clusterTime" : {
  79.                 "clusterTime" : Timestamp(1535296028, 1),
  80.                 "signature" : {
  81.                         "hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="),
  82.                         "keyId" : NumberLong(0)
  83.                 }
  84.         }
  85. }
  87. # 查看新的权重，第二个节点将会成为候选主节点。
  88. rs0:PRIMARY> rs.conf()
  89. {
  90.         "_id" : "rs0",
  91.         "version" : 2,
  92.         "protocolVersion" : NumberLong(1),
  93.         "writeConcernMajorityJournalDefault" : true,
  94.         "members" : [
  95.                 {
  96.                         "_id" : 0,
  97.                         "host" : "192.168.1.47:27017",
  98.                         "arbiterOnly" : false,
  99.                         "buildIndexes" : true,
  100.                         "hidden" : false,
  101.                         "priority" : 3,
  102.                         "tags" : {
  104.                         },
  105.                         "slaveDelay" : NumberLong(0),
  106.                         "votes" : 1
  107.                 },
  108.                 {
  109.                         "_id" : 1,
  110.                         "host" : "192.168.1.48:27017",
  111.                         "arbiterOnly" : false,
  112.                         "buildIndexes" : true,
  113.                         "hidden" : false,
  114.                         "priority" : 2,
  115.                         "tags" : {
  117.                         },
  118.                         "slaveDelay" : NumberLong(0),
  119.                         "votes" : 1
  120.                 },
  121.                 {
  122.                         "_id" : 2,
  123.                         "host" : "192.168.1.49:27017",
  124.                         "arbiterOnly" : false,
  125.                         "buildIndexes" : true,
  126.                         "hidden" : false,
  127.                         "priority" : 1,
  128.                         "tags" : {
  130.                         },
  131.                         "slaveDelay" : NumberLong(0),
  132.                         "votes" : 1
  133.                 }
  134.         ],
  135.         "settings" : {
  136.                 "chainingAllowed" : true,
  137.                 "heartbeatIntervalMillis" : 2000,
  138.                 "heartbeatTimeoutSecs" : 10,
  139.                 "electionTimeoutMillis" : 10000,
  140.                 "catchUpTimeoutMillis" : -1,
  141.                 "catchUpTakeoverDelayMillis" : 30000,
  142.                 "getLastErrorModes" : {
  144.                 },
  145.                 "getLastErrorDefaults" : {
  146.                         "w" : 1,
  147.                         "wtimeout" : 0
  148.                 },
  149.                 "replicaSetId" : ObjectId("5b82b904244cfb9393d33a63")
  150.         }
  151. }
  152. rs0:PRIMARY> 
  154. # 模拟主宕机，断开主的网卡
  155. # 在192.168.1.48上查看，之前的主192.168.1.47的状态："stateStr" : "(not reachable/healthy)",
  156. # 192.168.1.48已经变为主了。
  157. rs0:PRIMARY> rs.status()
  158. {
  159.         "set" : "rs0",
  160.         "date" : ISODate("2018-08-26T15:11:07.305Z"),
  161.         "myState" : 1,
  162.         "term" : NumberLong(2),
  163.         "syncingTo" : "",
  164.         "syncSourceHost" : "",
  165.         "syncSourceId" : -1,
  166.         "heartbeatIntervalMillis" : NumberLong(2000),
  167.         "optimes" : {
  168.                 "lastCommittedOpTime" : {
  169.                         "ts" : Timestamp(1535296259, 1),
  170.                         "t" : NumberLong(2)
  171.                 },
  172.                 "readConcernMajorityOpTime" : {
  173.                         "ts" : Timestamp(1535296259, 1),
  174.                         "t" : NumberLong(2)
  175.                 },
  176.                 "appliedOpTime" : {
  177.                         "ts" : Timestamp(1535296259, 1),
  178.                         "t" : NumberLong(2)
  179.                 },
  180.                 "durableOpTime" : {
  181.                         "ts" : Timestamp(1535296259, 1),
  182.                         "t" : NumberLong(2)
  183.                 }
  184.         },
  185.         "lastStableCheckpointTimestamp" : Timestamp(1535296229, 1),
  186.         "members" : [
  187.                 {
  188.                         "_id" : 0,
  189.                         "name" : "192.168.1.47:27017",
  190.                         "health" : 0,
  191.                         "state" : 8,
  192.                         "stateStr" : "(not reachable/healthy)",
  193.                         "uptime" : 0,
  194.                         "optime" : {
  195.                                 "ts" : Timestamp(0, 0),
  196.                                 "t" : NumberLong(-1)
  197.                         },
  198.                         "optimeDurable" : {
  199.                                 "ts" : Timestamp(0, 0),
  200.                                 "t" : NumberLong(-1)
  201.                         },
  202.                         "optimeDate" : ISODate("1970-01-01T00:00:00Z"),
  203.                         "optimeDurableDate" : ISODate("1970-01-01T00:00:00Z"),
  204.                         "lastHeartbeat" : ISODate("2018-08-26T15:11:04.624Z"),
  205.                         "lastHeartbeatRecv" : ISODate("2018-08-26T15:09:36.925Z"),
  206.                         "pingMs" : NumberLong(0),
  207.                         "lastHeartbeatMessage" : "Error connecting to 192.168.1.47:27017 :: caused by :: No route to host",
  208.                         "syncingTo" : "",
  209.                         "syncSourceHost" : "",
  210.                         "syncSourceId" : -1,
  211.                         "infoMessage" : "",
  212.                         "configVersion" : -1
  213.                 },
  214.                 {
  215.                         "_id" : 1,
  216.                         "name" : "192.168.1.48:27017",
  217.                         "health" : 1,
  218.                         "state" : 1,
  219.                         "stateStr" : "PRIMARY",
  220.                         "uptime" : 3505,
  221.                         "optime" : {
  222.                                 "ts" : Timestamp(1535296259, 1),
  223.                                 "t" : NumberLong(2)
  224.                         },
  225.                         "optimeDate" : ISODate("2018-08-26T15:10:59Z"),
  226.                         "syncingTo" : "",
  227.                         "syncSourceHost" : "",
  228.                         "syncSourceId" : -1,
  229.                         "infoMessage" : "",
  230.                         "electionTime" : Timestamp(1535296187, 1),
  231.                         "electionDate" : ISODate("2018-08-26T15:09:47Z"),
  232.                         "configVersion" : 2,
  233.                         "self" : true,
  234.                         "lastHeartbeatMessage" : ""
  235.                 },
  236.                 {
  237.                         "_id" : 2,
  238.                         "name" : "192.168.1.49:27017",
  239.                         "health" : 1,
  240.                         "state" : 2,
  241.                         "stateStr" : "SECONDARY",
  242.                         "uptime" : 2565,
  243.                         "optime" : {
  244.                                 "ts" : Timestamp(1535296259, 1),
  245.                                 "t" : NumberLong(2)
  246.                         },
  247.                         "optimeDurable" : {
  248.                                 "ts" : Timestamp(1535296259, 1),
  249.                                 "t" : NumberLong(2)
  250.                         },
  251.                         "optimeDate" : ISODate("2018-08-26T15:10:59Z"),
  252.                         "optimeDurableDate" : ISODate("2018-08-26T15:10:59Z"),
  253.                         "lastHeartbeat" : ISODate("2018-08-26T15:11:05.393Z"),
  254.                         "lastHeartbeatRecv" : ISODate("2018-08-26T15:11:07.196Z"),
  255.                         "pingMs" : NumberLong(0),
  256.                         "lastHeartbeatMessage" : "",
  257.                         "syncingTo" : "192.168.1.48:27017",
  258.                         "syncSourceHost" : "192.168.1.48:27017",
  259.                         "syncSourceId" : 1,
  260.                         "infoMessage" : "",
  261.                         "configVersion" : 2
  262.                 }
  263.         ],
  264.         "ok" : 1,
  265.         "operationTime" : Timestamp(1535296259, 1),
  266.         "$clusterTime" : {
  267.                 "clusterTime" : Timestamp(1535296259, 1),
  268.                 "signature" : {
  269.                         "hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="),
  270.                         "keyId" : NumberLong(0)
  271.                 }
  272.         }
  273. }
  274. rs0:PRIMARY> 
  276. # 将192.168.1.47重新连上网络，并查看状态，192.168.1.47又变为主了
  277. rs0:PRIMARY> rs.status()
  278. {
  279.         "set" : "rs0",
  280.         "date" : ISODate("2018-08-26T15:16:21.215Z"),
  281.         "myState" : 1,
  282.         "term" : NumberLong(3),
  283.         "syncingTo" : "",
  284.         "syncSourceHost" : "",
  285.         "syncSourceId" : -1,
  286.         "heartbeatIntervalMillis" : NumberLong(2000),
  287.         "optimes" : {
  288.                 "lastCommittedOpTime" : {
  289.                         "ts" : Timestamp(1535296574, 1),
  290.                         "t" : NumberLong(3)
  291.                 },
  292.                 "readConcernMajorityOpTime" : {
  293.                         "ts" : Timestamp(1535296574, 1),
  294.                         "t" : NumberLong(3)
  295.                 },
  296.                 "appliedOpTime" : {
  297.                         "ts" : Timestamp(1535296574, 1),
  298.                         "t" : NumberLong(3)
  299.                 },
  300.                 "durableOpTime" : {
  301.                         "ts" : Timestamp(1535296574, 1),
  302.                         "t" : NumberLong(3)
  303.                 }
  304.         },
  305.         "lastStableCheckpointTimestamp" : Timestamp(1535296534, 1),
  306.         "members" : [
  307.                 {
  308.                         "_id" : 0,
  309.                         "name" : "192.168.1.47:27017",
  310.                         "health" : 1,
  311.                         "state" : 1,
  312.                         "stateStr" : "PRIMARY",
  313.                         "uptime" : 3866,
  314.                         "optime" : {
  315.                                 "ts" : Timestamp(1535296574, 1),
  316.                                 "t" : NumberLong(3)
  317.                         },
  318.                         "optimeDate" : ISODate("2018-08-26T15:16:14Z"),
  319.                         "syncingTo" : "",
  320.                         "syncSourceHost" : "",
  321.                         "syncSourceId" : -1,
  322.                         "infoMessage" : "",
  323.                         "electionTime" : Timestamp(1535296432, 1),
  324.                         "electionDate" : ISODate("2018-08-26T15:13:52Z"),
  325.                         "configVersion" : 2,
  326.                         "self" : true,
  327.                         "lastHeartbeatMessage" : ""
  328.                 },
  329.                 {
  330.                         "_id" : 1,
  331.                         "name" : "192.168.1.48:27017",
  332.                         "health" : 1,
  333.                         "state" : 2,
  334.                         "stateStr" : "SECONDARY",
  335.                         "uptime" : 159,
  336.                         "optime" : {
  337.                                 "ts" : Timestamp(1535296574, 1),
  338.                                 "t" : NumberLong(3)
  339.                         },
  340.                         "optimeDurable" : {
  341.                                 "ts" : Timestamp(1535296574, 1),
  342.                                 "t" : NumberLong(3)
  343.                         },
  344.                         "optimeDate" : ISODate("2018-08-26T15:16:14Z"),
  345.                         "optimeDurableDate" : ISODate("2018-08-26T15:16:14Z"),
  346.                         "lastHeartbeat" : ISODate("2018-08-26T15:16:20.414Z"),
  347.                         "lastHeartbeatRecv" : ISODate("2018-08-26T15:16:19.382Z"),
  348.                         "pingMs" : NumberLong(0),
  349.                         "lastHeartbeatMessage" : "",
  350.                         "syncingTo" : "192.168.1.47:27017",
  351.                         "syncSourceHost" : "192.168.1.47:27017",
  352.                         "syncSourceId" : 0,
  353.                         "infoMessage" : "",
  354.                         "configVersion" : 2
  355.                 },
  356.                 {
  357.                         "_id" : 2,
  358.                         "name" : "192.168.1.49:27017",
  359.                         "health" : 1,
  360.                         "state" : 2,
  361.                         "stateStr" : "SECONDARY",
  362.                         "uptime" : 159,
  363.                         "optime" : {
  364.                                 "ts" : Timestamp(1535296574, 1),
  365.                                 "t" : NumberLong(3)
  366.                         },
  367.                         "optimeDurable" : {
  368.                                 "ts" : Timestamp(1535296574, 1),
  369.                                 "t" : NumberLong(3)
  370.                         },
  371.                         "optimeDate" : ISODate("2018-08-26T15:16:14Z"),
  372.                         "optimeDurableDate" : ISODate("2018-08-26T15:16:14Z"),
  373.                         "lastHeartbeat" : ISODate("2018-08-26T15:16:20.414Z"),
  374.                         "lastHeartbeatRecv" : ISODate("2018-08-26T15:16:21.156Z"),
  375.                         "pingMs" : NumberLong(0),
  376.                         "lastHeartbeatMessage" : "",
  377.                         "syncingTo" : "192.168.1.47:27017",
  378.                         "syncSourceHost" : "192.168.1.47:27017",
  379.                         "syncSourceId" : 0,
  380.                         "infoMessage" : "",
  381.                         "configVersion" : 2
  382.                 }
  383.         ],
  384.         "ok" : 1,
  385.         "operationTime" : Timestamp(1535296574, 1),
  386.         "$clusterTime" : {
  387.                 "clusterTime" : Timestamp(1535296574, 1),
  388.                 "signature" : {
  389.                         "hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="),
  390.                         "keyId" : NumberLong(0)
  391.                 }
  392.         }
  393. }
  394. rs0:PRIMARY>

三十四 mongodb分片介绍

分片就是将数据库进行拆分，将大型集合分隔到不同服务器上。比如，本来100G的数据，可以分割成10份存储到10台服务器上，这样每台机器只有10G的数据。

通过一个mongos的进程（路由）实现分片后的数据存储与访问，也就是说mongos是整个分片架构的核心，对客户端而言是不知道是否有分片的，客户端只需要把读写操作转达给mongos即可。

虽然分片会把数据分隔到很多台服务器上，但是每一个节点都是需要有一个备用角色的，这样能保证数据的高可用。

当系统需要更多空间或者资源的时候，分片可以让我们按需方便扩展，只需要把mongodb服务的机器加入到分片集群中即可

mongodb分片架构

mongos: 数据库集群请求的入口，所有的请求都通过mongos进行协调，不需要在应用程序添加一个路由选择器，mongos自己就是一个请求分发中心，它负责把对应的数据请求请求转发到对应的shard服务器上。在生产环境通常有多mongos作为请求的入口，防止其中一个挂掉所有的mongodb请求都没有办法操作。

config server: 配置服务器，存储所有数据库元信息（路由、分片）的配置。mongos本身没有物理存储分片服务器和数据路由信息，只是缓存在内存里，配置服务器则实际存储这些数据。mongos第一次启动或者关掉重启就会从 config server 加载配置信息，以后如果配置服务器信息变化会通知到所有的 mongos 更新自己的状态，这样 mongos 就能继续准确路由。在生产环境通常有多个 config server 配置服务器，因为它存储了分片路由的元数据，防止数据丢失！

shard: 存储了一个集合部分数据的MongoDB实例，每个分片是单独的mongodb服务或者副本集，在生产环境中，所有的分片都应该是副本集。

三十五 mongodb分片搭建

1.分片搭建 -服务器规划

  1. 三台机器 
  3. mongodbserver1: 192.168.1.47 mongos、config server、副本集1主节点、副本集2仲裁、副本集3从节点
  5. mongodbserver2: 192.168.1.48 mongos、config server、副本集1从节点、副本集2主节点、副本集3仲裁
  7. mongodbserver3: 192.168.1.49 mongos、config server、副本集1仲裁、副本集2从节点、副本集3
  9. 端口分配：mongos 20000、config 21000、副本集1 27001、副本集2 27002、副本集3 27003
  11. 三台机器全部关闭firewalld服务和selinux，或者增加对应端口的规则

2.分片搭建 – 创建目录

  1. # 分别在三台机器上创建各个角色所需要的目录
  2. # mkdir -p /data/mongodb/mongos/log
  3. # mkdir -p /data/mongodb/config/{data,log}
  4. # mkdir -p /data/mongodb/shard1/{data,log}
  5. # mkdir -p /data/mongodb/shard2/{data,log}
  6. # mkdir -p /data/mongodb/shard3/{data,log}
  8. [root@mongodbserver1 ~]# mkdir -p /data/mongodb/mongos/log
  9. [root@mongodbserver1 ~]# ls -ld !$
  10. ls -ld /data/mongodb/mongos/log
  11. drwxr-xr-x 2 root root 6 Aug 27 00:04 /data/mongodb/mongos/log
  12. [root@mongodbserver1 ~]# mkdir -p /data/mongodb/config/{data,log}
  13. [root@mongodbserver1 ~]#
  14. [root@mongodbserver1 ~]# ls -l /data/mongodb/config
  15. total 0
  16. drwxr-xr-x 2 root root 6 Aug 27 00:04 data
  17. drwxr-xr-x 2 root root 6 Aug 27 00:04 log
  18. [root@mongodbserver1 ~]# mkdir -p /data/mongodb/shard1/{data,log}
  19. [root@mongodbserver1 ~]# ls -l /data/mongodb/shard1
  20. total 0
  21. drwxr-xr-x 2 root root 6 Aug 27 00:05 data
  22. drwxr-xr-x 2 root root 6 Aug 27 00:05 log
  23. [root@mongodbserver1 ~]# mkdir -p /data/mongodb/shard2/{data,log}
  24. [root@mongodbserver1 ~]# mkdir -p /data/mongodb/shard3/{data,log}
  25. [root@mongodbserver1 ~]# ls -l /data/mongodb/shard2
  26. total 0
  27. drwxr-xr-x 2 root root 6 Aug 27 00:05 data
  28. drwxr-xr-x 2 root root 6 Aug 27 00:05 log
  29. [root@mongodbserver1 ~]# ls -l /data/mongodb/shard3
  30. total 0
  31. drwxr-xr-x 2 root root 6 Aug 27 00:06 data
  32. drwxr-xr-x 2 root root 6 Aug 27 00:06 log

3.config server配置

  1. # mongodb3.4版本以后需要对config server创建副本集
  2. # 添加配置文件(三台机器都操作)
  3. [root@mongodbserver3 ~]# mkdir /etc/mongod/
  4. [root@mongodbserver3 ~]#
  5. [root@mongodbserver3 ~]# vim /etc/mongod/config.conf
  6. # 内容如下，bind_ip可侦听所有端口，为安全考虑，也可以只侦听本机端口
  7. pidfilepath = /var/run/mongodb/configsrv.pid
  8. dbpath = /data/mongodb/config/data
  9. logpath = /data/mongodb/config/log/congigsrv.log
  10. logappend = true
  11. bind_ip = 0.0.0.0
  12. port = 21000
  13. fork = true
  14. configsvr = true #declare this is a config db of a cluster;
  15. replSet=configs #副本集名称
  16. maxConns=20000 #设置最大连接数
  18. # 启动config server
  19. [root@mongodbserver1 ~]# mongod -f /etc/mongod/config.conf
  20. 2018-08-27T00:13:47.546+0800 I CONTROL  [main] Automatically disabling TLS 1.0, to force-enable TLS 1.0 specify --sslDisabledProtocols 'none'
  21. about to fork child process, waiting until server is ready for connections.
  22. forked process: 41218
  23. child process started successfully, parent exiting
  25. # 登录任意一台机器的21000端口，初始化副本集
  26. [root@mongodbserver1 ~]# mongo --port 21000
  27. > config = { _id: "configs", members: [ {_id : 0, host : "192.168.1.47:21000"},{_id : 1, host : "192.168.1.48:21000"},{_id : 2, host : "192.168.1.49:21000"}] }
  28. {
  29.         "_id" : "configs",
  30.         "members" : [
  31.                 {
  32.                         "_id" : 0,
  33.                         "host" : "192.168.1.47:21000"
  34.                 },
  35.                 {
  36.                         "_id" : 1,
  37.                         "host" : "192.168.1.48:21000"
  38.                 },
  39.                 {
  40.                         "_id" : 2,
  41.                         "host" : "192.168.1.49:21000"
  42.                 }
  43.         ]
  44. }
  45. > rs.initiate(config)
  46. {
  47.         "ok" : 1,
  48.         "operationTime" : Timestamp(1535300396, 1),
  49.         "$gleStats" : {
  50.                 "lastOpTime" : Timestamp(1535300396, 1),
  51.                 "electionId" : ObjectId("000000000000000000000000")
  52.         },
  53.         "lastCommittedOpTime" : Timestamp(0, 0),
  54.         "$clusterTime" : {
  55.                 "clusterTime" : Timestamp(1535300396, 1),
  56.                 "signature" : {
  57.                         "hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="),
  58.                         "keyId" : NumberLong(0)
  59.                 }
  60.         }
  61. }
  62. configs:PRIMARY>

4.分片配置

  1. # mongodbserver1,mongodbserver2,mongodbserver3上分别新建如下配置文件
  2. [root@mongodbserver1 mongod]# cat /etc/mongod/shard1.conf
  3. pidfilepath = /var/run/mongodb/shard1.pid
  4. dbpath = /data/mongodb/shard1/data
  5. logpath = /data/mongodb/shard1/log/shard1.log
  6. logappend = true
  7. bind_ip = 0.0.0.0
  8. port = 27001
  9. fork = true
  10. oplogSize = 4096
  11. journal = true
  12. quiet = true
  13. replSet=shard1 #副本集名称
  14. shardsvr = true #declare this is a shard db of a cluster;
  15. maxConns=20000 #设置最大连接数
  17. [root@mongodbserver1 mongod]# cat /etc/mongod/shard2.conf
  18. pidfilepath = /var/run/mongodb/shard2.pid
  19. dbpath = /data/mongodb/shard2/data
  20. logpath = /data/mongodb/shard2/log/shard2.log
  21. logappend = true
  22. bind_ip = 0.0.0.0
  23. port = 27002
  24. fork = true
  25. oplogSize = 4096
  26. journal = true
  27. quiet = true
  28. replSet=shard2 #副本集名称
  29. shardsvr = true #declare this is a shard db of a cluster;
  30. maxConns=20000 #设置最大连接数
  31. [root@mongodbserver1 mongod]# cat /etc/mongod/shard3.conf
  32. pidfilepath = /var/run/mongodb/shard3.pid
  33. dbpath = /data/mongodb/shard3/data
  34. logpath = /data/mongodb/shard3/log/shard3.log
  35. logappend = true
  36. bind_ip = 0.0.0.0
  37. port = 27003
  38. fork = true
  39. oplogSize = 4096
  40. journal = true
  41. quiet = true
  42. replSet=shard3 #副本集名称
  43. shardsvr = true #declare this is a shard db of a cluster;
  44. maxConns=20000 #设置最大连接数
  46. [root@mongodbserver1 ~]# mongod -f /etc/mongod/shard1.conf
  47. 2018-08-27T09:45:20.879+0800 I CONTROL  [main] Automatically disabling TLS 1.0, to force-enable TLS 1.0 specify --sslDisabledProtocols 'none'
  48. about to fork child process, waiting until server is ready for connections.
  49. forked process: 46045
  50. child process started successfully, parent exiting
  52. [root@mongodbserver1 ~]# mongod -f /etc/mongod/shard2.conf
  53. 2018-08-27T09:45:20.879+0800 I CONTROL  [main] Automatically disabling TLS 1.0, to force-enable TLS 1.0 specify --sslDisabledProtocols 'none'
  54. about to fork child process, waiting until server is ready for connections.
  55. forked process: 46045
  56. child process started successfully, parent exiting
  58. [root@mongodbserver1 mongod]# mongod -f /etc/mongod/shard3.conf
  59. 2018-08-27T09:50:15.220+0800 I CONTROL  [main] Automatically disabling TLS 1.0, to force-enable TLS 1.0 specify --sslDisabledProtocols 'none'
  60. about to fork child process, waiting until server is ready for connections.
  61. forked process: 46162
  62. child process started successfully, parent exiting
  64. [root@mongodbserver1 mongod]# netstat -nltup | grep :27003
  65. tcp        0      0 0.0.0.0:27003           0.0.0.0:*               LISTEN      46162/mongod
  66. [root@mongodbserver1 mongod]# netstat -nltup | grep :27001
  67. tcp        0      0 0.0.0.0:27001           0.0.0.0:*               LISTEN      45946/mongod
  68. [root@mongodbserver1 mongod]# netstat -nltup | grep :27002
  69. tcp        0      0 0.0.0.0:27002           0.0.0.0:*               LISTEN      46045/mongod

4.副本集初始化

  1. # shard1副本集初始化
  2. # 登录192.168.1.47或者192.168.1.48中的任何一台机器的27001端口初始化副本集，192.168.1.49因为shard1中我们把这台机器的27001端口作为了仲裁节点
  3. [root@mongodbserver1 mongod]# mongo --port 27001
  4. MongoDB shell version v4.0.1
  5. connecting to: mongodb://127.0.0.1:27001/
  6. MongoDB server version: 4.0.1
  7. Server has startup warnings:
  8. 2018-08-27T09:37:06.874+0800 I CONTROL  [initandlisten]
  9. 2018-08-27T09:37:06.874+0800 I CONTROL  [initandlisten] ** WARNING: Access control is not enabled for the database.
  10. 2018-08-27T09:37:06.874+0800 I CONTROL  [initandlisten] **          Read and write access to data and configuration is unrestricted.
  11. 2018-08-27T09:37:06.874+0800 I CONTROL  [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended.
  12. 2018-08-27T09:37:06.874+0800 I CONTROL  [initandlisten]
  13. ---
  14. Enable MongoDB's free cloud-based monitoring service, which will then receive and display
  15. metrics about your deployment (disk utilization, CPU, operation statistics, etc).
  17. The monitoring data will be available on a MongoDB website with a unique URL accessible to you
  18. and anyone you share the URL with. MongoDB may use this information to make product
  19. improvements and to suggest MongoDB products and deployment options to you.
  21. To enable free monitoring, run the following command: db.enableFreeMonitoring()
  22. To permanently disable this reminder, run the following command: db.disableFreeMonitoring()
  23. ---
  25. > use admin
  26. switched to db admin
  27. > config = { _id: "shard1", members: [ {_id : 0, host : "192.168.1.47:27001"}, {_id: 1,host : "192.168.1.48:27001"},{_id : 2, host : "192.168.1.49:27001",arbiterOnly:true}] }
  28. {
  29.         "_id" : "shard1",
  30.         "members" : [
  31.                 {
  32.                         "_id" : 0,
  33.                         "host" : "192.168.1.47:27001"
  34.                 },
  35.                 {
  36.                         "_id" : 1,
  37.                         "host" : "192.168.1.48:27001"
  38.                 },
  39.                 {
  40.                         "_id" : 2,
  41.                         "host" : "192.168.1.49:27001",
  42.                         "arbiterOnly" : true
  43.                 }
  44.         ]
  45. }
  46. > rs.initiate(config)
  47. {
  48.         "ok" : 1,
  49.         "operationTime" : Timestamp(1535335745, 1),
  50.         "$clusterTime" : {
  51.                 "clusterTime" : Timestamp(1535335745, 1),
  52.                 "signature" : {
  53.                         "hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="),
  54.                         "keyId" : NumberLong(0)
  55.                 }
  56.         }
  57. }
  58. shard1:SECONDARY> rs.status()
  59. {
  60.         "set" : "shard1",
  61.         "date" : ISODate("2018-08-27T02:09:26.775Z"),
  62.         "myState" : 1,
  63.         "term" : NumberLong(1),
  64.         "syncingTo" : "",
  65.         "syncSourceHost" : "",
  66.         "syncSourceId" : -1,
  67.         "heartbeatIntervalMillis" : NumberLong(2000),
  68.         "optimes" : {
  69.                 "lastCommittedOpTime" : {
  70.                         "ts" : Timestamp(1535335758, 2),
  71.                         "t" : NumberLong(1)
  72.                 },
  73.                 "readConcernMajorityOpTime" : {
  74.                         "ts" : Timestamp(1535335758, 2),
  75.                         "t" : NumberLong(1)
  76.                 },
  77.                 "appliedOpTime" : {
  78.                         "ts" : Timestamp(1535335758, 2),
  79.                         "t" : NumberLong(1)
  80.                 },
  81.                 "durableOpTime" : {
  82.                         "ts" : Timestamp(1535335758, 2),
  83.                         "t" : NumberLong(1)
  84.                 }
  85.         },
  86.         "lastStableCheckpointTimestamp" : Timestamp(1535335758, 1),
  87.         "members" : [
  88.                 {
  89.                         "_id" : 0,
  90.                         "name" : "192.168.1.47:27001",
  91.                         "health" : 1,
  92.                         "state" : 1,
  93.                         "stateStr" : "PRIMARY",
  94.                         "uptime" : 1940,
  95.                         "optime" : {
  96.                                 "ts" : Timestamp(1535335758, 2),
  97.                                 "t" : NumberLong(1)
  98.                         },
  99.                         "optimeDate" : ISODate("2018-08-27T02:09:18Z"),
  100.                         "syncingTo" : "",
  101.                         "syncSourceHost" : "",
  102.                         "syncSourceId" : -1,
  103.                         "infoMessage" : "could not find member to sync from",
  104.                         "electionTime" : Timestamp(1535335756, 1),
  105.                         "electionDate" : ISODate("2018-08-27T02:09:16Z"),
  106.                         "configVersion" : 1,
  107.                         "self" : true,
  108.                         "lastHeartbeatMessage" : ""
  109.                 },
  110.                 {
  111.                         "_id" : 1,
  112.                         "name" : "192.168.1.48:27001",
  113.                         "health" : 1,
  114.                         "state" : 2,
  115.                         "stateStr" : "SECONDARY",
  116.                         "uptime" : 20,
  117.                         "optime" : {
  118.                                 "ts" : Timestamp(1535335758, 2),
  119.                                 "t" : NumberLong(1)
  120.                         },
  121.                         "optimeDurable" : {
  122.                                 "ts" : Timestamp(1535335758, 2),
  123.                                 "t" : NumberLong(1)
  124.                         },
  125.                         "optimeDate" : ISODate("2018-08-27T02:09:18Z"),
  126.                         "optimeDurableDate" : ISODate("2018-08-27T02:09:18Z"),
  127.                         "lastHeartbeat" : ISODate("2018-08-27T02:09:26.532Z"),
  128.                         "lastHeartbeatRecv" : ISODate("2018-08-27T02:09:25.106Z"),
  129.                         "pingMs" : NumberLong(0),
  130.                         "lastHeartbeatMessage" : "",
  131.                         "syncingTo" : "192.168.1.47:27001",
  132.                         "syncSourceHost" : "192.168.1.47:27001",
  133.                         "syncSourceId" : 0,
  134.                         "infoMessage" : "",
  135.                         "configVersion" : 1
  136.                 },
  137.                 {
  138.                         "_id" : 2,
  139.                         "name" : "192.168.1.49:27001",
  140.                         "health" : 1,
  141.                         "state" : 7,
  142.                         "stateStr" : "ARBITER",
  143.                         "uptime" : 20,
  144.                         "lastHeartbeat" : ISODate("2018-08-27T02:09:26.531Z"),
  145.                         "lastHeartbeatRecv" : ISODate("2018-08-27T02:09:25.865Z"),
  146.                         "pingMs" : NumberLong(0),
  147.                         "lastHeartbeatMessage" : "",
  148.                         "syncingTo" : "",
  149.                         "syncSourceHost" : "",
  150.                         "syncSourceId" : -1,
  151.                         "infoMessage" : "",
  152.                         "configVersion" : 1
  153.                 }
  154.         ],
  155.         "ok" : 1,
  156.         "operationTime" : Timestamp(1535335758, 2),
  157.         "$clusterTime" : {
  158.                 "clusterTime" : Timestamp(1535335758, 2),
  159.                 "signature" : {
  160.                         "hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="),
  161.                         "keyId" : NumberLong(0)
  162.                 }
  163.         }
  164. }
  165. shard1:PRIMARY> 
  167. # shard2副本集初始化
  168. # 登录192.168.1.48或者192.168.1.49中的任何一台机器的27002端口初始化副本集，192.168.1.47因为shard2中我们把这台机器的27002端口作为了仲裁节点
  169. # rs.remove("192.168.1.49:27002");  删除节点
  170. # rs.add({_id: 2, host: "192.168.1.49:27002"})
  171. # rs.add({_id: 2, host: "192.168.1.47:27002"，arbiterOnly:true})
  172. [root@mongodbserver2 ~]# mongo --port 27002
  173. >config = { _id: "shard2", members: [ {_id : 0, host : "192.168.1.47:27002" ,arbiterOnly:true},{_id : 1, host : "192.168.1.48:27002"},{_id : 2, host : "192.168.1.49:27002"}] }
  174. >rs.reinitiate(config)
  176. # shard3副本集初始化
  177. # 登录192.168.1.47或者192.168.1.49中的任何一台机器的27003端口初始化副本集，192.168.1.48因为shard3中我们把这台机器的27002端口作为了仲裁节点
  178. [root@mongodbserver3 ~]# mongo --port 27003
  179. > use admin
  180. switched to db admin
  181. > config = { _id: "shard3", members: [ {_id : 0, host : "192.168.1.47:27003"},  {_id : 1, host : "192.168.1.48:27003", arbiterOnly:true}, {_id : 2, host : "192.168.1.49:27003"}] }
  182. {
  183.         "_id" : "shard3",
  184.         "members" : [
  185.                 {
  186.                         "_id" : 0,
  187.                         "host" : "192.168.1.47:27003"
  188.                 },
  189.                 {
  190.                         "_id" : 1,
  191.                         "host" : "192.168.1.48:27003",
  192.                         "arbiterOnly" : true
  193.                 },
  194.                 {
  195.                         "_id" : 2,
  196.                         "host" : "192.168.1.49:27003"
  197.                 }
  198.         ]
  199. }
  200. > rs.initiate(config)
  201. {
  202.         "ok" : 1,
  203.         "operationTime" : Timestamp(1535338725, 1),
  204.         "$clusterTime" : {
  205.                 "clusterTime" : Timestamp(1535338725, 1),
  206.                 "signature" : {
  207.                         "hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="),
  208.                         "keyId" : NumberLong(0)
  209.                 }
  210.         }
  211. }
  212. shard3:PRIMARY> rs.status()
  213. {
  214.         "set" : "shard3",
  215.         "date" : ISODate("2018-08-27T02:59:59.805Z"),
  216.         "myState" : 1,
  217.         "term" : NumberLong(1),
  218.         "syncingTo" : "",
  219.         "syncSourceHost" : "",
  220.         "syncSourceId" : -1,
  221.         "heartbeatIntervalMillis" : NumberLong(2000),
  222.         "optimes" : {
  223.                 "lastCommittedOpTime" : {
  224.                         "ts" : Timestamp(1535338797, 1),
  225.                         "t" : NumberLong(1)
  226.                 },
  227.                 "readConcernMajorityOpTime" : {
  228.                         "ts" : Timestamp(1535338797, 1),
  229.                         "t" : NumberLong(1)
  230.                 },
  231.                 "appliedOpTime" : {
  232.                         "ts" : Timestamp(1535338797, 1),
  233.                         "t" : NumberLong(1)
  234.                 },
  235.                 "durableOpTime" : {
  236.                         "ts" : Timestamp(1535338797, 1),
  237.                         "t" : NumberLong(1)
  238.                 }
  239.         },
  240.         "lastStableCheckpointTimestamp" : Timestamp(1535338797, 1),
  241.         "members" : [
  242.                 {
  243.                         "_id" : 0,
  244.                         "name" : "192.168.1.47:27003",
  245.                         "health" : 1,
  246.                         "state" : 2,
  247.                         "stateStr" : "SECONDARY",
  248.                         "uptime" : 74,
  249.                         "optime" : {
  250.                                 "ts" : Timestamp(1535338797, 1),
  251.                                 "t" : NumberLong(1)
  252.                         },
  253.                         "optimeDurable" : {
  254.                                 "ts" : Timestamp(1535338797, 1),
  255.                                 "t" : NumberLong(1)
  256.                         },
  257.                         "optimeDate" : ISODate("2018-08-27T02:59:57Z"),
  258.                         "optimeDurableDate" : ISODate("2018-08-27T02:59:57Z"),
  259.                         "lastHeartbeat" : ISODate("2018-08-27T02:59:57.821Z"),
  260.                         "lastHeartbeatRecv" : ISODate("2018-08-27T02:59:58.287Z"),
  261.                         "pingMs" : NumberLong(0),
  262.                         "lastHeartbeatMessage" : "",
  263.                         "syncingTo" : "192.168.1.49:27003",
  264.                         "syncSourceHost" : "192.168.1.49:27003",
  265.                         "syncSourceId" : 2,
  266.                         "infoMessage" : "",
  267.                         "configVersion" : 1
  268.                 },
  269.                 {
  270.                         "_id" : 1,
  271.                         "name" : "192.168.1.48:27003",
  272.                         "health" : 1,
  273.                         "state" : 7,
  274.                         "stateStr" : "ARBITER",
  275.                         "uptime" : 74,
  276.                         "lastHeartbeat" : ISODate("2018-08-27T02:59:57.821Z"),
  277.                         "lastHeartbeatRecv" : ISODate("2018-08-27T02:59:59.384Z"),
  278.                         "pingMs" : NumberLong(0),
  279.                         "lastHeartbeatMessage" : "",
  280.                         "syncingTo" : "",
  281.                         "syncSourceHost" : "",
  282.                         "syncSourceId" : -1,
  283.                         "infoMessage" : "",
  284.                         "configVersion" : 1
  285.                 },
  286.                 {
  287.                         "_id" : 2,
  288.                         "name" : "192.168.1.49:27003",
  289.                         "health" : 1,
  290.                         "state" : 1,
  291.                         "stateStr" : "PRIMARY",
  292.                         "uptime" : 4185,
  293.                         "optime" : {
  294.                                 "ts" : Timestamp(1535338797, 1),
  295.                                 "t" : NumberLong(1)
  296.                         },
  297.                         "optimeDate" : ISODate("2018-08-27T02:59:57Z"),
  298.                         "syncingTo" : "",
  299.                         "syncSourceHost" : "",
  300.                         "syncSourceId" : -1,
  301.                         "infoMessage" : "could not find member to sync from",
  302.                         "electionTime" : Timestamp(1535338735, 1),
  303.                         "electionDate" : ISODate("2018-08-27T02:58:55Z"),
  304.                         "configVersion" : 1,
  305.                         "self" : true,
  306.                         "lastHeartbeatMessage" : ""
  307.                 }
  308.         ],
  309.         "ok" : 1,
  310.         "operationTime" : Timestamp(1535338797, 1),
  311.         "$clusterTime" : {
  312.                 "clusterTime" : Timestamp(1535338797, 1),
  313.                 "signature" : {
  314.                         "hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="),
  315.                         "keyId" : NumberLong(0)
  316.                 }
  317.         }
  318. }

5.配置路由服务器

  1. bye
  2. [root@mongodbserver2 ~]# vim /etc/mongod/mongos.conf
  3. pidfilepath = /var/run/mongodb/mongos.pid
  4. logpath = /data/mongodb/mongos/log/mongos.log
  5. logappend = true
  6. bind_ip = 0.0.0.0
  7. port = 20000
  8. fork = true
  9. configdb = configs/192.168.1.47:21000, 192.168.1.48:21000, 192.168.1.49:21000 #监听的配置服务器,只能有1个或者3个>
  10. ，configs为配置服务器的副本集名字
  11. maxConns=20000 #设置最大连接数
  13. "/etc/mongod/mongos.conf" [New] 8L, 360C written
  14. [root@mongodbserver2 ~]# mongos -f /etc/mongod/mongos.conf
  15. 2018-08-27T11:05:04.093+0800 I CONTROL  [main] Automatically disabling TLS 1.0, to force-enable TLS 1.0 specify --sslDisabledProtocols 'none'
  16. 2018-08-27T11:05:04.254+0800 I NETWORK  [main] getaddrinfo(" 192.168.1.48") failed: Name or service not known
  17. 2018-08-27T11:05:04.305+0800 I NETWORK  [main] getaddrinfo(" 192.168.1.49") failed: Name or service not known
  18. about to fork child process, waiting until server is ready for connections.
  19. forked process: 4238
  20. child process started successfully, parent exiting
  21. [root@mongodbserver2 ~]#

6.启用分片

  1. mongos> sh.addShard("shard1/192.168.1.47:27001,192.168.1.48:27001,192.168.1.49:27001")
  2. {
  3.         "shardAdded" : "shard1",
  4.         "ok" : 1,
  5.         "operationTime" : Timestamp(1535339410, 3),
  6.         "$clusterTime" : {
  7.                 "clusterTime" : Timestamp(1535339410, 3),
  8.                 "signature" : {
  9.                         "hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="),
  10.                         "keyId" : NumberLong(0)
  11.                 }
  12.         }
  13. }
  15. # 192.168.1.49初始化的时候角色弄错了，删掉了
  16. mongos> sh.addShard("shard2/192.168.1.47:27002,192.168.1.48:27002")
  17. {
  18.         "shardAdded" : "shard2",
  19.         "ok" : 1,
  20.         "operationTime" : Timestamp(1535339580, 9),
  21.         "$clusterTime" : {
  22.                 "clusterTime" : Timestamp(1535339580, 9),
  23.                 "signature" : {
  24.                         "hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="),
  25.                         "keyId" : NumberLong(0)
  26.                 }
  27.         }
  28. }
  30. mongos> sh.addShard("shard3/192.168.1.47:27003,192.168.1.48:27003,192.168.1.49:27003")
  31. {
  32.         "shardAdded" : "shard3",
  33.         "ok" : 1,
  34.         "operationTime" : Timestamp(1535339462, 5),
  35.         "$clusterTime" : {
  36.                 "clusterTime" : Timestamp(1535339462, 5),
  37.                 "signature" : {
  38.                         "hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="),
  39.                         "keyId" : NumberLong(0)
  40.                 }
  41.         }
  42. }
  44. mongos>  sh.status()
  45. --- Sharding Status ---
  46.   sharding version: {
  47.         "_id" : 1,
  48.         "minCompatibleVersion" : 5,
  49.         "currentVersion" : 6,
  50.         "clusterId" : ObjectId("5b82d3380925dce6faaca18a")
  51.   }
  52.   shards:
  53.         {  "_id" : "shard1",  "host" : "shard1/192.168.1.47:27001,192.168.1.48:27001",  "state" : 1 }
  54.         {  "_id" : "shard2",  "host" : "shard2/192.168.1.48:27002",  "state" : 1 }
  55.         {  "_id" : "shard3",  "host" : "shard3/192.168.1.47:27003,192.168.1.49:27003",  "state" : 1 }
  56.   active mongoses:
  57.         "4.0.1" : 3
  58.   autosplit:
  59.         Currently enabled: yes
  60.   balancer:
  61.         Currently enabled:  yes
  62.         Currently running:  no
  63.         Failed balancer rounds in last 5 attempts:  0
  64.         Migration Results for the last 24 hours:
  65.                 No recent migrations
  66.   databases:
  67.         {  "_id" : "config",  "primary" : "config",  "partitioned" : true }
  68.                 config.system.sessions
  69.                         shard key: { "_id" : 1 }
  70.                         unique: false
  71.                         balancing: true
  72.                         chunks:
  73.                                 shard1  1
  74.                         { "_id" : { "$minKey" : 1 } } -->> { "_id" : { "$maxKey" : 1 } } on : shard1 Timestamp(1, 0) 
  76. mongos>

三十六 mongodb分片测试

  1. [root@mongodbserver1 mongod]# mongo --port 20000
  2. MongoDB shell version v4.0.1
  3. connecting to: mongodb://127.0.0.1:20000/
  4. MongoDB server version: 4.0.1
  5. Server has startup warnings:
  6. 2018-08-27T11:05:03.697+0800 I CONTROL  [main]
  7. 2018-08-27T11:05:03.697+0800 I CONTROL  [main] ** WARNING: Access control is not enabled for the database.
  8. 2018-08-27T11:05:03.697+0800 I CONTROL  [main] **          Read and write access to data and configuration is unrestricted.
  9. 2018-08-27T11:05:03.697+0800 I CONTROL  [main] ** WARNING: You are running this process as the root user, which is not recommended.
  10. 2018-08-27T11:05:03.697+0800 I CONTROL  [main]
  11. mongos> use admin
  12. switched to db admin
  13. mongos> db.runCommand({ enablesharding : "testdb"})
  14. {
  15.         "ok" : 1,
  16.         "operationTime" : Timestamp(1535339870, 5),
  17.         "$clusterTime" : {
  18.                 "clusterTime" : Timestamp(1535339870, 5),
  19.                 "signature" : {
  20.                         "hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="),
  21.                         "keyId" : NumberLong(0)
  22.                 }
  23.         }
  24. }
  25. mongos> db.runCommand( { shardcollection : "testdb.table1",key : {id: 1} } )
  26. {
  27.         "collectionsharded" : "testdb.table1",
  28.         "collectionUUID" : UUID("733c1dad-cb4e-4ed3-a3ca-c3cfbec2e30e"),
  29.         "ok" : 1,
  30.         "operationTime" : Timestamp(1535339897, 16),
  31.         "$clusterTime" : {
  32.                 "clusterTime" : Timestamp(1535339897, 16),
  33.                 "signature" : {
  34.                         "hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="),
  35.                         "keyId" : NumberLong(0)
  36.                 }
  37.         }
  38. }
  39. mongos> use  testdb
  40. switched to db testdb
  41. mongos> for (var i = 1; i <= 10000; i++) db.table1.save({id:i,"test1":"testval1"})
  42. WriteResult({ "nInserted" : 1 })
  43. mongos> db.table1.stats()
  44. {
  45.         "sharded" : true,
  46.         "capped" : false,
  47.         "wiredTiger" : {
  48.                 "metadata" : {
  49.                         "formatVersion" : 1
  50.                 },
  51.                 "creationString" : "access_pattern_hint=none,allocation_size=4KB,app_metadata=(formatVersion=1),assert=(commit_timestamp=none,read_timestamp=none),block_allocation=best,block_compressor=snappy,cache_resident=false,checksum=on,colgroups=,collator=,columns=,dictionary=0,encryption=(keyid=,name=),exclusive=false,extractor=,format=btree,huffman_key=,huffman_value=,ignore_in_memory_cache_size=false,immutable=false,internal_item_max=0,internal_key_max=0,internal_key_truncate=true,internal_page_max=4KB,key_format=q,key_gap=10,leaf_item_max=0,leaf_key_max=0,leaf_page_max=32KB,leaf_value_max=64MB,log=(enabled=false),lsm=(auto_throttle=true,bloom=true,bloom_bit_count=16,bloom_config=,bloom_hash_count=8,bloom_oldest=false,chunk_count_limit=0,chunk_max=5GB,chunk_size=10MB,merge_custom=(prefix=,start_generation=0,suffix=),merge_max=15,merge_min=0),memory_page_max=10m,os_cache_dirty_max=0,os_cache_max=0,prefix_compression=false,prefix_compression_min=4,source=,split_deepen_min_child=0,split_deepen_per_child=0,split_pct=90,type=file,value_format=u",
  52.                 "type" : "file",
  53.                 "uri" : "statistics:table:collection-24--8506913186853910022",
  54.                 "LSM" : {
  55.                         "bloom filter false positives" : 0,
  56.                         "bloom filter hits" : 0,
  57.                         "bloom filter misses" : 0,
  58.                         "bloom filter pages evicted from cache" : 0,
  59.                         "bloom filter pages read into cache" : 0,
  60.                         "bloom filters in the LSM tree" : 0,
  61.                         "chunks in the LSM tree" : 0,
  62.                         "highest merge generation in the LSM tree" : 0,
  63.                         "queries that could have benefited from a Bloom filter that did not exist" : 0,
  64.                         "sleep for LSM checkpoint throttle" : 0,
  65.                         "sleep for LSM merge throttle" : 0,
  66.                         "total size of bloom filters" : 0
  67.                 },
  68.                 "block-manager" : {
  69.                         "allocations requiring file extension" : 21,
  70.                         "blocks allocated" : 21,
  71.                         "blocks freed" : 0,
  72.                         "checkpoint size" : 155648,
  73.                         "file allocation unit size" : 4096,
  74.                         "file bytes available for reuse" : 0,
  75.                         "file magic number" : 120897,
  76.                         "file major version number" : 1,
  77.                         "file size in bytes" : 167936,
  78.                         "minor version number" : 0
  79.                 },
  80.                 "btree" : {
  81.                         "btree checkpoint generation" : 91,
  82.                         "column-store fixed-size leaf pages" : 0,
  83.                         "column-store internal pages" : 0,
  84.                         "column-store variable-size RLE encoded values" : 0,
  85.                         "column-store variable-size deleted values" : 0,
  86.                         "column-store variable-size leaf pages" : 0,
  87.                         "fixed-record size" : 0,
  88.                         "maximum internal page key size" : 368,
  89.                         "maximum internal page size" : 4096,
  90.                         "maximum leaf page key size" : 2867,
  91.                         "maximum leaf page size" : 32768,
  92.                         "maximum leaf page value size" : 67108864,
  93.                         "maximum tree depth" : 3,
  94.                         "number of key/value pairs" : 0,
  95.                         "overflow pages" : 0,
  96.                         "pages rewritten by compaction" : 0,
  97.                         "row-store internal pages" : 0,
  98.                         "row-store leaf pages" : 0
  99.                 },
  100.                 "cache" : {
  101.                         "bytes currently in the cache" : 1349553,
  102.                         "bytes read into cache" : 0,
  103.                         "bytes written from cache" : 530298,
  104.                         "checkpoint blocked page eviction" : 0,
  105.                         "data source pages selected for eviction unable to be evicted" : 0,
  106.                         "eviction walk passes of a file" : 0,
  107.                         "eviction walk target pages histogram - 0-9" : 0,
  108.                         "eviction walk target pages histogram - 10-31" : 0,
  109.                         "eviction walk target pages histogram - 128 and higher" : 0,
  110.                         "eviction walk target pages histogram - 32-63" : 0,
  111.                         "eviction walk target pages histogram - 64-128" : 0,
  112.                         "eviction walks abandoned" : 0,
  113.                         "eviction walks gave up because they restarted their walk twice" : 0,
  114.                         "eviction walks gave up because they saw too many pages and found no candidates" : 0,
  115.                         "eviction walks gave up because they saw too many pages and found too few candidates" : 0,
  116.                         "eviction walks reached end of tree" : 0,
  117.                         "eviction walks started from root of tree" : 0,
  118.                         "eviction walks started from saved location in tree" : 0,
  119.                         "hazard pointer blocked page eviction" : 0,
  120.                         "in-memory page passed criteria to be split" : 0,
  121.                         "in-memory page splits" : 0,
  122.                         "internal pages evicted" : 0,
  123.                         "internal pages split during eviction" : 0,
  124.                         "leaf pages split during eviction" : 0,
  125.                         "modified pages evicted" : 0,
  126.                         "overflow pages read into cache" : 0,
  127.                         "page split during eviction deepened the tree" : 0,
  128.                         "page written requiring lookaside records" : 0,
  129.                         "pages read into cache" : 0,
  130.                         "pages read into cache after truncate" : 1,
  131.                         "pages read into cache after truncate in prepare state" : 0,
  132.                         "pages read into cache requiring lookaside entries" : 0,
  133.                         "pages requested from the cache" : 10000,
  134.                         "pages seen by eviction walk" : 0,
  135.                         "pages written from cache" : 20,
  136.                         "pages written requiring in-memory restoration" : 0,
  137.                         "tracked dirty bytes in the cache" : 1349094,
  138.                         "unmodified pages evicted" : 0
  139.                 },
  140.                 "cache_walk" : {
  141.                         "Average difference between current eviction generation when the page was last considered" : 0,
  142.                         "Average on-disk page image size seen" : 0,
  143.                         "Average time in cache for pages that have been visited by the eviction server" : 0,
  144.                         "Average time in cache for pages that have not been visited by the eviction server" : 0,
  145.                         "Clean pages currently in cache" : 0,
  146.                         "Current eviction generation" : 0,
  147.                         "Dirty pages currently in cache" : 0,
  148.                         "Entries in the root page" : 0,
  149.                         "Internal pages currently in cache" : 0,
  150.                         "Leaf pages currently in cache" : 0,
  151.                         "Maximum difference between current eviction generation when the page was last considered" : 0,
  152.                         "Maximum page size seen" : 0,
  153.                         "Minimum on-disk page image size seen" : 0,
  154.                         "Number of pages never visited by eviction server" : 0,
  155.                         "On-disk page image sizes smaller than a single allocation unit" : 0,
  156.                         "Pages created in memory and never written" : 0,
  157.                         "Pages currently queued for eviction" : 0,
  158.                         "Pages that could not be queued for eviction" : 0,
  159.                         "Refs skipped during cache traversal" : 0,
  160.                         "Size of the root page" : 0,
  161.                         "Total number of pages currently in cache" : 0
  162.                 },
  163.                 "compression" : {
  164.                         "compressed pages read" : 0,
  165.                         "compressed pages written" : 19,
  166.                         "page written failed to compress" : 0,
  167.                         "page written was too small to compress" : 1,
  168.                         "raw compression call failed, additional data available" : 0,
  169.                         "raw compression call failed, no additional data available" : 0,
  170.                         "raw compression call succeeded" : 0
  171.                 },
  172.                 "cursor" : {
  173.                         "bulk-loaded cursor-insert calls" : 0,
  174.                         "create calls" : 5,
  175.                         "cursor operation restarted" : 0,
  176.                         "cursor-insert key and value bytes inserted" : 561426,
  177.                         "cursor-remove key bytes removed" : 0,
  178.                         "cursor-update value bytes updated" : 0,
  179.                         "cursors cached on close" : 0,
  180.                         "cursors reused from cache" : 9996,
  181.                         "insert calls" : 10000,
  182.                         "modify calls" : 0,
  183.                         "next calls" : 1,
  184.                         "prev calls" : 1,
  185.                         "remove calls" : 0,
  186.                         "reserve calls" : 0,
  187.                         "reset calls" : 20003,
  188.                         "search calls" : 0,
  189.                         "search near calls" : 0,
  190.                         "truncate calls" : 0,
  191.                         "update calls" : 0
  192.                 },
  193.                 "reconciliation" : {
  194.                         "dictionary matches" : 0,
  195.                         "fast-path pages deleted" : 0,
  196.                         "internal page key bytes discarded using suffix compression" : 36,
  197.                         "internal page multi-block writes" : 0,
  198.                         "internal-page overflow keys" : 0,
  199.                         "leaf page key bytes discarded using prefix compression" : 0,
  200.                         "leaf page multi-block writes" : 1,
  201.                         "leaf-page overflow keys" : 0,
  202.                         "maximum blocks required for a page" : 1,
  203.                         "overflow values written" : 0,
  204.                         "page checksum matches" : 0,
  205.                         "page reconciliation calls" : 2,
  206.                         "page reconciliation calls for eviction" : 0,
  207.                         "pages deleted" : 0
  208.                 },
  209.                 "session" : {
  210.                         "cached cursor count" : 5,
  211.                         "object compaction" : 0,
  212.                         "open cursor count" : 0
  213.                 },
  214.                 "transaction" : {
  215.                         "update conflicts" : 0
  216.                 }
  217.         },
  218.         "ns" : "testdb.table1",
  219.         "count" : 10000,
  220.         "size" : 540000,
  221.         "storageSize" : 167936,
  222.         "totalIndexSize" : 208896,
  223.         "indexSizes" : {
  224.                 "_id_" : 94208,
  225.                 "id_1" : 114688
  226.         },
  227.         "avgObjSize" : 54,
  228.         "maxSize" : NumberLong(0),
  229.         "nindexes" : 2,
  230.         "nchunks" : 1,
  231.         "shards" : {
  232.                 "shard3" : {
  233.                         "ns" : "testdb.table1",
  234.                         "size" : 540000,
  235.                         "count" : 10000,
  236.                         "avgObjSize" : 54,
  237.                         "storageSize" : 167936,
  238.                         "capped" : false,
  239.                         "wiredTiger" : {
  240.                                 "metadata" : {
  241.                                         "formatVersion" : 1
  242.                                 },
  243.                                 "creationString" : "access_pattern_hint=none,allocation_size=4KB,app_metadata=(formatVersion=1),assert=(commit_timestamp=none,read_timestamp=none),block_allocation=best,block_compressor=snappy,cache_resident=false,checksum=on,colgroups=,collator=,columns=,dictionary=0,encryption=(keyid=,name=),exclusive=false,extractor=,format=btree,huffman_key=,huffman_value=,ignore_in_memory_cache_size=false,immutable=false,internal_item_max=0,internal_key_max=0,internal_key_truncate=true,internal_page_max=4KB,key_format=q,key_gap=10,leaf_item_max=0,leaf_key_max=0,leaf_page_max=32KB,leaf_value_max=64MB,log=(enabled=false),lsm=(auto_throttle=true,bloom=true,bloom_bit_count=16,bloom_config=,bloom_hash_count=8,bloom_oldest=false,chunk_count_limit=0,chunk_max=5GB,chunk_size=10MB,merge_custom=(prefix=,start_generation=0,suffix=),merge_max=15,merge_min=0),memory_page_max=10m,os_cache_dirty_max=0,os_cache_max=0,prefix_compression=false,prefix_compression_min=4,source=,split_deepen_min_child=0,split_deepen_per_child=0,split_pct=90,type=file,value_format=u",
  244.                                 "type" : "file",
  245.                                 "uri" : "statistics:table:collection-24--8506913186853910022",
  246.                                 "LSM" : {
  247.                                         "bloom filter false positives" : 0,
  248.                                         "bloom filter hits" : 0,
  249.                                         "bloom filter misses" : 0,
  250.                                         "bloom filter pages evicted from cache" : 0,
  251.                                         "bloom filter pages read into cache" : 0,
  252.                                         "bloom filters in the LSM tree" : 0,
  253.                                         "chunks in the LSM tree" : 0,
  254.                                         "highest merge generation in the LSM tree" : 0,
  255.                                         "queries that could have benefited from a Bloom filter that did not exist" : 0,
  256.                                         "sleep for LSM checkpoint throttle" : 0,
  257.                                         "sleep for LSM merge throttle" : 0,
  258.                                         "total size of bloom filters" : 0
  259.                                 },
  260.                                 "block-manager" : {
  261.                                         "allocations requiring file extension" : 21,
  262.                                         "blocks allocated" : 21,
  263.                                         "blocks freed" : 0,
  264.                                         "checkpoint size" : 155648,
  265.                                         "file allocation unit size" : 4096,
  266.                                         "file bytes available for reuse" : 0,
  267.                                         "file magic number" : 120897,
  268.                                         "file major version number" : 1,
  269.                                         "file size in bytes" : 167936,
  270.                                         "minor version number" : 0
  271.                                 },
  272.                                 "btree" : {
  273.                                         "btree checkpoint generation" : 91,
  274.                                         "column-store fixed-size leaf pages" : 0,
  275.                                         "column-store internal pages" : 0,
  276.                                         "column-store variable-size RLE encoded values" : 0,
  277.                                         "column-store variable-size deleted values" : 0,
  278.                                         "column-store variable-size leaf pages" : 0,
  279.                                         "fixed-record size" : 0,
  280.                                         "maximum internal page key size" : 368,
  281.                                         "maximum internal page size" : 4096,
  282.                                         "maximum leaf page key size" : 2867,
  283.                                         "maximum leaf page size" : 32768,
  284.                                         "maximum leaf page value size" : 67108864,
  285.                                         "maximum tree depth" : 3,
  286.                                         "number of key/value pairs" : 0,
  287.                                         "overflow pages" : 0,
  288.                                         "pages rewritten by compaction" : 0,
  289.                                         "row-store internal pages" : 0,
  290.                                         "row-store leaf pages" : 0
  291.                                 },
  292.                                 "cache" : {
  293.                                         "bytes currently in the cache" : 1349553,
  294.                                         "bytes read into cache" : 0,
  295.                                         "bytes written from cache" : 530298,
  296.                                         "checkpoint blocked page eviction" : 0,
  297.                                         "data source pages selected for eviction unable to be evicted" : 0,
  298.                                         "eviction walk passes of a file" : 0,
  299.                                         "eviction walk target pages histogram - 0-9" : 0,
  300.                                         "eviction walk target pages histogram - 10-31" : 0,
  301.                                         "eviction walk target pages histogram - 128 and higher" : 0,
  302.                                         "eviction walk target pages histogram - 32-63" : 0,
  303.                                         "eviction walk target pages histogram - 64-128" : 0,
  304.                                         "eviction walks abandoned" : 0,
  305.                                         "eviction walks gave up because they restarted their walk twice" : 0,
  306.                                         "eviction walks gave up because they saw too many pages and found no candidates" : 0,
  307.                                         "eviction walks gave up because they saw too many pages and found too few candidates" : 0,
  308.                                         "eviction walks reached end of tree" : 0,
  309.                                         "eviction walks started from root of tree" : 0,
  310.                                         "eviction walks started from saved location in tree" : 0,
  311.                                         "hazard pointer blocked page eviction" : 0,
  312.                                         "in-memory page passed criteria to be split" : 0,
  313.                                         "in-memory page splits" : 0,
  314.                                         "internal pages evicted" : 0,
  315.                                         "internal pages split during eviction" : 0,
  316.                                         "leaf pages split during eviction" : 0,
  317.                                         "modified pages evicted" : 0,
  318.                                         "overflow pages read into cache" : 0,
  319.                                         "page split during eviction deepened the tree" : 0,
  320.                                         "page written requiring lookaside records" : 0,
  321.                                         "pages read into cache" : 0,
  322.                                         "pages read into cache after truncate" : 1,
  323.                                         "pages read into cache after truncate in prepare state" : 0,
  324.                                         "pages read into cache requiring lookaside entries" : 0,
  325.                                         "pages requested from the cache" : 10000,
  326.                                         "pages seen by eviction walk" : 0,
  327.                                         "pages written from cache" : 20,
  328.                                         "pages written requiring in-memory restoration" : 0,
  329.                                         "tracked dirty bytes in the cache" : 1349094,
  330.                                         "unmodified pages evicted" : 0
  331.                                 },
  332.                                 "cache_walk" : {
  333.                                         "Average difference between current eviction generation when the page was last considered" : 0,
  334.                                         "Average on-disk page image size seen" : 0,
  335.                                         "Average time in cache for pages that have been visited by the eviction server" : 0,
  336.                                         "Average time in cache for pages that have not been visited by the eviction server" : 0,
  337.                                         "Clean pages currently in cache" : 0,
  338.                                         "Current eviction generation" : 0,
  339.                                         "Dirty pages currently in cache" : 0,
  340.                                         "Entries in the root page" : 0,
  341.                                         "Internal pages currently in cache" : 0,
  342.                                         "Leaf pages currently in cache" : 0,
  343.                                         "Maximum difference between current eviction generation when the page was last considered" : 0,
  344.                                         "Maximum page size seen" : 0,
  345.                                         "Minimum on-disk page image size seen" : 0,
  346.                                         "Number of pages never visited by eviction server" : 0,
  347.                                         "On-disk page image sizes smaller than a single allocation unit" : 0,
  348.                                         "Pages created in memory and never written" : 0,
  349.                                         "Pages currently queued for eviction" : 0,
  350.                                         "Pages that could not be queued for eviction" : 0,
  351.                                         "Refs skipped during cache traversal" : 0,
  352.                                         "Size of the root page" : 0,
  353.                                         "Total number of pages currently in cache" : 0
  354.                                 },
  355.                                 "compression" : {
  356.                                         "compressed pages read" : 0,
  357.                                         "compressed pages written" : 19,
  358.                                         "page written failed to compress" : 0,
  359.                                         "page written was too small to compress" : 1,
  360.                                         "raw compression call failed, additional data available" : 0,
  361.                                         "raw compression call failed, no additional data available" : 0,
  362.                                         "raw compression call succeeded" : 0
  363.                                 },
  364.                                 "cursor" : {
  365.                                         "bulk-loaded cursor-insert calls" : 0,
  366.                                         "create calls" : 5,
  367.                                         "cursor operation restarted" : 0,
  368.                                         "cursor-insert key and value bytes inserted" : 561426,
  369.                                         "cursor-remove key bytes removed" : 0,
  370.                                         "cursor-update value bytes updated" : 0,
  371.                                         "cursors cached on close" : 0,
  372.                                         "cursors reused from cache" : 9996,
  373.                                         "insert calls" : 10000,
  374.                                         "modify calls" : 0,
  375.                                         "next calls" : 1,
  376.                                         "prev calls" : 1,
  377.                                         "remove calls" : 0,
  378.                                         "reserve calls" : 0,
  379.                                         "reset calls" : 20003,
  380.                                         "search calls" : 0,
  381.                                         "search near calls" : 0,
  382.                                         "truncate calls" : 0,
  383.                                         "update calls" : 0
  384.                                 },
  385.                                 "reconciliation" : {
  386.                                         "dictionary matches" : 0,
  387.                                         "fast-path pages deleted" : 0,
  388.                                         "internal page key bytes discarded using suffix compression" : 36,
  389.                                         "internal page multi-block writes" : 0,
  390.                                         "internal-page overflow keys" : 0,
  391.                                         "leaf page key bytes discarded using prefix compression" : 0,
  392.                                         "leaf page multi-block writes" : 1,
  393.                                         "leaf-page overflow keys" : 0,
  394.                                         "maximum blocks required for a page" : 1,
  395.                                         "overflow values written" : 0,
  396.                                         "page checksum matches" : 0,
  397.                                         "page reconciliation calls" : 2,
  398.                                         "page reconciliation calls for eviction" : 0,
  399.                                         "pages deleted" : 0
  400.                                 },
  401.                                 "session" : {
  402.                                         "cached cursor count" : 5,
  403.                                         "object compaction" : 0,
  404.                                         "open cursor count" : 0
  405.                                 },
  406.                                 "transaction" : {
  407.                                         "update conflicts" : 0
  408.                                 }
  409.                         },
  410.                         "nindexes" : 2,
  411.                         "totalIndexSize" : 208896,
  412.                         "indexSizes" : {
  413.                                 "_id_" : 94208,
  414.                                 "id_1" : 114688
  415.                         },
  416.                         "ok" : 1,
  417.                         "operationTime" : Timestamp(1535339957, 1),
  418.                         "$gleStats" : {
  419.                                 "lastOpTime" : {
  420.                                         "ts" : Timestamp(1535339939, 572),
  421.                                         "t" : NumberLong(1)
  422.                                 },
  423.                                 "electionId" : ObjectId("7fffffff0000000000000001")
  424.                         },
  425.                         "lastCommittedOpTime" : Timestamp(1535339957, 1),
  426.                         "$configServerState" : {
  427.                                 "opTime" : {
  428.                                         "ts" : Timestamp(1535339956, 1),
  429.                                         "t" : NumberLong(1)
  430.                                 }
  431.                         },
  432.                         "$clusterTime" : {
  433.                                 "clusterTime" : Timestamp(1535339957, 1),
  434.                                 "signature" : {
  435.                                         "hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="),
  436.                                         "keyId" : NumberLong(0)
  437.                                 }
  438.                         }
  439.                 }
  440.         },
  441.         "ok" : 1,
  442.         "operationTime" : Timestamp(1535339957, 1),
  443.         "$clusterTime" : {
  444.                 "clusterTime" : Timestamp(1535339957, 1),
  445.                 "signature" : {
  446.                         "hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="),
  447.                         "keyId" : NumberLong(0)
  448.                 }
  449.         }
  450. }
  451. mongos>

三十七 mongodb备份恢复

1.备份指定库

[root@mongodbserver1 mongod]# mongodump --host 127.0.0.1 --port 20000  -d testdb -o /tmp/mongobak

2018-08-27T11:22:43.430+0800    writing testdb.table1 to

2018-08-27T11:22:43.541+0800    done dumping testdb.table1 (10000 documents)

[root@mongodbserver1 mongod]# ls -lh /tmp/mongobak/testdb/

total 532K

-rw-r--r-- 1 root root 528K Aug 27 11:22 table1.bson

-rw-r--r-- 1 root root  187 Aug 27 11:22 table1.metadata.json

2.备份所有库

[root@mongodbserver1 mongod]# mongodump --host 127.0.0.1 --port 20000 -o /tmp/mongobak/alldatabase

2018-08-27T11:24:40.955+0800    writing admin.system.version to

2018-08-27T11:24:41.049+0800    done dumping admin.system.version (1 document)

2018-08-27T11:24:41.143+0800    writing config.locks to

2018-08-27T11:24:41.144+0800    writing config.changelog to

2018-08-27T11:24:41.144+0800    writing testdb.table1 to

2018-08-27T11:24:41.144+0800    writing config.lockpings to

2018-08-27T11:24:41.149+0800    done dumping config.changelog (7 documents)

2018-08-27T11:24:41.149+0800    writing config.shards to

2018-08-27T11:24:41.149+0800    done dumping config.locks (4 documents)

2018-08-27T11:24:41.149+0800    writing config.mongos to

2018-08-27T11:24:41.149+0800    done dumping config.lockpings (9 documents)

2018-08-27T11:24:41.149+0800    writing config.chunks to

2018-08-27T11:24:41.151+0800    done dumping config.mongos (3 documents)

2018-08-27T11:24:41.151+0800    writing config.collections to

2018-08-27T11:24:41.152+0800    done dumping config.shards (3 documents)

2018-08-27T11:24:41.152+0800    writing config.databases to

2018-08-27T11:24:41.153+0800    done dumping config.chunks (2 documents)

2018-08-27T11:24:41.153+0800    writing config.version to

2018-08-27T11:24:41.154+0800    done dumping config.databases (1 document)

2018-08-27T11:24:41.154+0800    writing config.tags to

2018-08-27T11:24:41.155+0800    done dumping config.collections (2 documents)

2018-08-27T11:24:41.155+0800    writing config.migrations to

2018-08-27T11:24:41.157+0800    done dumping config.version (1 document)

2018-08-27T11:24:41.170+0800    done dumping config.tags (0 documents)

2018-08-27T11:24:41.179+0800    done dumping config.migrations (0 documents)

2018-08-27T11:24:41.301+0800    done dumping testdb.table1 (10000 documents)

3.指定备份集合

# 它依然会生成mydb目录，再在这目录下面生成两个文件

[root@mongodbserver1 mongod]# mongodump --host 127.0.0.1 --port 20000 -d testdb -c table1 -o /tmp/mongobak/

2018-08-27T11:28:31.578+0800    writing testdb.table1 to

2018-08-27T11:28:31.636+0800    done dumping testdb.table1 (10000 documents)

4.导出集合为json文件

[root@mongodbserver1 mongod]# mongoexport --host 127.0.0.1 --port 20000 -d testdb -c table1 -o /tmp/mydb2/testdb.json

2018-08-27T11:31:07.827+0800    connected to: 127.0.0.1:20000

2018-08-27T11:31:07.974+0800    exported 10000 records

[root@mongodbserver1 mongod]#

5.mongodb的恢复

1.恢复所有库

# 其中dir是备份所有库的目录名字，其中--drop可选，意思是当恢复之前先把之前的数据删除，不建议使用

# 其中--drop可选，意思是当恢复之前先把之前的数据删除，不建议使用

[root@mongodbserver1 mongod]# mongorestore -h 127.0.0.1 --port 20000  --drop /tmp/mongobak/alldatabase

2.恢复指定库

# -d跟要恢复的库名字，dir就是该库备份时所在的目录

[root@mongodbserver1 mongod]# mongorestore -d testdb /tmp/mongobak

3.恢复集合

# -c后面跟要恢复的集合名字，dir是备份mydb库时生成文件所在路径，这里是一个bson文件的路径

[root@mongodbserver1 mongod]# mongorestore -d testdb -c table1 /tmp/mongobak/

4.导入集合

[root@mongodbserver1 mongod]# mongoimport -d testdb -c table1 --file /tmp/mydb2/testdb.json

三十八 扩展

扩展内容

mongodb安全设置 http://www.mongoing.com/archives/631

mongodb执行js脚本 http://www.jianshu.com/p/6bd8934bd1ca

非关系统型数据库-mangodb的更多相关文章

  1. Mysql-关系型数据库与非关系型数据库

    一.什么是数据库 数据库是数据的仓库. 与普通的"数据仓库"不同的是,数据库依据"数据结构"来组织数据,因为"数据结构",所以我们看到的数据 ...

  2. 关于数据库管理系统DBMS--关系型数据库（MySQL/MariaDB）

    数据库的结构(3种):层次,网状,关系型(用的最多): DBMS的三层模型: 视图层:面向最终用户: 逻辑层:面向程序员或DBA: 物理层:面向系统管理员: 关系型数据库管理系统——RDBMS: 主要 ...

  3. 回首2018 | 分析型数据库AnalyticDB: 不忘初心 砥砺前行

    题记 分析型数据库AnalyticDB(下文简称ADB),是阿里巴巴自主研发.唯一经过超大规模以及核心业务验证的PB级实时数据仓库.截止目前,现有外部支撑客户既包括传统的大中型企业和政府机构,也包括众 ...

  4. ADO.NET 连接方式和非链接方式访问数据库

    一.//连接方式访问数据库的主要步骤(利用DataReader对象实现数据库连接模式) 1.创建连接对象(连接字符串) SqlConnection con = new SqlConnection(Co ...

  5. (转)操作型数据库的春天：MongoDB 1.5亿美元融资背后的故事

    大部分融资都要耗时数月,但非关系式数据库MongoDB仅用3周时间就完成了1.5亿美元的融资.为什么这个进程会这么快,MongoDB CEO Max Schireson在接受采访时说,这是因为投资者看 ...

  6. MongoDB，无模式文档型数据库简介

    MongoDB的名字源自一个形容词humongous(巨大无比的),在向上扩展和快速处理大数据量方面,它会损失一些精度,在旧金山举行的MondoDB大会上,Merriman说:“你不适宜用它来处理复杂 ...

  7. MySQL新特性文档型数据库

    mongodb在文档型数据库这方面一直做的很好,也发展了很多年,MySQL作为一个比较大众的数据库也慢慢支持了该特性,下面介绍一下MySQL支持文档型数据库的简单操作. 环境: 主机名 IP 系统 软 ...

  8. 阿里下一代云分析型数据库AnalyticDB入选Forrester云化数仓象限

    前言 近期, 全球权威IT咨询机构Forrester发布"The Forrester Wave: CloudData Warehouse Q4 2018"研究报告,阿里巴巴分析型数 ...

  9. 阿里巴巴下一代云分析型数据库AnalyticDB入选Forrester Wave™ 云数仓评估报告 解读

    前言近期, 全球权威IT咨询机构Forrester发布"The Forrester WaveTM: CloudData Warehouse Q4 2018"研究报告,阿里巴巴分析型 ...

随机推荐

  1. 20165306 Exp5 MSF基础应用

    Exp5 MSF基础应用 一.实践概述 1. 实践内容 本实践目标是掌握metasploit的基本应用方式,重点常用的三种攻击方式的思路.实现: 1.1一个主动攻击实践 ms08-067+window ...

  2. 剑指offer：顺时针打印矩阵

    问题描述 输入一个矩阵,按照从外向里以顺时针的顺序依次打印出每一个数字,例如,如果输入如下4 X 4矩阵: 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 则依次打印出数 ...

  3. CentOS7攻克日记(四) —— 安装Mysql和Redis

    这一篇主要安装mysql,redis等数据库   在这篇开始之前,有一个坑,上一篇更改python软连接的时候,尽量都用名字是python3来软连接/usr/../bin/python3.6,把名字是 ...

  4. ELK6.6.0+filebeat6.6.0部署

    elastic不能用root用户去启动,否则会报错,所以创建elastic用户ES集群部署 1.创建elastic用户 $ useradd elastic $ passwd elastic 2..部署 ...

  5. Docker跨主机网络联通之etcd实现

    搭建ETCD集群 查看NODE1机器IP,并启动ETCD ubuntu@docker-node1:~$ ifconfig eth0 eth0: flags=4163<UP,BROADCAST,R ...

  6. ArrayList源码阅读笔记（1.8）

    目录 ArrayList类的注解阅读 ArrayList类的定义 属性的定义 ArrayList构造器 核心方法 普通方法 迭代器(iterator&ListIterator)实现 最后声明 ...

  7. 使用npm私有服务器保存公司内部强业务类型组件(一):npm私有服务器搭建

    1:安装centOS虚拟机 2:安装完成虚拟机后完成后开启系统网卡: 进入到/etc/sysconfig/network-scprits/ 打开ifcfg-ens33文件 找到 ONBOOT=NO 改 ...

  8. (桥接)完美解决linux设置静态ip。

    网上找来找去都是一些隔靴挠痒的操作,这里引自https://blog.csdn.net/yefeng0810/article/details/81150605.感谢大佬的博客.

  9. 服务器与客户端连接 & 聊天机器人

    服务器运行当显示 E:\pycharm\python\venv\Scripts\python.exe E:/pycharm/python/协议/机器人聊天服务器.py 开始监听 accept 说明服务 ...

  10. Hadoop 2.7.4 HDFS+YRAN HA增加datanode和nodemanager

    当前集群 主机名称 IP地址 角色 统一安装目录 统一安装用户 sht-sgmhadoopnn-01 172.16.101.55 namenode,resourcemanager /usr/local ...