Mongodb集群——分片和集群2高級實例

2020-03-14 13:23:46

字體：大中小

來源：轉載

供稿：網友

前面我們介紹了簡單的集群配置實例。在簡單實例中，雖然MongoDB auto-Sharding解決了海量存儲問題，和動態擴容問題，但是離我們在真實環境下面所需要的高可靠性和高可用性還有一定的距離。

下面我們就介紹一個接近實際的解決方案：

Shard：使用Replica Sets，來確保數據的可靠性。通過這個方案，可以在每個節點有數據的備份、實現自動控制容錯轉移和自動恢復
Config：使用3個配置服務器，確保元數據完整性
Route：配合LVS，實現負載均衡，提高接入性能。

1、配置集群目錄

數據存儲目錄：

[python] view plaincopy									 
				$ mkdir -p /home/scotte.ye/data/10001  
				$ mkdir -p /home/scotte.ye/data/10002  
				$ mkdir -p /home/scotte.ye/data/10003  
				  
				$ mkdir -p /home/scotte.ye/data/10011  
				$ mkdir -p /home/scotte.ye/data/10012  
				$ mkdir -p /home/scotte.ye/data/10013  
				  
				$ mkdir -p /home/scotte.ye/data/config1  
				$ mkdir -p /home/scotte.ye/data/config2  
				$ mkdir -p /home/scotte.ye/data/config3  

日志目錄：

[python] view plaincopy									 
				$ mkdir -p /home/scotte.ye/data/logs  

2、配置 Shard Replica Sets

配置第一組Sets

[python] view plaincopy									 
				//10001  
				$ ./mongod --shardsvr --fork -logpath=/home/data/logs/null -dbpath=/home/data/10001/ -port=10001 --nohttpinterface --replSet set1  
				  
				//10002  
				$ ./mongod --shardsvr --fork -logpath=/home/data/logs/null -dbpath=/home/data/10002/ -port=10002 --nohttpinterface --replSet set1  
				  
				//10003  
				$ ./mongod --shardsvr --fork -logpath=/home/data/logs/null -dbpath=/home/data/10003/ -port=10003 --nohttpinterface --replSet set1  

配置集群

[python] view plaincopy									 
				$ ./mongo -port 10001  
				MongoDB shell version: 2.0.2  
				connecting to: 127.0.0.1:10001/test  
				>#配置集合1  
				>#構建參數  
				>cfg={_id:'set1',  
				members:[{_id:1,host:'192.168.35.106:10001'},  
				                {_id:1,host:'192.168.35.106:10002'},  
				                {_id:1,host:'192.168.35.106:10003'}]  
				};  
				{  
				     "_id":"set1",  
				     "members":[  
				          {  
				               "_id":1,  
				               "host":"192.168.35.106:10001"  
				          },  
				          {  
				               "_id":2,  
				               "host":"192.168.35.106:10002"  
				          },  
				          {  
				               "_id":3,  
				               "host":"192.168.35.106:10003"  
				          }  
				     ]  
				}  
				>#讓參數生效  
				>rs.initiate(cfg);  
				{  
				     "info":"Config now saved locally. Should come online in about aminute.",  
				     "OK":1  
				}  
				>#查看運行狀態  
				>rs.status();  
				{  
				        "set" : "set1",  
				        "date" : ISODate("2012-02-29T12:02:46Z"),  
				        "myState" : 2,  
				        "syncingTo" : "192.168.35.106:10003",  
				        "members" : [  
				                {  
				                        "_id" : 1,  
				                        "name" : "192.168.35.106:10001",  
				                        "health" : 1,  
				                        "state" : 2,  
				                        "stateStr" : "PRIMARY",  
				                        "optime" : {  
				                                "t" : 1330435339000,  
				                                "i" : 2413  
				                        },  
				                        "optimeDate" : ISODate("2012-02-28T13:22:19Z"),  
				                        "self" : true  
				                },  
				                {  
				                        "_id" : 2,  
				                        "name" : "192.168.35.106:10002",  
				                        "health" : 1,  
				                        "state" : 2,  
				                        "stateStr" : "SECONDARY",  
				                        "uptime" : 1112736,  
				                        "optime" : {  
				                                "t" : 1330435339000,  
				                                "i" : 2413  
				                        },  
				                        "optimeDate" : ISODate("2012-02-28T13:22:19Z"),  
				                        "lastHeartbeat" : ISODate("2012-02-29T12:02:45Z"),  
				                        "pingMs" : 0  
				                },  
				                {  
				                        "_id" : 3,  
				                        "name" : "192.168.35.106:10003",  
				                        "health" : 1,  
				                        "state" : 1,  
				                        "stateStr" : "SECONDARY",  
				                        "uptime" : 1112736,  
				                        "optime" : {  
				                                "t" : 1330435339000,  
				                                "i" : 2413  
				                        },  
				                        "optimeDate" : ISODate("2012-02-28T13:22:19Z"),  
				                        "lastHeartbeat" : ISODate("2012-02-29T12:02:46Z"),  
				                        "pingMs" : 0  
				                }  
				        ],  
				        "ok" : 1  
				}  

配置第二組sets

[python] view plaincopy									 
				//10011  
				$ ./mongod --shardsvr --fork -logpath=/home/data/logs/null -dbpath=/home/data/10011/ -port=10011 --nohttpinterface --replSet set2  
				  
				//10012  
				$ ./mongod --shardsvr --fork -logpath=/home/data/logs/null -dbpath=/home/data/10012/ -port=10012 --nohttpinterface --replSet set2  
				  
				//10013  
				$ ./mongod --shardsvr --fork -logpath=/home/data/logs/null -dbpath=/home/data/10013/ -port=10013 --nohttpinterface --replSet set2  

配置集群

[cpp] view plaincopy									 
				$ ./mongo -port 10011  
				MongoDB shell version: 2.0.2  
				connecting to: 127.0.0.1:10011/test  
				>#配置集合1  
				>#構建參數  
				>cfg={_id:'set2',  
				members:[{_id:1,host:'192.168.35.106:10011'},  
				                {_id:1,host:'192.168.35.106:10012'},  
				                {_id:1,host:'192.168.35.106:10013'}]  
				};  
				{  
				     "_id":"set2",  
				     "members":[  
				          {  
				               "_id":1,  
				               "host":"192.168.35.106:10011"  
				          },  
				          {  
				               "_id":2,  
				               "host":"192.168.35.106:10012"  
				          },  
				          {  
				               "_id":3,  
				               "host":"192.168.35.106:10013"  
				          }  
				     ]  
				}  
				>#讓參數生效  
				>rs.initiate(cfg);  
				{  
				     "info":"Config now saved locally. Should come online in about aminute.",  
				     "OK":1  
				}  
				>#查看運行狀態  
				>rs.status();  
				{  
				        "set" : "set2",  
				        "date" : ISODate("2012-02-29T12:12:46Z"),  
				        "myState" : 2,  
				        "syncingTo" : "192.168.35.106:10011",  
				        "members" : [  
				                {  
				                        "_id" : 1,  
				                        "name" : "192.168.35.106:10011",  
				                        "health" : 1,  
				                        "state" : 2,  
				                        "stateStr" : "PRIMARY",  
				                        "optime" : {  
				                                "t" : 1330435339000,  
				                                "i" : 2413  
				                        },  
				                        "optimeDate" : ISODate("2012-02-28T13:22:19Z"),  
				                        "self" : true  
				                },  
				                {  
				                        "_id" : 2,  
				                        "name" : "192.168.35.106:10012",  
				                        "health" : 1,  
				                        "state" : 2,  
				                        "stateStr" : "SECONDARY",  
				                        "uptime" : 1112736,  
				                        "optime" : {  
				                                "t" : 1330435339000,  
				                                "i" : 2413  
				                        },  
				                        "optimeDate" : ISODate("2012-02-28T13:22:19Z"),  
				                        "lastHeartbeat" : ISODate("2012-02-29T12:02:45Z"),  
				                        "pingMs" : 0  
				                },  
				                {  
				                        "_id" : 3,  
				                        "name" : "192.168.35.106:10013",  
				                        "health" : 1,  
				                        "state" : 1,  
				                        "stateStr" : "SECONDARY",  
				                        "uptime" : 1112736,  
				                        "optime" : {  
				                                "t" : 1330435339000,  
				                                "i" : 2413  
				                        },  
				                        "optimeDate" : ISODate("2012-02-28T13:22:19Z"),  
				                        "lastHeartbeat" : ISODate("2012-02-29T12:02:46Z"),  
				                        "pingMs" : 0  
				                }  
				        ],  
				        "ok" : 1  
				}  

啟用config servier

[python] view plaincopy									 
				$ ./mongod --configsvr --fork -logpath=/home/data/logs/null -dbpath=/home/data/config1/ -port=20000 --nohttpinterface  
				$ ./mongod --configsvr --fork -logpath=/home/data/logs/null -dbpath=/home/data/config2/ -port=20001 --nohttpinterface  
				$ ./mongod --configsvr --fork -logpath=/home/data/logs/null -dbpath=/home/data/config3/ -port=20002 --nohttpinterface  

啟用Route server

[python] view plaincopy									 
				$ ./mongos -configdb="192.168.35.106:20000,192.168.35.106:20001,192.168.35.106:20002" --fork -logpath=/home/data/logs/null  
				>#查看是否正常運行  
				>ps aux|grep mongos|grep -v grep  
				root      2726  0.0  0.1 174192  3392 ?        Sl   Feb16   3:20 ./mongos -configdb=192.168.35.106:20000,192.168.35.106:20001,192.168.35.106:20002 --fork -logpath=/home/data/logs/null  

開始配置Sharding

[python] view plaincopy									 
				$ ./mongo -port 10001  
				MongoDB shell version: 2.0.2  
				connecting to: 127.0.0.1:10001/test  
				>#進入管理數據庫  
				>use admin  
				switched to db admin  
				>#添加Sharding  
				> db.runcommand({addshard:'set1/192.168.35.106:10001,192.168.35.106:10002,192.168.35.106:10003'})  
				{"shardAdded":"set1","ok":1}  
				> db.runCommand({addshard:'set2/192.168.35.106:10011,192.168.35.106:10012,192.168.35.106:10013'})  
				{"shardAdded":"set2","ok":1}  
				>#讓test數據庫支持Sharding  
				>db.runCommand({enablesharding:'test'})  
				{"ok":1}  
				>#讓數據庫中的一個集合生效，且根據ID來進行分片  
				>db.runCommand({shardcollection:'test.user',key:{_id:1}})  
				{"collectionshrded":"test.user","ok":1}  
				  
				注：另外可以通過下面兩個命令查看sharding情況:  
				>db.runCommand({listshards:1}  
				>printShardingStatus();  