DRBD(DistributedReplicatedBlockDevice)是一個基于塊設備級別在遠程服務器直接同步和鏡像數據的開源軟件,類似于RAID1數據鏡像,通常配合keepalived、heartbeat等HA軟件來實現高可用性。
DRBD是一種塊設備,可以被用于高可用(HA)之中.它類似于一個網絡RAID-1功能,當你將數據寫入本地文件系統時,數據還將會被發送到網絡中另一臺主機上.以相同的形式記錄在一個文件系統中。
本地(master)與遠程主機(backup)的保證實時同步,如果本地系統出現故障時,遠程主機上還會保留有一份相同的數據,可以繼續使用.在高可用(HA)中使用DRBD功能,可以代替使用一個共享盤陣.因為數據同時存在于本地主機和遠程主機上,切換時,遠程主機只要使用它上面的那份備份數據。
一、實施環境
系統版本:CentOS 6.5
DRBD版本: drbd-8.3.15
Keepalived:keepalived-1.1.15
Master:192.168.10.128
Backup:192.168.10.130
二、初始化配置
1) 在128、130兩臺服務器/etc/hosts里面都添加如下配置:
192.168.149.128 node1
192.168.149.130 node2
2) 優化系統kernel參數,直接上sysctl.conf配置如下:
net.ipv4.ip_forward = 0net.ipv4.conf.default.rp_filter = 1net.ipv4.conf.default.accept_source_route = 0kernel.sysrq = 0kernel.core_uses_pid = 1net.ipv4.tcp_syncookies = 1kernel.msgmnb = 65536kernel.msgmax = 65536kernel.shmmax = 68719476736kernel.shmall = 4294967296net.ipv4.tcp_max_tw_buckets = 10000net.ipv4.tcp_sack = 1net.ipv4.tcp_window_scaling = 1net.ipv4.tcp_rmem = 4096 87380 4194304net.ipv4.tcp_wmem = 4096 16384 4194304net.core.wmem_default = 8388608net.core.rmem_default = 8388608net.core.rmem_max = 16777216net.core.wmem_max = 16777216net.core.netdev_max_backlog = 262144net.core.somaxconn = 262144net.ipv4.tcp_max_orphans = 3276800net.ipv4.tcp_max_syn_backlog = 262144net.ipv4.tcp_timestamps = 0net.ipv4.tcp_synack_retries = 1net.ipv4.tcp_syn_retries = 1net.ipv4.tcp_tw_recycle = 1net.ipv4.tcp_tw_reuse = 1net.ipv4.tcp_mem = 94500000 915000000 927000000net.ipv4.tcp_fin_timeout = 1net.ipv4.tcp_keepalive_time = 30net.ipv4.ip_local_port_range = 1024 65530net.ipv4.icmp_echo_ignore_all = 1
3)兩臺服務器分別添加一塊設備,用于DRBD主設備存儲,我這里為/dev/sdb 20G硬盤;
執行如下命令:
mkfs.ext3 /dev/sdb ;dd if=/dev/zero of=/dev/sdb bs=1M count=1;sync
三、DRBD安裝配置
Yum方式安裝:
rpm -Uvh http://www.elrepo.org/elrepo-release-6-6.el6.elrepo.noarch.rpm
yum -y install drbd83* kmod-drbd83 ; modprobe drbd
源碼安裝方式:
http://oss.linbit.com/drbd/8.4/drbd-8.4.4.tar.gz
./configure --prefix=/usr/local/drbd --with-km
make KDIR=/usr/src/kernels/2.6.32-504.el6.x86_64/
make install
cp drbd/drbd.ko /lib/modules/`uname -r`/kernel/lib/
Yum方式和源碼方式都需要執行:modprobe drbd 加載DRBD模塊。
安裝完成并加載drbd模塊后,vi修改/etc/drbd.conf配置文件,內容如下:
global {usage-count yes;}common {syncer { rate 100M; }}resource r0 {protocol C;startup {}disk {on-io-error detach;#size 1G;}net {}on node1 {device /dev/drbd0;disk /dev/sdb;address 192.168.10.128:7898;meta-disk internal;}on node2 {device /dev/drbd0;disk /dev/sdb;address 192.168.10.130:7898;meta-disk internal;}}
配置修改完畢后執行如下命令初始化:
drbdadm create-md r0 ;/etc/init.d/drbd restart ;/etc/init.d/drbd status
如下圖:
以上步驟,需要在兩臺服務器都執行,兩臺都配置完畢后,在node2從上面執行如下命令:/etc/init.d/drbd status 看到如下信息,表示目前兩臺都為從,我們需要設置node1為master,命令如下:
drbdadm -- --overwrite-data-of-peer primary all
mkfs.ext4 /dev/drbd0
mkdir /app ;mount /dev/drbd0 /app
自此,DRBD配置完畢,我們可以往/app目錄寫入任何東西,當master出現宕機或者其他故障,手動切換到backup,數據沒有任何丟失,相當于兩臺服務器做網絡RAID1。
四、Keepalived配置
wget http://www.keepalived.org/software/keepalived-1.1.15.tar.gz ; tar -xzvf keepalived-1.1.15.tar.gz ;cd keepalived-1.1.15 ; ./configure ; make ;make install
DIR=/usr/local/ ;cp $DIR/etc/rc.d/init.d/keepalived /etc/rc.d/init.d/ ; cp $DIR/etc/sysconfig/keepalived /etc/sysconfig/ ;
mkdir -p /etc/keepalived ; cp $DIR/sbin/keepalived /usr/sbin/
兩臺服務器均安裝keepalived,并進行配置,首先在node1(master)上配置,keepalived.conf內容如下:
! Configuration File for keepalivedglobal_defs {router_id LVS_DEVEL}vrrp_script check_mysql {script "/data/sh/check_mysql.sh"interval 5}vrrp_instance VI_1 {state MASTERinterface eth0virtual_router_id 52priority 100advert_int 1authentication {auth_type PASSauth_pass 1111}virtual_ipaddress {192.168.10.100}track_script {check_mysql}}
然后創建check_mysql.sh檢測腳本,內容如下:
#!/bin/shA=`ps -C mysqld --no-header |wc -l`if[ $A -eq 0 ];then/bin/umount /app/drbdadm secondary r0killall keepalivedfi添加node2(backup)上配置,keepalived.conf內容如下:! Configuration File for keepalivedglobal_defs {router_id LVS_DEVEL}vrrp_sync_group VI{group {VI_1}notify_master /data/sh/master.shnotify_backup /data/sh/backup.sh}vrrp_instance VI_1 {state BACKUPinterface eth0virtual_router_id 52priority 90advert_int 1authentication {auth_type PASSauth_pass 1111}virtual_ipaddress {192.168.10.100}}
創建master.sh檢測腳本,內容如下:
#!/bin/bashdrbdadm primary r0/bin/mount /dev/drbd0 /app//etc/init.d/mysqld start
創建backup.sh檢測腳本,內容如下:
#!/bin/bash/etc/init.d/mysqld stop/bin/umount /dev/drbd0drbdadm secondary r0
發生腦裂恢復步驟如下:
Master執行命令:
drbdadm secondary r0
drbdadm -- --discard-my-data connect r0
drbdadm -- --overwrite-data-of-peer primary all
Backup上執行命令:
drbdadm secondary r0
drbdadm connect r0
新聞熱點
疑難解答
圖片精選