sersync其實是利用inotify和rsync兩種軟件技術來實現數據實時同步功能的,inotify是用于監聽sersync所在服務器上的文件變化,結合rsync軟件來進行數據同步,將數據實時同步給客戶端服務器。
工作過程:在同步主服務器上開啟sersync,負責監聽文件系統的變化,然后調用rsync命令把更新的文件同步到目標服務器上,主服務器上安裝sersync軟件,目標服務器上安裝rsync服務。
1、客戶端配置
[root@localhost2 ~]# cat /etc/rsyncd.conf ##created by cai at 2018-2-24uid=rsyncgid=rsyncuse chroot = nomax connections = 200timeout = 300pid file = /var/run/rsyncd.pidlock file = /var/run/rsync.locklog file = /var/log/rsyncd.log[data]path = /data/ignore errorsread only = falselist = falsehosts allow = 192.168.181.128:52000/24hosts deny = 0.0.0.0/32auth users = rsync_bodysecrets file = /etc/rsync.password[root@localhost2 ~]# ls -ld /data/drwxrwxrwx. 3 rsync rsync 4096 Feb 24 16:58 /data/[root@localhost2 ~]# cat /etc/rsync.password rsync_body:admin[root@localhost2 ~]# ls -ld /etc/rsync.password -rw-------. 1 root root 17 Feb 24 16:26 /etc/rsync.password #600權限[root@localhost2 ~]# netstat -lntup| grep "rsync"tcp 0 0 0.0.0.0:873 0.0.0.0:* LISTEN 1497/rsync tcp 0 0 :::873 :::* LISTEN 1497/rsync
2、主服務器配置
[root@localhost1 ~]# cat /etc/rsync.password admin[root@localhost1 ~]# ls -ld /etc/rsync.password -rw------- 1 root root 6 Feb 24 03:54 /etc/rsync.password
3、安裝sersync服務
采用inotify來對文件進行監控,當監控到文件有文件發生改變的時候,就會調用rsync實現觸發式實時同步!
安裝sersync(注意sersync是工作在rsync的源服務器上,也就是客戶端上)
[root@salt-client01 ~]# cd /usr/local/src/[root@salt-client01 src]# tar -zxvf sersync2.5.4_64bit_binary_stable_final.tar.gz -C /usr/local/GNU-Linux-x86/GNU-Linux-x86/sersync2GNU-Linux-x86/confxml.xml[root@salt-client01 src]# cd /usr/local/[root@salt-client01 local]# mv GNU-Linux-x86 sersync[root@salt-client01 local]# cd sersync/[root@salt-client01 sersync]# mkdir conf bin log[root@salt-client01sersync]# mv confxml.xml conf[root@salt-client01sersync]# mv sersync2 bin/sersync
修改配置文件
***********************************30行開始****************************** <commonParams params="-artuz"/> #-artuz為rsync同步時的參數 <authstart="true" users="rsync的虛擬用戶名(rsync_backup)" passwordfile="rsync的密碼文件"/> <userDefinedPort start="true"port="873"/><!-- port=874 --> <timeout start="false" time="100"/><!--timeout=100 --> <sshstart="false"/> ************************************第36行*********************************** <failLogpath="自己定義的log文件夾(/usr/local/sersync/log)rsync_fail_log.sh" timeToExecute="60"/><!--defaultevery 60mins execute once--> ******************************************************************************* *注:若有多個目錄備份可以穿件多個配置文件在啟動時的-o參數中添加即可[root@salt-client01 conf]# diff confxml.xml confxml.xml.bak24,25c24,25< <localpath watch="/data/"> #data就是本地需要同步的文件夾到服務器端的目錄< <remote ip="192.168.91.166" name="data"/> #data (server的模塊名)是rsync 服務端的文件夾,也就是推送到服務器端的目標文件夾,可以配置多個,---> <localpath watch="/opt/tongbu">> <remote ip="127.0.0.1" name="tongbu1"/>31c31< <auth start="true" users="rsync_body" passwordfile="/etc/rsync.password"/> #true 才能生效,rsync_body同步時候虛擬賬號,后面是密碼文件---> <auth start="false" users="root" passwordfile="/etc/rsync.pas"/>33c33< <timeout start="true" time="100"/><!-- timeout=100 --> #true 才能生效---> <timeout start="false" time="100"/><!-- timeout=100 -->36c36< <failLog path="/usr/local/sersync/log/rsync_fail_log.sh" timeToExecute="60"/><!--default every 60mins execute once--> #檢測rsync進程判斷,沒有自動啟---> <failLog path="/tmp/rsync_fail_log.sh" timeToExecute="60"/><!--default evePry 60mins execute once-->
啟動sersync
[root@salt-client01 src]# echo 'export PATH=$PATH:/usr/local/sersync/bin'>>/etc/profile #聲明環境變量[root@salt-client01 src]# source /etc/profile[root@salt-client01 src]# sersync2 -r -d -o /usr/local/sersync/conf/confxml.xml #啟動set the system paramexecute:echo 50000000 > /proc/sys/fs/inotify/max_user_watchesexecute:echo 327679 > /proc/sys/fs/inotify/max_queued_eventsparse the command paramoption: -r rsync all the local files to the remote servers before the sersync workoption: -d run as a daemonoption: -o config xml name: /usr/local/sersync/conf/confxml.xmldaemon thread num: 10parse xml config filehost ip : localhost host port: 8008daemon start,sersync run behind the consoleuse rsync password-file :user is rsync_bodypasswordfile is /etc/rsync.passwordconfig xml parse successplease set /etc/rsyncd.conf max connections=0 Manuallysersync working thread 12 = 1(primary thread) + 1(fail retry thread) + 10(daemon sub threads)Max threads numbers is: 22 = 12(Thread pool nums) + 10(Sub threads)please according your cpu ,use -n param to adjust the cpu rate------------------------------------------rsync the directory recursivly to the remote servers onceworking please wait...execute command: cd /data && rsync -artuz -R --delete ./ --timeout=100 rsync_body@192.168.91.166::data --password-file=/etc/rsync.password >/dev/null 2>&1run the sersync:watch path is: /data #此時可以看出sersync已經啟動成功了#檢測腳本[root@salt-client01 log]# pwd/usr/local/sersync/log[root@salt-client01 log]# vim rsync_fail_log.sh[root@salt-client01 log]# chmod +x rsync_fail_log.sh[root@salt-client01 ~]# cat /usr/local/sersync/log/rsync_fail_log.sh#!/bin/bash#Purpose: Check sersync whether it is alive#Author: cai meng zhiSERSYNC="/usr/local/sersync/bin/sersync2"CONF_FILE="/usr/local/sersync/conf/confxml.xml"STATUS=$(ps aux |grep 'sersync2'|grep -v 'grep'|wc -l)if [ $STATUS -eq 0 ];then $SERSYNC -d -r -o $CONF_FILE &else exit 0;fi腳本寫好以后,添加到計劃任務中去*/1 * * * * /bin/bash /usr/local/sersync/log/rsync_fail_log.sh > /dev/null 2>&1測試同步:客戶端新增文件[root@salt-client01 data]# cp /etc/passwd 192.168.91.156.passwd[root@salt-client01 data]# lltotal 4-rw-r--r-- 1 root root 1928 Nov 10 18:15 192.168.91.156.passwd-rw-r--r-- 1 root root 0 Nov 10 17:27 3服務端檢測[root@salt-master data]# cd /data/[root@salt-master data]# lltotal 8-rw-r--r-- 1 root root 1928 Nov 10 18:15 192.168.91.156.passwd #說明已經同步過來了-rw-r--r-- 1 root root 0 Nov 10 17:27 3drwxr-xr-x 2 root root 4096 Nov 10 17:27 data客戶端測試刪除[root@salt-client01 data]# rm rf 192.168.91.156.passwd rm: cannot remove `rf': No such file or directoryrm: remove regular file `192.168.91.156.passwd'? y[root@salt-client01 data]# lltotal 0-rw-r--r-- 1 root root 0 Nov 10 17:27 3[root@salt-client01 data]#服務器端:[root@salt-master data]# lltotal 4-rw-r--r-- 1 root root 0 Nov 10 17:27 3 #說明已經刪除掉了drwxr-xr-x 2 root root 4096 Nov 10 17:27 data
4、常見錯誤匯總
錯誤一:@ERROR: auth failed on module xxxxxrsync: connection unexpectedly closed(90 bytes read so far)rsync error: error in rsync protocoldata stream (code 12) at io.c(150)說明:這是因為密碼設置錯了,無法登入成功,檢查一下rsync.pwd,看客服是否匹配。還有服務器端沒啟動rsync 服務也會出現這種情況。 錯誤二:password file must not beother-accessiblecontinuing without password filePassword:說明:這是因為rsyncd.pwdrsyncd.sec的權限不對,應該設置為600。如:chmod600 rsyncd.pwd 錯誤三:@ERROR: chroot failedrsync: connection unexpectedly closed(75 bytes read so far)rsync error: error in rsync protocoldata stream (code 12) at io.c(150)說明:這是因為你在 rsync.conf中設置的 path 路徑不存在,要新建目錄才能開啟同步 錯誤四:rsync: failed to connect to218.107.243.2: No route to host (113)rsync error: error in socket IO (code10) at clientserver.c(104) [receiver=2.6.9]說明:防火墻問題導致,這個最好先徹底關閉防火墻,排錯的基本法就是這樣,無論是S還是C,還有ignore errors選項問題也會導致 錯誤五:@ERROR: access denied to www fromunknown (192.168.1.123)rsync: connection unexpectedly closed(0 bytes received so far) [receiver]rsync error: error in rsync protocoldata stream (code 12) at io.c(359)說明:此問題很明顯,是配置選項hostallow的問題,初學者喜歡一個允許段做成一個配置,然后模塊又是同一個,致使導致 錯誤六:rsync error: received SIGINT,SIGTERM, or SIGHUP (code 20) at rsync.c(244) [generator=2.6.9]rsync error: received SIGUSR1 (code19) at main.c(1182) [receiver=2.6.9]說明:導致此問題多半是服務端服務沒有被正常啟動,到服務器上去查查服務是否有啟動,然后查看下 /var/run/rsync.pid 文件是否存在,最干脆的方法是殺死已經啟動了服務,然后再次啟動服務或者讓腳本加入系統啟動服務級別然后shutdown -r now服務器錯誤七:rsync: read error: Connection resetby peer (104)rsync error: error in rsync protocoldata stream (code 12) at io.c(604) [sender=2.6.9]說明:原數據目錄里沒有數據存在
以上就是本文的全部內容,希望對大家的學習有所幫助,也希望大家多多支持VEVB武林網。
新聞熱點
疑難解答
圖片精選