puppet使用rsync模块同步目录和文件

puppet使用rsync模块同步目录和文件 2013-09-23 14:28:57

分类： LINUX

环境说明：

OS :    CentOS5.4                         i686
puppet版本: 2.7.14
puppetmaster.manzuoinfo.com            192.168.0.12
puppet1.manzuoinfo.com           192.168.0.64
rsync server 192.168.0.12

同步需求简介：

需要把 rsync server 192.168.0.12 上的 /tmp/default 和 /tmp/test 目录分别同步到 puppet1.manzuinfo.com 192.168.0.12 上的 /tmp/test1 下和/tmp/test。

点击(此处)折叠或打开

[root@puppetmaster test]# cd /tmp/
[root@puppetmaster tmp]# ls
default test
[root@puppetmaster tmp]# cd test
/tmp/test
[root@puppetmaster test]# ls -l
total 4
-rw-r--r-- 1 root root 0 Sep 22 17:32 10.txt
-rw-r--r-- 1 root root 0 Sep 22 17:32 1.txt
-rw-r--r-- 1 root root 0 Sep 22 17:32 2.txt
-rw-r--r-- 1 root root 0 Sep 22 17:32 3.txt
-rw-r--r-- 1 root root 0 Sep 22 17:32 4.txt
-rw-r--r-- 1 root root 0 Sep 22 17:32 5.txt
-rw-r--r-- 1 root root 0 Sep 22 17:32 6.txt
-rw-r--r-- 1 root root 0 Sep 22 17:32 7.txt
-rw-r--r-- 1 root root 0 Sep 22 17:32 8.txt
-rw-r--r-- 1 root root 0 Sep 22 17:32 9.txt
-rw-r--r-- 1 root root 17 Sep 22 17:32 test.txt
[root@puppetmaster default]# pwd
/tmp/default
[root@puppetmaster default]# ls
de.txt

一、下载安装rsync 模块

puppet 的rsync 模块在GitHub位置 https://github.com/onyxpoint/pupmod-rsync ，大家可以上去查看。

点击(此处)折叠或打开

[root@puppetmaster ~]# cd /etc/puppet/modules/
[root@puppetmaster modules]# git clone https://github.com/onyxpoint/pupmod-concat && mv pupmod-concat concat
[root@puppetmaster modules]# git clone https://github.com/onyxpoint/pupmod-rsync && mv pupmod-rsync rsync

说明:我这里是使用git,如果机器没有安装,可以使用yum -y install git 来安装,如不想安装git可以下载zip压缩包.解压到相应目录.
注意：在server, clent 端都下载安装concat 和rsync 模块。

二、服务端配置文件

1). 新建node.pp

点击(此处)折叠或打开

[root@puppetmaster manifests]# pwd
/etc/puppet/manifests
[root@puppetmaster manifests]# cat node.pp
node 'puppetmaster.manzuoinfo.com' {
include 'rsync::server'
rsync::server::global { 'global':
address => '192.168.0.12'
}
rsync::server::section { 'default':
comment => 'The default file path',
path => '/tmp/default',
hosts_allow => '192.168.0.64'
}
rsync::server::section { 'test':
# auth_users => 'testuser',
comment => 'Test comment',
path => '/tmp/test',
hosts_allow => '192.168.0.64',
outgoing_chmod => 'o-w'
}
}
node 'puppet1.manzuoinfo.com' {
include 'rsync'
}

2). 新建modules.pp 载入rsync 模块

点击(此处)折叠或打开

[root@puppetmaster manifests]# pwd
/etc/puppet/manifests
[root@puppetmaster manifests]# cat modules.pp
import "rsync"

3). 把 node.pp modules.pp 包进site.pp

点击(此处)折叠或打开

[root@puppetmaster test]# cat /etc/puppet/manifests/site.pp
import 'node.pp'
import 'modules.pp'

4). 测试配置文件

点击(此处)折叠或打开

[root@puppetmaster manifests]# puppet agent --server=puppetmaster.manzuoinfo.com --test -v
info: Caching catalog for puppetmaster.manzuoinfo.com
info: /Stage[main]/Rsync/Tidy[/etc/rsync]: File does not exist
info: Applying configuration version '1379830750'
notice: /Stage[main]/Rsync/File[/etc/rsync]/ensure: created
notice: /Stage[main]//Node[puppetmaster.manzuoinfo.com]/Rsync::Server::Section[default]/Concat_fragment[rsync+default.section]/content: content changed '' to '[default]
comment = The default file path
path = /home/sky
use chroot = false
max connections = 0
max verbosity = 1
lock file = /var/run/rsyncd.lock
read only = true
write only = false
list = false
uid = root
gid = root
outgoing chmod = o-w
ignore nonreadable = true
transfer logging = true
log format = "%o %h [%a] %m (%u) %f %l"
dont compress = *.gz *.tgz *.zip *.z *.rpm *.deb *.iso *.bz2 *.tbz *.rar *.jar *.pdf *.sar *.war
hosts allow = 192.168.0.64
hosts deny = *
'
notice: /Stage[main]//Node[puppetmaster.manzuoinfo.com]/Rsync::Server::Global[global]/Concat_fragment[rsync+global]/content: content changed '' to 'pid file = /var/run/rsyncd.pid
syslog facility = daemon
port = 873
address = 192.168.0.12
'
notice: /Stage[main]//Node[puppetmaster.manzuoinfo.com]/Rsync::Server::Section[test]/Concat_fragment[rsync+test.section]/content: content changed '' to '[test]
comment = Test comment
path = /home/skywu
use chroot = false
max connections = 0
max verbosity = 1
lock file = /var/run/rsyncd.lock
read only = true
write only = false
list = false
uid = root
gid = root
outgoing chmod = o-w
ignore nonreadable = true
transfer logging = true
log format = "%o %h [%a] %m (%u) %f %l"
dont compress = *.gz *.tgz *.zip *.z *.rpm *.deb *.iso *.bz2 *.tbz *.rar *.jar *.pdf *.sar *.war
hosts allow = 192.168.0.64
hosts deny = *
'
notice: /Stage[main]/Rsync::Server/Concat_build[rsync]/target: global*.section used for ordering
notice: /Stage[main]/Rsync::Server/File[/etc/rsyncd.conf]/mode: mode changed '0644' to '0400'
notice: /Stage[main]/Rsync::Server/File[/etc/rsyncd.conf]/content: audit change: newly-recorded value {md5}2148062cf8d2f7220279fd0ca07b9329
info: /Stage[main]/Rsync::Server/File[/etc/rsyncd.conf]: Scheduling refresh of Service[rsync]
notice: /Stage[main]/Rsync::Server/Service[rsync]/ensure: ensure changed 'stopped' to 'running'
err: /Stage[main]/Rsync::Server/Service[rsync]: Failed to call refresh: Could not stop Service[rsync]: Execution of '/bin/kill `cat \`grep "pid file" /etc/rsyncd.conf | cut -f4 -d' '\``' returned 1: at /etc/puppet/modules/rsync/manifests/server.pp:56
info: Creating state file /var/lib/puppet/state/state.yaml
notice: Finished catalog run in 2.70 seconds
[root@puppetmaster manifests]#

注意：err: 这里出现了一个错误，请根据自己的情况来修改停止rsync,例如:
stop => "ps -ef | grep [r]sync |awk '{print $2}'|xargs kill -9",

5). 在server 端生成rsync配置

点击(此处)折叠或打开

[root@puppetmaster manifests]# puppetd --test --server puppetmaster.manzuoinfo.com
info: Caching catalog for puppetmaster.manzuoinfo.com
notice: /Stage[main]/Rsync/Tidy[/etc/rsync]: Tidying File[/etc/rsync]
info: /File[/etc/rsync]: Duplicate generated resource; skipping
info: Applying configuration version '1379837152'
notice: /Stage[main]//Node[puppetmaster.manzuoinfo.com]/Rsync::Server::Section[default]/Concat_fragment[rsync+default.section]/content: content changed '[default]
comment = The default file path
path = /home/sky
use chroot = false
max connections = 0
max verbosity = 1
lock file = /var/run/rsyncd.lock
read only = true
write only = false
list = false
uid = root
gid = root
outgoing chmod = o-w
ignore nonreadable = true
transfer logging = true
log format = "%o %h [%a] %m (%u) %f %l"
dont compress = *.gz *.tgz *.zip *.z *.rpm *.deb *.iso *.bz2 *.tbz *.rar *.jar *.pdf *.sar *.war
hosts allow = 192.168.0.64
hosts deny = *
' to '[default]
comment = The default file path
path = /tmp/default
use chroot = false
max connections = 0
max verbosity = 1
lock file = /var/run/rsyncd.lock
read only = true
write only = false
list = false
uid = root
gid = root
outgoing chmod = o-w
ignore nonreadable = true
transfer logging = true
log format = "%o %h [%a] %m (%u) %f %l"
dont compress = *.gz *.tgz *.zip *.z *.rpm *.deb *.iso *.bz2 *.tbz *.rar *.jar *.pdf *.sar *.war
hosts allow = 192.168.0.64
hosts deny = *
'
notice: /Stage[main]//Node[puppetmaster.manzuoinfo.com]/Rsync::Server::Section[test]/Concat_fragment[rsync+test.section]/content: content changed '[test]
comment = Test comment
path = /home/skywu
use chroot = false
max connections = 0
max verbosity = 1
lock file = /var/run/rsyncd.lock
read only = true
write only = false
list = false
uid = root
gid = root
outgoing chmod = o-w
ignore nonreadable = true
transfer logging = true
log format = "%o %h [%a] %m (%u) %f %l"
dont compress = *.gz *.tgz *.zip *.z *.rpm *.deb *.iso *.bz2 *.tbz *.rar *.jar *.pdf *.sar *.war
hosts allow = 192.168.0.64
hosts deny = *
' to '[test]
comment = Test comment
path = /tmp/test
use chroot = false
max connections = 0
max verbosity = 1
lock file = /var/run/rsyncd.lock
read only = true
write only = false
list = false
uid = root
gid = root
outgoing chmod = o-w
ignore nonreadable = true
transfer logging = true
log format = "%o %h [%a] %m (%u) %f %l"
dont compress = *.gz *.tgz *.zip *.z *.rpm *.deb *.iso *.bz2 *.tbz *.rar *.jar *.pdf *.sar *.war
hosts allow = 192.168.0.64
hosts deny = *
'
notice: /Stage[main]/Rsync::Server/Concat_build[rsync]/target: global*.section used for ordering
notice: /Stage[main]/Rsync::Server/File[/etc/rsyncd.conf]/mode: mode changed '0644' to '0400'
notice: /Stage[main]/Rsync::Server/File[/etc/rsyncd.conf]/content: audit change: previously recorded value {md5}2148062cf8d2f7220279fd0ca07b9329 has been changed to {md5}8063eb4c3129b055fb0106eb2cfd7912
info: /Stage[main]/Rsync::Server/File[/etc/rsyncd.conf]: Scheduling refresh of Service[rsync]
info: /Stage[main]/Rsync::Server/File[/etc/rsyncd.conf]: Scheduling refresh of Service[rsync]
notice: /Stage[main]/Rsync::Server/Service[rsync]/ensure: ensure changed 'stopped' to 'running'
notice: /Stage[main]/Rsync::Server/Service[rsync]: Triggered 'refresh' from 2 events
notice: Finished catalog run in 3.66 seconds

注意：/etc/rsyncd.conf 是生成的，而不是手动创建的。

内容如下：

点击(此处)折叠或打开

[root@puppetmaster manifests]# cat /etc/rsyncd.conf
pid file = /var/run/rsyncd.pid
syslog facility = daemon
port = 873
address = 192.168.0.12
[default]
comment = The default file path
path = /tmp/default
use chroot = false
max connections = 0
max verbosity = 1
lock file = /var/run/rsyncd.lock
read only = true
write only = false
list = false
uid = root
gid = root
outgoing chmod = o-w
ignore nonreadable = true
transfer logging = true
log format = "%o %h [%a] %m (%u) %f %l"
dont compress = *.gz *.tgz *.zip *.z *.rpm *.deb *.iso *.bz2 *.tbz *.rar *.jar *.pdf *.sar *.war
hosts allow = 192.168.0.64
hosts deny = *
[test]
comment = Test comment
path = /tmp/test
use chroot = false
max connections = 0
max verbosity = 1
lock file = /var/run/rsyncd.lock
read only = true
write only = false
list = false
uid = root
gid = root
outgoing chmod = o-w
ignore nonreadable = true
transfer logging = true
log format = "%o %h [%a] %m (%u) %f %l"
dont compress = *.gz *.tgz *.zip *.z *.rpm *.deb *.iso *.bz2 *.tbz *.rar *.jar *.pdf *.sar *.war
hosts allow = 192.168.0.64
hosts deny = *
[root@puppetmaster manifests]#

6). 启动rsync 服务

点击(此处)折叠或打开

[root@puppetmaster manifests]# /etc/init.d/xinetd restart
Stopping xinetd: [ OK ]
Starting xinetd: [ OK ]
[root@puppetmaster manifests]# ps -ef | grep rsync
root 13227 1 0 16:16 ? 00:00:00 /usr/bin/rsync --daemon --config=/etc/rsyncd.conf
root 13266 3142 0 16:19 pts/0 00:00:00 grep rsync

7). 客户端需要执行rsync类中,我们编辑puppetmaster上的代码文件,添加default 和test。

点击(此处)折叠或打开

[root@puppetmaster manifests]# vim /etc/puppet/modules/rsync/manifests/init.pp
class rsync {
package { "rsync": ensure => "latest" }
# This define provides a useful abstraction for common rsync client side
# activities.
exec { "rsync_stub":
command => "/bin/true",
refreshonly => true
}
file { '/etc/rsync':
ensure => 'directory',
owner => 'root',
group => 'root',
mode => '750'
}
tidy { '/etc/rsync':
size => "0b",
recurse => 'true',
rmdirs => 'true'
}
rsync { 'default':
source => 'default',
target => '/tmp/test1',
server => '192.168.0.12'
}
rsync { 'test':
source => 'test',
target => '/tmp/test',
server => '192.168.0.12'
}
}

三、puppet1 客户端测试

点击(此处)折叠或打开

[root@puppet1 tmp]# puppetd --test --server puppetmaster.manzuoinfo.com
info: Caching catalog for puppet1.manzuoinfo.com
notice: /Stage[main]/Rsync/Tidy[/etc/rsync]: Tidying File[/etc/rsync]
info: /File[/etc/rsync]: Duplicate generated resource; skipping
info: Applying configuration version '1379841152'
notice: /Stage[main]/Rsync/Rsync[test]/do: executed successfully
notice: Finished catalog run in 0.75 seconds
或者用命令：
[root@puppet1 tmp]# puppet agent --test --server puppetmaster.manzuoinfo.com

点击(此处)折叠或打开

[root@puppet1 test1]# pwd
/tmp/test1
[root@puppet1 test1]# ls
de.txt
[root@puppet1 test]# pwd
/tmp/test
[root@puppet1 test]# ls -l
total 4
-rw-r--r-- 1 root root 0 Sep 23 11:42 10.txt
-rw-r--r-- 1 root root 0 Sep 23 11:42 1.txt
-rw-r--r-- 1 root root 0 Sep 23 11:42 2.txt
-rw-r--r-- 1 root root 0 Sep 23 11:42 3.txt
-rw-r--r-- 1 root root 0 Sep 23 11:42 4.txt
-rw-r--r-- 1 root root 0 Sep 23 11:42 5.txt
-rw-r--r-- 1 root root 0 Sep 23 11:42 6.txt
-rw-r--r-- 1 root root 0 Sep 23 11:42 7.txt
-rw-r--r-- 1 root root 0 Sep 23 11:42 8.txt
-rw-r--r-- 1 root root 0 Sep 23 11:42 9.txt
-rw-r--r-- 1 root root 17 Sep 23 11:42 test.txt

在客户端查看/tmp/test 和 /tmp/test1 目录及文件已经同步过来了。

puppet使用rsync模块同步目录和文件的更多相关文章

puppet使用rsync模块
puppet使用rsync模块同步目录和文件环境说明: OS : CentOS5.4 i686puppet版本: ...
rsync 排除指定目录或文件进行同步
很常见的情况:我想同步/myweb下的一些php文件 , 但是不想复制/myweb/log/里边的一些日志文件,因为这些文件太大了,备份也是没有意义的. 现在如果想避开某个路径直接添加—exc ...
使用rsync, 向另外一台服务器同步目录和文件的脚本
#!/bin/bash #亚特兰蒂斯-同步目录#定时任务ini_file="/usr/local/sunlight/conf/rsync-file.ini"target_ip=&q ...
Linux同步目录保留文件修改时间和权限 rsync
scp copy文件夹的时候,会强行覆盖文件,导致增量同步的时候不方便,而rsync则能很好解决这个问题. rsync -avz ubuntu@192.168.1.208:/home/ubuntu/m ...
记一次rsync增量同步远程服务器文件
rsync remote shell 增量方式同步数据 rsync同步文件有两种方式,一种是daemon的方式(rsync daemon)另一种方式是通过远程shell方式(rsync remote ...
rsync用于同步目录
rsync是unix/linux下同步文件的一个高效算法,它能同步更新两处计算机的文件与目录,并适当利用查找文件中的不同块以减少数据传输.rsync中一项与其他大部分类似程序或协定中所未见的重要特性是 ...
类unix系统同步目录,却不同步目录中文件
rsync -av --del -f '+ */' -f '- *' src/ dst/;用此条命令即可同步同主机间不同目录到一个位置,或是同步道不同主机同位置. 或是用以下命令: ssh 10.18 ...
Python shutil模块（目录和文件操作）
import shutil #导入shutil模块 copyfileobj方法将类文件对象fsrc的内容复制到类文件对象fdst shutil.copyfileobj(fsrc, fdst[, le ...
Linux实战教学笔记21:Rsync数据同步工具
第二十一节 Rsync数据同步工具标签(空格分隔): Linux实战教学笔记-陈思齐 ---本教学笔记是本人学习和工作生涯中的摘记整理而成,此为初稿(尚有诸多不完善之处),为原创作品,允许转载,转载 ...

随机推荐

【AMAD】tenacity -- Python中一个专门用来retry的库
动机简介用法基本用法何时停止尝试间的等待何时retry 其它热度分析源码分析个人评分动机很多时候,我们都喜欢为代码加入retry功能.比如oauth验证,有时候网络不太灵,我们希 ...
给Date的构造函数添加属性和方法
let d = Date.prototype; Object.defineProperties(d, { 'year': { get: function () { return this.getFul ...
stm32 F40x CCM数据区的使用
1. CCM需要打开总线时钟 2. CCM可以作为堆和栈使用使用分散加载文件直接操作即可 RW_CCMRAM1 0x10000000 { .ANY (HEAP) .ANY (STACK) } 3. ...
Linux基础命令---间歇执行命令---watch
[watch] watch指令可以间歇性的执行程序,将输出结果以全屏的方式显示,默认是2s执行一次. watch指令下发后,将会一直被执行,直到被中断. [语法] watch \ [-d h v t] ...
PTA(Basic Level)1046.划拳
划拳是古老中国酒文化的一个有趣的组成部分.酒桌上两人划拳的方法为:每人口中喊出一个数字,同时用手比划出一个数字.如果谁比划出的数字正好等于两人喊出的数字之和,谁就赢了,输家罚一杯酒.两人同赢或两人同输 ...
Python学习【day05】- Python文件处理
一.打开文件对文件的操作主要为三步:1.打开文件,得到文件句柄.2.通过句柄对文件进行操作.3.关闭文件 # 默认打开模式为r,encoding默认为系统文件编码 f=open('F:/Go.txt ...
java this的作用
this: 区分成员变量和局部变量的重名问题,this.name指的是类中的成员变量,而不是方法内部的
Python 入门之 print带颜色输出
Python 入门之 print带颜色输出 1.print带颜色输出书写格式: 开头部分: \033[显示方式; 前景色 ; 背景色 m 结尾部分: \033[0m 详解: 开头部分的三个参数: 显 ...
python中的并发执行
一. Gevent实例 import gevent import requests from gevent import monkey # socket发送请求以后就会进入等待状态,gevent更改了 ...
如何利用 CSS 的动画原理，创作一个乒乓球对打动画
效果预览在线演示按下右侧的"点击预览"按钮可以在当前页面预览,点击链接可以全屏预览. https://codepen.io/comehope/pen/rvgLzK 可交互视频教 ...

puppet使用rsync模块同步目录和文件

puppet使用rsync模块同步目录和文件的更多相关文章

随机推荐

热门专题