分布式文件系统FastDFS安装与配置(单机)

安装包如下：
fastdfs-nginx-module_v1.16.tar.gz
FastDFS_v5.05.tar.gz
libfastcommon-master.zip
nginx-1.8.0.tar.gz

一、安装libfastcommon

FastDFS 5.05版本不再依赖libevent，而依赖于libfastcommon，因此需要先安装libfastcommon。
软件包下载地址：https://github.com/happyfish100/libfastcommon

# unzip libfastcommon-master.zip
# cd libfastcommon-master
# ./make.sh
# ./make.sh install

libfastcommon.so 默认安装到了/usr/lib64/libfastcommon.so，而FastDFS主程序设置的lib目录是/usr/local/lib，因此需要设置软链接（如果已存在，可以忽略）。

# ln -s /usr/lib64/libfastcommon.so /usr/local/lib/libfastcommon.so
# ln -s /usr/lib64/libfastcommon.so /usr/lib/libfastcommon.so

二、安装FastDFS

软件包下载地址：
1、https://sourceforge.net/projects/fastdfs/files/
2、https://code.google.com/archive/p/fastdfs/downloads
3、https://github.com/happyfish100/fastdfs

# tar zxf FastDFS_v5..tar.gz
# cd FastDFS
# ./make.sh
# ./make.sh install

安装完成后可以看到/etc/fdfs目录下生成了3个文件：

三、配置tracker节点

# mkdir /data/fastdfs  #创建tracker的数据文件和日志存储目录
# cd /etc/fdfs
# mv tracker.conf.sample tracker.conf
# vim tracker.conf #修改的文件内容如下（基础配置，不考虑性能调优情况下）：
base_path=/data/fastdfs  #设置 tracker 的数据文件和日志目录（需预先创建）
http.server_port=  #设置http端口号，默认为8080

# ln -s /usr/bin/fdfs_trackerd /usr/local/bin
# ln -s /usr/bin/stop.sh /usr/local/bin
# ln -s /usr/bin/restart.sh /usr/local/bin
# service fdfs_trackerd start  #启动tracker节点

启动成功后，在/data/fastdfs目录下生成了data和logs两个目录。
查看日志如下：

检查对应端口是否监听：

四、配置storage节点

# mkdir /data/fastdfs-storage  #创建
# cd /etc/fdfs/
# mv storage.conf.sample storage.conf
# vim storage.conf#修改的文件内容如下（基础配置，不考虑性能调优情况下）：
group_name=group1   #组名，可根据实际情况修改
base_path=/data/fastdfs-storage #设置storage数据文件和日志目录，需预先创建
store_path_count=  #存储路径个数，需要和 store_path 个数匹配、
store_path0=/data/fastdfs-storage #存储路径
tracker_server=192.168.116.145: # #tracker 服务器的 IP地址和端口号，如果是单机搭建，IP不要写127.0.0.，否则启动不成功。
http.server_port=  #设置 http 端口号

# ln -s /usr/bin/fdfs_storaged /usr/local/bin
# service fdfs_storaged start #启动storage，启动会根据配置文件的设置自动创建多级存储目录

查看日志，内容如下，表示启动正常：

# cat /data/fastdfs-storage/logs/storaged.log
[-- ::] INFO - FastDFS v5., base_path=/data/fastdfs-storage, store_path_count=, subdir_count_per_path=, group_name=group1, run_by_group=, run_by_user=, connect_timeout=30s, network_timeout=60s, port=, bind_addr=, client_bind=, max_connections=, accept_threads=, work_threads=, disk_rw_separated=, disk_reader_threads=, disk_writer_threads=, buff_size=256KB, heart_beat_interval=30s, stat_report_interval=60s, tracker_server_count=, sync_wait_msec=50ms, sync_interval=0ms, sync_start_time=:, sync_end_time=:, write_mark_file_freq=, allow_ip_count=-, file_distribute_path_mode=, file_distribute_rotate_count=, fsync_after_written_bytes=, sync_log_buff_interval=10s, sync_binlog_buff_interval=10s, sync_stat_file_interval=300s, thread_stack_size= KB, upload_priority=, if_alias_prefix=, check_file_duplicate=, file_signature_method=hash, FDHT group count=, FDHTserver count=, FDHT key_namespace=, FDHT keep_alive=, HTTP server port=, domain name=, use_access_log=, rotate_access_log=, access_log_rotate_time=:, rotate_error_log=, error_log_rotate_time=:, rotate_access_log_size=, rotate_error_log_size=, log_file_keep_days=, file_sync_skip_invalid_record=, use_connection_pool=, g_connection_pool_max_idle_time=3600s
data path: /data/fastdfs-storage/data, mkdir sub dir...
mkdir data path:  ...
mkdir data path:  ...
mkdir data path:  ...
mkdir data path:  ...
。。。。。
data path: /data/fastdfs-storage/data, mkdir sub dir done.

确认启动成功后，可以运行 fdfs_monitor 查看 storage服务器是否已经登记到 tracker服务器。
# /usr/bin/fdfs_monitor /etc/fdfs/storage.conf
[-- ::] DEBUG - base_path=/data/fastdfs-storage, connect_timeout=, network_timeout=, tracker_server_count=, anti_steal_token=, anti_steal_secret_key length=, use_connection_pool=, g_connection_pool_max_idle_time=3600s, use_storage_id=, storage server id count: 

server_count=, server_index=

tracker server is 192.168.116.145:

group count: 

Group :
group name = group1
disk total space =  MB
disk free space =  MB
trunk free space =  MB
storage server count =
active server count =
storage server port =
storage HTTP port =
store path count =
subdir count per path =
current write server index =
current trunk file id = 

     Storage :
          id = 192.168.116.145
          ip_addr = 192.168.116.145  ACTIVE
          http domain =
          version = 5.05
          join time = -- ::
          up time = -- ::
          total storage =  MB
          free storage =  MB
          upload priority =
          store_path_count =
          subdir_count_per_path =
          storage_port =
          storage_http_port =
          current_write_path =
          source storage id =
          if_trunk_server =
          connection.alloc_count =
          connection.current_count =
          connection.max_count =
          total_upload_count =
          success_upload_count =
          total_append_count =
          success_append_count =
          total_modify_count =
          success_modify_count =
          total_truncate_count =
          success_truncate_count =
          total_set_meta_count =
          success_set_meta_count =
          total_delete_count =
          success_delete_count =
          total_download_count =
          success_download_count =
          total_get_meta_count =
          success_get_meta_count =
          total_create_link_count =
          success_create_link_count =
          total_delete_link_count =
          success_delete_link_count =
          total_upload_bytes =
          success_upload_bytes =
          total_append_bytes =
          success_append_bytes =
          total_modify_bytes =
          success_modify_bytes =
          stotal_download_bytes =
          success_download_bytes =
          total_sync_in_bytes =
          success_sync_in_bytes =
          total_sync_out_bytes =
          success_sync_out_bytes =
          total_file_open_count =
          success_file_open_count =
          total_file_read_count =
          success_file_read_count =
          total_file_write_count =
          success_file_write_count =
          last_heart_beat_time = -- ::
          last_source_update = -- ::
          last_sync_update = -- ::
          last_synced_timestamp = -- ::

看到“192.168.116.145  ACTIVE”即可确认 storage 运行正常。

五、给storage安装nginx并配置

主要目的是为了提供 http 的访问服务，同时解决 group 中 storage服务器的同步延迟问题。
nginx需要添加fastdfs-nginx-module模块。
下载地址:http://nchc.dl.sourceforge.net/project/fastdfs/FastDFS%20Nginx%20Module%20Source%20Code/fastdfs-nginx-module_v1.16.tar.gz

# tar zxf fastdfs-nginx-module_v1..tar.gz
# tar zxf nginx-1.8..tar.gz
# cd nginx-1.8.
# ./configure --prefix=/data/nginx --add-module=/data/soft/fastdfs-nginx-module/src
# make
# make install

make时报错如下：

.......
/data/soft/fastdfs-nginx-module/src/ngx_http_fastdfs_module.c:: 错误：‘struct fdfs_http_context’没有名为‘if_modified_since’的成员
/data/soft/fastdfs-nginx-module/src/ngx_http_fastdfs_module.c:: 错误：‘struct fdfs_http_context’没有名为‘if_modified_since’的成员
/data/soft/fastdfs-nginx-module/src/ngx_http_fastdfs_module.c:: 错误：‘struct fdfs_http_context’没有名为‘range’的成员
/data/soft/fastdfs-nginx-module/src/ngx_http_fastdfs_module.c:: 错误：‘struct fdfs_http_context’没有名为‘if_range’的成员
/data/soft/fastdfs-nginx-module/src/ngx_http_fastdfs_module.c:: 错误：‘true’未声明(在此函数内第一次使用)
make[]: *** [objs/addon/src/ngx_http_fastdfs_module.o] 错误
make[]: Leaving directory `/data/soft/nginx-1.8.'
make: *** [build] 错误 

解决办法：
执行以下2条命令，然后重新make

# ln -sv /usr/include/fastcommon /usr/local/include/fastcommon
# ln -sv /usr/include/fastdfs /usr/local/include/fastdfs

拷贝相关文件到/etc/fdfs目录下：

# cp /data/soft/fastdfs-nginx-module/src/mod_fastdfs.conf /etc/fdfs/
# cp /data/soft/FastDFS/conf/mime.types /etc/fdfs/
# cp /data/soft/FastDFS/conf/http.conf /etc/fdfs/
# cp /data/soft/FastDFS/conf/anti-steal.jpg /etc/fdfs/

修改nginx.conf的配置:

listen       ;
location ~/group[-]/M00 {
            root /data/fastdfs-storage/data;
            ngx_fastdfs_module;
        }

修改/etc/fdfs/mod_fastdfs.conf的配置：

base_path=/data/fastdfs-storage  #保存日志目录
tracker_server=192.168.116.145:  #tracker 服务器的 IP 地址以及端口号
url_have_group_name = true #文件 url 中是否有 group 名
store_path0=/data/fastdfs-storage # 存储路径
http.need_find_content_type=true  # 从文件扩展名查找文件类型 （nginx 时 为true）
group_count =   #设置组的个数，事实上这次只使用了group1
在文件末添加如下内容：
[group1]
group_name=group1
storage_server_port=
store_path_count=
store_path0=/data/fastdfs-storage

[group2]
group_name=group2
storage_server_port=
store_path_count=
store_path0=/data/fastdfs-storage

[group3]
group_name=group3
storage_server_port=
store_path_count=
store_path0=/data/fastdfs-storage

建立 M00 至存储目录的符号连接：

# ln -s /data/fastdfs-storage/data /data/fastdfs-storage/data/M00

启动nginx:

# /data/nginx/sbin/nginx

查看nginx的error日志，如果类似下以内容，表明配置成功：

六、给tracker安装nginx并配置

安装路径为：/data/nginx2
安装过程略。
nginx.conf配置如下：

upstream fdfs_group1 {
        server 127.0.0.1:;
    }

location /group1/M00 {
        proxy_pass http://fdfs_group1;
    }

启动nginx:

# /data/nginx2/sbin/nginx

配置客户端文件:

# cd /etc/fdfs/
# mv client.conf.sample client.conf  #修改内容如下：
base_path=/data/fastdfs-storage  #日志存放路径
tracker_server=192.168.116.145:  #tracker 服务器 IP 地址和端口号
http.tracker_server_port=  # tracker 服务器的 http 端口号，必须和tracker的设置对应起来

测试文件上传：

通过上图可以看到文件上传后存储的路径为：group1/M00/00/00/wKh0kVb8xZuAdQGUAAfp5oSKTdo388.jpg

通过nginx访问：