[转帖]clickHouse单机模式安装部署（RPM安装）

关于版本和系统的选择

操作系统：Centos-7
ClickHouse: rpm 在安装，20.x

安装前的准备

CentOS7 打开文件数限

在 /etc/security/limits.conf 这个文件的末尾加入一下内容：

[hadoop@hadoop001 ~]$ sudo vim /etc/security/limits.conf






* soft nofile 65536





* hard nofile 65536





* soft nproc 131072





* hard nproc 131072

/etc/security/limits.d/20-nproc.conf （centos6 是90-nproc.conf）这个文件的末尾加入一下内容：

[hadoop@hadoop001 ~]$ sudo vim /etc/security/limits.d/20-nproc.conf






* soft nofile 65536





* hard nofile 65536





* soft nproc 131072





* hard nproc 131072

重启服务器之后生效，用 ulimit -n 或者 ulimit -a 查看设置结果






ulimit -n





ulimit -a






[hadoop@hadoop001 ~]$ ulimit -n





65536





[hadoop@hadoop001 ~]$ ulimit -a





core file size          (blocks, -c) 0





data seg size           (kbytes, -d) unlimited





scheduling priority             (-e) 0





file size               (blocks, -f) unlimited





pending signals                 (-i) 14994





max locked memory       (kbytes, -l) 64





max memory size         (kbytes, -m) unlimited





open files                      (-n) 65536





pipe size            (512 bytes, -p) 8





POSIX message queues     (bytes, -q) 819200





real-time priority              (-r) 0





stack size              (kbytes, -s) 8192





cpu time               (seconds, -t) unlimited





max user processes              (-u) 131072





virtual memory          (kbytes, -v) unlimited





file locks                      (-x) unlimited

CentOS7 取消 SELINUX

修改 /etc/selinux/config 中的 SELINUX=disabled 后重启

[hadoop@hadoop001 ~]$ sudo vim /etc/selinux/config

SELINUX=disabled

关闭防火墙






[hadoop@hadoop001 ~]$ sudo systemctl stop firewalld.service





[hadoop@hadoop001 ~]$ sudo systemctl disable firewalld.servie





[hadoop@hadoop001 ~]$ sudo systemctl status firewalld.service





● firewalld.service - firewalld - dynamic firewall daemon





   Loaded: loaded (/usr/lib/systemd/system/firewalld.service; disabled; vendor preset: enabled)





   Active: inactive (dead)





     Docs: man:firewalld(1)





[hadoop@hadoop001 ~]$

安装依赖






[hadoop@hadoop001 ~]$ sudo yum install -y libtool





[hadoop@hadoop001 ~]$ sudo yum install -y *unixODBC*

安装

官网：https://clickhouse.yandex/
具体安装细节看：https://clickhouse.tech/#quick-start

先检查是否已经安装clickhouse，如果已经安装，先卸载 clickhouse
查询是否安装 clickhouse：

[hadoop@hadoop001 software]rpm -qa | grep clickhouse

卸载 clickhouse：






[hadoop@hadoop001 software]rpm -e --nodeps clickhouse-client-20.1.4.14-2.noarch





[hadoop@hadoop001 software]rpm -e --nodeps clickhouse-server-20.1.4.14-2.noarch





[hadoop@hadoop001 software]rpm -e --nodeps clickhouse-common-static-20.1.4.14-2-2.x86_64

删除数据目录：

[hadoop@hadoop001 software]rm -rf /var/lib/clickhouse

删除集群配置文件：

[hadoop@hadoop001 software]rm -rf /etc/metrika.xml

删除集群配置文件：

[hadoop@hadoop001 software]rm -rf /etc/metrika.xml

删除配置文件：

[hadoop@hadoop001 software]rm -rf /etc/clickhouse-*

删除日志文件：

[hadoop@hadoop001 software]rm -rf /var/log/clickhouse-server

删除 zookeeper 上 clickhouse 的数据：

rmr /clickhouse

也可以进行全局寻找，然后执行删除操作

[hadoop@hadoop001 software]find / -name 'clickhouse'

单机模式

ClickHouse的安装可以使用 yum在线安装，也可以使用 rpm 离线安装的方式！
具体信息见官网文档：https://clickhouse.tech/#quick-start

准备操作

需要验证当前服务器的 CPU 是否支持 SSE 4.2 指令集，因为向量化执行需要用到这项特性：






[hadoop@hadoop001 clickhouse]$ grep -q sse4_2 /proc/cpuinfo && echo "SSE 4.2 supported" || echo "SSE 4.2 not supported"





SSE 4.2 supported

安装

依次执行如下命令：






[hadoop@hadoop001 clickhouse]$ sudo yum install yum-utils -y





[hadoop@hadoop001 clickhouse]$ sudo rpm --import https://repo.clickhouse.tech/CLICKHOUSE-KEY.GPG





[hadoop@hadoop001 clickhouse]$ yum-config-manager --add-repo ttps://repo.clickhouse.tech/rpm/clickhouse.repo





[hadoop@hadoop001 clickhouse]$ yum install clickhouse-server clickhouse-client -y

如果您没法链接互联网，则也可以使用 rpm 的方式来进行离线安装（下载地址在：https://repo.yandex.ru/clickhouse/rpm/stable/x86_64/https://packagecloud.io/Altinity/clickhouse）需要下载的安装包有：






[hadoop@hadoop001 clickhouse]$ ll





total 1212764





-rw-r--r-- 1 hadoop hadoop     120430 Nov  5 18:20 clickhouse-client-20.1.4.14-2.noarch.rpm





-rw-r--r-- 1 hadoop hadoop  113426346 Nov  5 18:23 clickhouse-common-static-20.1.4.14-2.x86_64.rpm





-rw-r--r-- 1 hadoop hadoop 1128177078 Nov  6 09:18 clickhouse-common-static-dbg-20.1.4.14-2.x86_64.rpm





-rw-r--r-- 1 hadoop hadoop     141391 Nov  5 18:20 clickhouse-server-20.1.4.14-2.noarch.rpm

rpm安装






[hadoop@hadoop001 clickhouse]$ sudo rpm -ivh *.rpm





warning: clickhouse-client-20.1.4.14-2.noarch.rpm: Header V4 RSA/SHA1 Signature, key ID e0c56bd4: NOKEY





Preparing...                          ################################# [100%]





Updating / installing...





   1:clickhouse-common-static-20.1.4.1################################# [ 25%]





   2:clickhouse-client-20.1.4.14-2    ################################# [ 50%]





   3:clickhouse-server-20.1.4.14-2    ################################# [ 75%]





Created symlink from /etc/systemd/system/multi-user.target.wants/clickhouse-server.service to /etc/systemd/system/clickhouse-server.service.





Path to data directory in /etc/clickhouse-server/config.xml: /var/lib/clickhouse/





   4:clickhouse-common-static-dbg-20.1################################# [100%]

启动服务端

前段启动：

sudo -u clickhouse clickhouse-server --config-file=/etc/clickhouse-server/config.xml

后端启动

nohup sudo -u clickhouse clickhouse-server --config-file=/etc/clickhouse-server/config.xml 1>/tmp/clickhouse/clickhouse_std.log 2>/tmp/clickhouse/clickhouse_err.log &

验证测试






[root@hadoop001 ~]# ps aux | grep clickhouse





clickho+  2955  0.1  3.1 2425796 122628 ?      Ssl  00:55   0:01 /usr/bin/clickhouse-server --config=/etc/clickhouse-server/config.xml --pid-file=/run/clickhouse-server/clickhouse-server.pid





root      3347  0.0  0.0 112704   980 pts/1    S+   01:08   0:00 grep --color=auto clickhouse





[root@hadoop001 ~]# netstat -ntlp | grep clickhouse





tcp6       0      0 :::8123                 :::*                    LISTEN      3966/clickhouse-ser 





tcp6       0      0 :::9000                 :::*                    LISTEN      3966/clickhouse-ser 





tcp6       0      0 :::9009                 :::*                    LISTEN      3966/clickhouse-ser 





[root@hadoop001 ~]# clickhouse-client





ClickHouse client version 20.1.4.14 (official build).





Connecting to localhost:9000 as user default.





Connected to ClickHouse server version 20.1.4 revision 54431.





 





hadoop001 :) show databases;





 





SHOW DATABASES





 





┌─name────┐





│ default │





│ system  │





└─────────┘





 





2 rows in set. Elapsed: 0.012 sec. 





 





hadoop001 :) create database test;





 





CREATE DATABASE test





 





Ok.





 





hadoop001 :) insert into test01 values (1, 'Russia'), (2, 'clickhouse'), (3, 'spark');





 





INSERT INTO test01 VALUES





 





Ok.





 





3 rows in set. Elapsed: 0.003 sec. 





 





hadoop001 :) select id, name from test01;





 





SELECT 





    id, 





    name





FROM test01





 





┌─id─┬─name───────┐





│  1 │ Russia     │





│  2 │ clickhouse │





│  3 │ spark      │





└────┴────────────┘





 





3 rows in set. Elapsed: 0.012 sec. 





 





hadoop001 :) 





 





 





0 rows in set. Elapsed: 0.002 sec.

问题汇总

问题一：启动报错

启动参数:sudo clickhouse-server --config-file=/etc/clickhouse-server/config.xml

2020.08.20 18:49:28.189321 [ 29338 ] {} <Error> Application: DB::Exception: Effective user of the process (root) does not match the owner of the data (clickhouse). Run under 'sudo -u clickhouse'

解决办法,已经有了提示,Run under ‘sudo -u clickhouse’.
修改后启动参数: sudo -u clickhouse clickhouse-server --config-file=/etc/clickhouse-server/config.xml

问题二：clickhouse-clict 连接失败






[root@hadoop001 ~]# clickhouse-client





ClickHouse client version 20.1.4.14 (official build).





Connecting to localhost:9000 as user default.





Code: 210. DB::NetException: Connection refused (localhost:9000)

[root@hadoop001 clickhouse]# vim /etc/clickhouse-server/config.xml

打开此处注释

</article>