kolla

kolla项目是为了容器化openstack，目标是做到100个节点的开箱即用，所有的组件的HA都具备。kolla是一个革命性的项目，我们以前积累的安装部署经验，全部都报废。使用kolla可以快速部署可扩展，可靠的生产就绪的openstack环境。

基本环境

操作系统：CentOS Linux release 7.2.1511 (Core)
内核版本：3.10.0-327.28.3.el7.x86_64
docker版本：Docker version 1.12.1, build 23cf638

部署kolla

1. 安装依赖

yum install epel-release python-pip
yum install -y python-devel libffi-devel openssl-devel gcc
pip install -U pip

2. 修改docker启动文件

# Create the drop-in unit directory for docker.service
mkdir -p /etc/systemd/system/docker.service.d

# Create the drop-in unit file
tee /etc/systemd/system/docker.service.d/kolla.conf <<-'EOF'
[Service]
MountFlags=shared
EOF

3. 重启docker

systemctl daemon-reload
systemctl restart docker

4. 安装docker的python库

yum install python-docker-py
or
pip install -U docker-py

5. 配置时间同步（此处略）

6. 禁用libvirt

systemctl stop libvirtd.service
systemctl disable libvirtd.service

7. 安装ansible

这里需要注意的是如果安装stable版的kolla需要Ansible < 2.0，master版需要Ansible > 2.0。默认yum安装ansible版本>2.0，因为我要安装stable/mitaka版，所有指定安装版本。

pip install -U ansible==1.9.4

8. 安装stable版kolla

下载源码

git clone https://git.openstack.org/openstack/kolla -b stable/mitaka

安装依赖

pip install -r kolla/requirements.txt -r kolla/test-requirements.txt

源码安装
pip install kolla/

9. 安装tox，生成配置文件

pip install -U tox
cd kolla/
tox -e genconfig
cp -rv etc/kolla /etc/

10. 安装python client

yum install python-openstackclient python-neutronclient

11. 本地docker仓库

all-in-one环境中本地仓库不是必须的这里没有配置

编译镜像

kolla-build

更多的编译选项可以参看：Building Container Images
如果个别镜像编译失败可以重新执行以上操作，因为docker的容器缓存，重新编译会很快
编译成功后生成的镜像如下所示：

# docker images
REPOSITORY                                      TAG                 IMAGE ID            CREATED             SIZE
kolla/centos-binary-heat-engine                 2.0.3               28956cc878d3        20 hours ago        571.4 MB
kolla/centos-binary-heat-api-cfn                2.0.3               d69858fd13fa        20 hours ago        571.4 MB
kolla/centos-binary-heat-api                    2.0.3               90a92ca6b71a        20 hours ago        571.4 MB
kolla/centos-binary-heat-base                   2.0.3               8f1cf8a1f536        21 hours ago        551.6 MB
kolla/centos-binary-neutron-openvswitch-agent   2.0.3               e7d0233ca541        21 hours ago        822.3 MB
kolla/centos-binary-neutron-base                2.0.3               8767569ca9b3        21 hours ago        796.7 MB
kolla/centos-binary-openvswitch-vswitchd        2.0.3               6867586ae335        21 hours ago        330.6 MB
kolla/centos-binary-openvswitch-db-server       2.0.3               3c692f316662        21 hours ago        330.6 MB
kolla/centos-binary-openvswitch-base            2.0.3               c3a263463f8f        21 hours ago        330.6 MB
kolla/centos-binary-cron                        2.0.3               d16d53e85ed9        26 hours ago        317.5 MB
kolla/centos-binary-kolla-toolbox               2.0.3               1fd9634b88ee        26 hours ago        568.4 MB
kolla/centos-binary-heka                        2.0.3               627a3de5e91c        26 hours ago        371.1 MB
kolla/centos-binary-neutron-metadata-agent      2.0.3               aad43ed7a5a1        42 hours ago        796.7 MB
kolla/centos-binary-neutron-server              2.0.3               bc1a7c0ec402        42 hours ago        796.7 MB
kolla/centos-binary-nova-compute                2.0.3               619344ac721b        42 hours ago        1.055 GB
kolla/centos-binary-nova-libvirt                2.0.3               6144729fff5f        42 hours ago        1.106 GB
kolla/centos-binary-neutron-linuxbridge-agent   2.0.3               720c9c5fa63d        42 hours ago        822 MB
kolla/centos-binary-neutron-l3-agent            2.0.3               3a82df7cb9c2        42 hours ago        796.7 MB
kolla/centos-binary-glance-api                  2.0.3               fb67115357d5        42 hours ago        673.8 MB
kolla/centos-binary-neutron-dhcp-agent          2.0.3               8c6fa56497ca        42 hours ago        796.7 MB
kolla/centos-binary-nova-compute-ironic         2.0.3               6f235dc430e5        43 hours ago        1.019 GB
kolla/centos-binary-glance-registry             2.0.3               f4cf7bc1536f        43 hours ago        673.8 MB
kolla/centos-binary-cinder-volume               2.0.3               0197cc13468d        43 hours ago        788.4 MB
kolla/centos-binary-cinder-api                  2.0.3               ed7c623e7364        43 hours ago        800.4 MB
kolla/centos-binary-cinder-rpcbind              2.0.3               75466dc5a3ba        43 hours ago        790.2 MB
kolla/centos-binary-horizon                     2.0.3               92c7ea9fc493        43 hours ago        703.1 MB
kolla/centos-binary-cinder-backup               2.0.3               e3ee19440831        43 hours ago        761.3 MB
kolla/centos-binary-cinder-scheduler            2.0.3               e3ee19440831        43 hours ago        761.3 MB
kolla/centos-binary-nova-consoleauth            2.0.3               96a9638801cd        43 hours ago        609.6 MB
kolla/centos-binary-nova-api                    2.0.3               eff73f704a90        43 hours ago        609.4 MB
kolla/centos-binary-nova-conductor              2.0.3               6016ae01a60d        43 hours ago        609.4 MB
kolla/centos-binary-nova-scheduler              2.0.3               726f100a5533        43 hours ago        609.4 MB
kolla/centos-binary-nova-spicehtml5proxy        2.0.3               c6a1a49e4226        43 hours ago        609.9 MB
kolla/centos-binary-glance-base                 2.0.3               1e4efa0f6701        43 hours ago        673.8 MB
kolla/centos-binary-nova-network                2.0.3               87f6389dd11a        43 hours ago        610.4 MB
kolla/centos-binary-ironic-pxe                  2.0.3               82f25f73c28f        43 hours ago        574.2 MB
kolla/centos-binary-nova-novncproxy             2.0.3               4726875ed228        43 hours ago        610.1 MB
kolla/centos-binary-nova-ssh                    2.0.3               51c70b9e9c47        43 hours ago        610.4 MB
kolla/centos-binary-cinder-base                 2.0.3               7c2d031be713        43 hours ago        761.3 MB
kolla/centos-binary-keystone                    2.0.3               c51a93cc9e2e        43 hours ago        585.2 MB
kolla/centos-binary-ironic-api                  2.0.3               b1771f5cc27f        43 hours ago        570.6 MB
kolla/centos-binary-ironic-inspector            2.0.3               32f4e33e1037        43 hours ago        576.2 MB
kolla/centos-binary-ironic-conductor            2.0.3               d552c64f3a08        43 hours ago        599 MB
kolla/centos-binary-nova-base                   2.0.3               8f077fafc5d8        43 hours ago        588.7 MB
kolla/centos-binary-rabbitmq                    2.0.3               d9e543e4f179        43 hours ago        370.3 MB
kolla/centos-binary-ironic-base                 2.0.3               6c4c453ddbce        43 hours ago        550.8 MB
kolla/centos-binary-openstack-base              2.0.3               cf48d5b3f3ee        43 hours ago        518.2 MB
kolla/centos-binary-mariadb                     2.0.3               cd9b363fe034        43 hours ago        630.5 MB
kolla/centos-binary-memcached                   2.0.3               49c536466427        43 hours ago        354.6 MB
kolla/centos-binary-base                        2.0.3               d04ac1ecd01a        43 hours ago        300 MB
centos                                          latest              980e0e4c79ec        2 days ago          196.7 MB

部署容器

1. 生成密码

openstack环境的密码等变量可以在 /etc/kolla/passwords.yml 中指定，为了方便可以使用kolla-genpwd工具自动生成复杂密码。

kolla-genpwd

为了方便，我们修改其中的管理员登陆密码

vim /etc/kolla/passwords.yml
keystone_admin_password: admin

2. 修改部署配置文件

修改/etc/kolla/globals.yml 文件，指定部署的一些信息

vim /etc/kolla/globals.yml

kolla_base_distro: "centos"
kolla_install_type: "binary"
enable_haproxy: "no"
#kolla_internal_vip_address: "10.10.10.254"
kolla_internal_address: "192.168.2.120"
network_interface: "ens160"
neutron_external_interface: "ens192"
neutron_plugin_agent: "openvswitch"
openstack_logging_debug: "True"

3. 检查配置

kolla-ansible prechecks

4. 开始部署

kolla-ansible deploy

5. 部署成功后查看容器

# docker ps
  CONTAINER ID        IMAGE                                                 COMMAND                  CREATED             STATUS              PORTS               NAMES
  3938136934cf        kolla/centos-binary-horizon:2.0.3                     "kolla_start"            17 hours ago        Up 17 hours                             horizon
  cc68cb8d96e4        kolla/centos-binary-heat-engine:2.0.3                 "kolla_start"            17 hours ago        Up 17 hours                             heat_engine
  96c94995ef7c        kolla/centos-binary-heat-api-cfn:2.0.3                "kolla_start"            17 hours ago        Up 17 hours                             heat_api_cfn
  cb8ae3afb767        kolla/centos-binary-heat-api:2.0.3                    "kolla_start"            17 hours ago        Up 17 hours                             heat_api
  e8f98659e03f        kolla/centos-binary-neutron-metadata-agent:2.0.3      "kolla_start"            17 hours ago        Up 17 hours                             neutron_metadata_agent
  d326fa732c2b        kolla/centos-binary-neutron-l3-agent:2.0.3            "kolla_start"            17 hours ago        Up 17 hours                             neutron_l3_agent
  4b1bbbe4fe5b        kolla/centos-binary-neutron-dhcp-agent:2.0.3          "kolla_start"            17 hours ago        Up 17 hours                             neutron_dhcp_agent
  88b2afbba5d9        kolla/centos-binary-neutron-openvswitch-agent:2.0.3   "kolla_start"            17 hours ago        Up 17 hours                             neutron_openvswitch_agent
  b73d52de75b2        kolla/centos-binary-neutron-server:2.0.3              "kolla_start"            17 hours ago        Up 17 hours                             neutron_server
  1c716402d95f        kolla/centos-binary-openvswitch-vswitchd:2.0.3        "kolla_start"            17 hours ago        Up 17 hours                             openvswitch_vswitchd
  176e7ee659f1        kolla/centos-binary-openvswitch-db-server:2.0.3       "kolla_start"            17 hours ago        Up 17 hours                             openvswitch_db
  457e0921c61a        kolla/centos-binary-nova-ssh:2.0.3                    "kolla_start"            17 hours ago        Up 17 hours                             nova_ssh
  b02acebb3dc3        kolla/centos-binary-nova-compute:2.0.3                "kolla_start"            17 hours ago        Up 17 hours                             nova_compute
  59be78a597d8        kolla/centos-binary-nova-libvirt:2.0.3                "kolla_start"            17 hours ago        Up 17 hours                             nova_libvirt
  668ad8f91920        kolla/centos-binary-nova-conductor:2.0.3              "kolla_start"            17 hours ago        Up 17 hours                             nova_conductor
  34f81b4bc18b        kolla/centos-binary-nova-scheduler:2.0.3              "kolla_start"            17 hours ago        Up 17 hours                             nova_scheduler
  eb47844e6547        kolla/centos-binary-nova-novncproxy:2.0.3             "kolla_start"            17 hours ago        Up 17 hours                             nova_novncproxy
  93563016cf21        kolla/centos-binary-nova-consoleauth:2.0.3            "kolla_start"            17 hours ago        Up 17 hours                             nova_consoleauth
  cc8a1cca2e98        kolla/centos-binary-nova-api:2.0.3                    "kolla_start"            17 hours ago        Up 17 hours                             nova_api
  40db89e89758        kolla/centos-binary-glance-api:2.0.3                  "kolla_start"            17 hours ago        Up 17 hours                             glance_api
  4fa5f0f38f0d        kolla/centos-binary-glance-registry:2.0.3             "kolla_start"            17 hours ago        Up 17 hours                             glance_registry
  f05120c95a9f        kolla/centos-binary-keystone:2.0.3                    "kolla_start"            17 hours ago        Up 17 hours                             keystone
  149a49d57aa6        kolla/centos-binary-rabbitmq:2.0.3                    "kolla_start"            17 hours ago        Up 17 hours                             rabbitmq
  5f4298c3821e        kolla/centos-binary-mariadb:2.0.3                     "kolla_start"            17 hours ago        Up 17 hours                             mariadb
  64f6fbb19892        kolla/centos-binary-cron:2.0.3                        "kolla_start"            17 hours ago        Up 17 hours                             cron
  4cab0e756b61        kolla/centos-binary-kolla-toolbox:2.0.3               "/usr/local/bin/dumb-"   17 hours ago        Up 17 hours                             kolla_toolbox
  293a7ccaab52        kolla/centos-binary-heka:2.0.3                        "kolla_start"            17 hours ago        Up 17 hours                             heka
  6dcf3a2c12cc        kolla/centos-binary-memcached:2.0.3                   "kolla_start"            17 hours ago        Up 17 hours                             memcached

6. 修改虚拟化类型

因为是在虚拟机中安装，不支持kvm，需要修改虚拟类型为qemu

vim /etc/kolla/nova-compute/nova.conf

[libvirt]
...
virt_type=qemu

然后就可以通过 kolla_internal_address 访问openstack环境

一些有用的工具

部署完成后，运行以下命令可以生成一个openrc文件(运行openstack CLI所需的环境变量):
kolla-ansible post-deploy
openrc文件生成之后，使用以下命令可以帮你做一下openstack的初始化工作，包括上传一个glance镜像以及创建几个虚拟网络:
source /etc/kolla/admin-openrc.sh
kolla/tools/init-runonce

由于错误的出现，可能需要多次的部署，而有些错误重新部署是不会进行修正的，所以需要将整个环境进行清理:

tools/cleanup-containers                #可用于从系统中移除部署的容器
tools/cleanup-host                      #可用于移除由于残余网络变化引发的docker启动的neutron-agents主机
tools/cleanup-images                    #可用于从本地缓存中移除所有的docker image

日志查看

kolla通过heka容器来收集所有容器的日志

docker exec -it heka bash

所有的容器都可以从这个目录中获取服务日志：/var/log/kolla/SERVICE_NAME。
如果需要输出日志，请运行：

docker logs

大多数容器不会stdout，上面的命令将不会提供信息。

出错处理

deploy时遇到以下错误:

TASK: [rabbitmq | fail msg="Hostname has to resolve to IP address of api_interface"] ***
failed: [localhost] =&gt; (item={'cmd': ['getent', 'ahostsv4', 'localhost'], 'end': '2016-06-24 04:51:39.738725', 'stderr': u'', 'stdout': '127.0.0.1       STREAM localhost\n127.0.0.1       DGRAM  \n127.0.0.1       RAW    \n127.0.0.1       STREAM \n127.0.0.1       DGRAM  \n127.0.0.1       RAW    ', 'changed': False, 'rc': 0, 'item': 'localhost', 'warnings': [], 'delta': '0:00:00.033351', 'invocation': {'module_name': u'command', 'module_complex_args': {}, 'module_args': u'getent ahostsv4 localhost'}, 'stdout_lines': ['127.0.0.1       STREAM localhost', '127.0.0.1       DGRAM  ', '127.0.0.1       RAW    ', '127.0.0.1       STREAM ', '127.0.0.1       DGRAM  ', '127.0.0.1       RAW    '], 'start': '2016-06-24 04:51:39.705374'}) =&gt; {"failed": true, "item": {"changed": false, "cmd": ["getent", "ahostsv4", "localhost"], "delta": "0:00:00.033351", "end": "2016-06-24 04:51:39.738725", "invocation": {"module_args": "getent ahostsv4 localhost", "module_complex_args": {}, "module_name": "command"}, "item": "localhost", "rc": 0, "start": "2016-06-24 04:51:39.705374", "stderr": "", "stdout": "127.0.0.1       STREAM localhost\n127.0.0.1       DGRAM  \n127.0.0.1       RAW    \n127.0.0.1       STREAM \n127.0.0.1       DGRAM  \n127.0.0.1       RAW    ", "stdout_lines": ["127.0.0.1       STREAM localhost", "127.0.0.1       DGRAM  ", "127.0.0.1       RAW    ", "127.0.0.1       STREAM ", "127.0.0.1       DGRAM  ", "127.0.0.1       RAW    "], "warnings": []}}
msg: Hostname has to resolve to IP address of api_interface

FATAL: all hosts have already failed -- aborting

PLAY RECAP ********************************************************************
to retry, use: --limit @/root/site.retry

localhost                  : ok=87   changed=24   unreachable=0    failed=1

解决办法：

vim /etc/hosts
127.0.0.1     localhost
192.168.2.120 localhost

kolla的更多相关文章

Inside Kolla - 05 从 tools 目录开始
从 tools 目录开始在上一篇中已介绍了 Kolla 的源代码目录结构和各个目录中源代码的基本作用,现在开始深入到各个目录,介绍目录中的具体内容.每个人分析代码的思路和方法不同,会选择从不同的目录 ...
Inside Kolla - 04 Kolla 目录结构
Kolla 目录结构把 Kolla 的源代码下载下来后,先从总体上分析 Kolla 的目录结构,查看顶层目录结构,使用 tree -L 1 输出 . ├── ansible ├── compose ...
Inside Kolla - 03 下载Kolla
下载 Kolla Kolla 目前托管在 github.com 上,项目仓库的 URL 是 https://github.com/stackforge/kolla. 下载 Kolla 时,可下载 gi ...
Inside Kolla - 02 Kolla 是什么
Kolla 是什么? Kolla 项目 Kolla 是 OpenStack 里面的一个项目,在源代码的 README.md 里面的解析是: The Kolla project is part of t ...
Inside Kolla - 01 简介
简介在 opencloud 2015 的会议上初次了解到 kolla 项目后,开始去了解和学习 kolla 的源代码和相关的知识.经过一段时间的了解,觉得 kolla 确实是一个很好的项目,它使用预 ...
kolla管理openstack容器
本文以nova-api容器为例,说明kolla如何将nova-api配置文件传入容器,容器如何启动nova-api服务并读取配置文件注:第一部分比较无趣,二三部分会有意思一些 1. nova-ap ...
kolla 多节点部署 openstack
kolla 介绍简介 kolla 的使命是为 openstack 云平台提供生产级别的.开箱即用的交付能力.kolla 的基本思想是一切皆容器,将所有服务基于 Docker 运行,并且保证一个容器只 ...
kolla queens on centos7.5 -all in one
目录环境准备开始配置快照,快照,快照 pull镜像并部署登录配置OpenStack 环境准备我这里用workstation创建了一个虚拟机,安装centos7.5 mini系统,这台虚拟机上 ...
kolla单节点部署openstack
virtualbox环境: 双网卡:enp0s3(桥接) 192.168.102.194 enp0s8(桥接) 无ip 块存储 50G 关闭防火墙,selinux. 配置yum源:wget ...
kolla之docker私有仓库创建
kolla镜像自从P版以后就没有向之前版本直接下载一个tar然后放入仓库那么简单了. 正式开始搭建仓库: 1.启动仓库容器 docker run -d -v /opt/registry:/var/l ...

随机推荐

一文搞定Spring Task
今天和大家分享下Spring Task这个知识点,主要通过下面6个点来展开描述,希望能够帮助到大家. 1.什么是定时任务 2.入门案例 3.Corn表达式 4.Corn实战案例 5.@Schedule ...
win10 WSL2问题解决“WslRegisterDistribution failed with error: 0x800701bc”
win10安装wsl过程报错信息如下: 造成该问题的原因是WSL版本由原来的WSL1升级到WSL2后,内核没有升级,前往微软WSL官网下载安装适用于 x64 计算机的最新 WSL2 Linux 内核更 ...
Redis缓存何以一枝独秀？(2) —— 聊聊Redis的数据过期、数据淘汰以及数据持久化的实现机制
大家好,又见面了. 本文是笔者作为掘金技术社区签约作者的身份输出的缓存专栏系列内容,将会通过系列专题,讲清楚缓存的方方面面.如果感兴趣,欢迎关注以获取后续更新. 上一篇文章中呢,我们简单的介绍了下Re ...
面试官：JVM是如何判定对象已死的？
本文已收录至Github,推荐阅读 Java随想录微信公众号:Java随想录 CSDN: 码农BookSea 知道的越多,才知知道的越少.--苏格拉底目录引用计数算法可达性分析算法引用类型 ...
drf基础：1、web应用模式、API接口、接口测试工具
drf入门一.web应用模式 web的应用模式共分为两种,前后端不分离.前后端分离 1.前后端混合之前所写的bbs项目就是前后端不分离,后端人员在开发过程中使用模板语法,前后端都由一个人员 ...
MySQL 合并查询join 查询出的不同列合并到一个表中
为了求解问题时思路清晰,建议先分列查询,再将列合并到一个表中,这样相当于将复杂问题拆解为简单问题,一一解决.优点是避免所有问题混在一起,代码逻辑清晰,可迁移性强,下次遇到类似的查询问题能快速求解,缺点 ...
神经网络基础部件-BN层详解
一,数学基础 1.1,概率密度函数 1.2,正态分布二,背景 2.1,如何理解 Internal Covariate Shift 2.2,Internal Covariate Shift 带来的问题 ...
Emacs单文件配置
编辑 ~/.emacs 输入以下内容 ;; 编码 (set-language-info "UTF-8" 'coding-priority '(utf-8 gb18030 gbk g ...
VUE10 计算属性
1 Vue计算属性简介 1)定义:我们需要一个属性,但是这个属性不存在,但是可以通过已有的属性计算得来,那么就可以定义一个计算属性. 2)原理:底层借助了Object.defineproperty方法 ...
STL中的智能指针(Smart Pointer)及其源码剖析： std::auto_ptr
STL中的智能指针(Smart Pointer)及其源码剖析: std::auto_ptr auto_ptr 是STL中的智能指针家族的成员之一, 它管理由 new expression 获得的对象, ...