[ Openstack ] OpenStack-Mitaka 高可用之 镜像服务(glance)

目录

Openstack-Mitaka 高可用之 概述
    Openstack-Mitaka 高可用之 环境初始化
    Openstack-Mitaka 高可用之 Mariadb-Galera集群部署
    Openstack-Mitaka 高可用之 Rabbitmq-server 集群部署
    Openstack-Mitaka 高可用之 memcache
    Openstack-Mitaka 高可用之 Pacemaker+corosync+pcs高可用集群
    Openstack-Mitaka 高可用之 认证服务（keystone）
    OpenStack-Mitaka 高可用之 镜像服务(glance)
    Openstack-Mitaka 高可用之 计算服务（Nova）
    Openstack-Mitaka 高可用之 网络服务（Neutron）
    Openstack-Mitaka 高可用之 Dashboard
    Openstack-Mitaka 高可用之 启动一个实例
    Openstack-Mitaka 高可用之 测试

简介

镜像服务允许用户发现、注册和获取虚拟机镜像。它提供了一个API，允许查询虚拟机镜像的metadata 并获取一个现存的镜像。可以将虚拟机镜像存储到各种位置，从简单的文件系统到对象存储系统。

组件：
    （1）glance-api
        接收镜像API的调用，诸如镜像发现、恢复、存储
    （2）glance-registry
        存储、处理和恢复镜像的元数据，元数据包括项诸如大小和类型
    （3）数据库
        存放镜像源数据，诸如MySQL、SQLite
    （4）镜像文件的存储仓库
        支持多种类型的仓库，它们有普通文件系统、对象存储、RADOS块存储、HTTP
    （5）元数据定义服务
        通用API，是用于为厂商、管理员、服务、及用户自定义元数据

安装和配置

安装服务前，必须创建一个数据库、服务凭证和API端点

root@controller1 ~]# . admin-openrc
[root@controller1 ~]# mysql -ugalera -pgalera -h 192.168.0.10

MariaDB [(none)]> CREATE DATABASE glance;
Query OK,  row affected (0.07 sec)

MariaDB [(none)]> grant all privileges on glance.* to 'glance'@'localhost' identified by 'glance';
Query OK,  rows affected (0.01 sec)

MariaDB [(none)]> grant all privileges on glance.* to 'glance'@'%' identified by 'glance';
Query OK,  rows affected (0.01 sec)

MariaDB [(none)]> flush privileges;
Query OK,  rows affected (0.00 sec)

创建服务证书
[root@controller1 ~]# openstack user create --domain default --password-prompt glance        # 密码 glance

创建服务实体
[root@controller1 ~]# openstack service create --name glance   --description "OpenStack Image" image

创建镜像服务的API端点
[root@controller1 ~]# openstack endpoint create --region RegionOne   image public http://controller:9292
[root@controller1 ~]# openstack endpoint create --region RegionOne   image internal http://controller:9292
[root@controller1 ~]# openstack endpoint create --region RegionOne   image admin http://controller:9292

安装并配置组件

三个节点都需要安装：
# yum install openstack-glance -y

配置文件做如下修改：
[root@controller1 ~]# vim /etc/glance/glance-api.conf
…
Bind_host = 192.168..xx        # 监听ip地址，为了避免和vip冲突。
registry_host = 192.168..xx        # 监听ip地址，为了避免和vip冲突。
[database]
...
connection = mysql+pymysql://glance:glance@controller/glance
[keystone_authtoken]
...
auth_uri = http://controller:5000
auth_url = http://controller:35357
memcached_servers = controller1:,controller2:,controller3:
auth_type = password
project_domain_name = default
user_domain_name = default
project_name = service
username = glance
password = glance
[paste_deploy]
...
flavor = keystone

[glance_store]
...
stores = file,http
default_store = file
filesystem_store_datadir = /var/lib/glance/images/

[root@controller1 ~]# vim /etc/glance/glance-registry.conf
[database]
...
connection = mysql+pymysql://glance:glance@controller/glance
…
bind_host = 192.168..xx        # 监听ip地址，为了避免和vip冲突。
[keystone_authtoken]
...
auth_uri = http://controller:5000
auth_url = http://controller:35357
memcached_servers = controller1:,controller2:,controller3:
auth_type = password
project_domain_name = default
user_domain_name = default
project_name = service
username = glance
password = glance
[paste_deploy]
...
flavor = keystone

将修改后的配置文件拷贝到其他controller节点

[root@controller1 ~]# cd /etc/glance/
[root@controller1 glance]# scp glance-api.conf glance-registry.conf controller2:/etc/glance/
glance-api.conf                                                                                                            %  137KB .5KB/s   :
glance-registry.conf                                                                                                       %   65KB  .5KB/s   :
[root@controller1 glance]# scp glance-api.conf glance-registry.conf controller3:/etc/glance/
glance-api.conf                                                                                                            %  137KB .5KB/s   :
glance-registry.conf 

注意修改监听地址

写入镜像服务数据库

[root@controller1 ~]# su -s /bin/sh -c "glance-manage db_sync" glance
忽视告警信息
Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
/usr/lib/python2./site-packages/oslo_db/sqlalchemy/enginefacade.py:: OsloDBDeprecationWarning: EngineFacade is deprecated; please use oslo_db.sqlalchemy.enginefacade
  expire_on_commit=expire_on_commit, _conf=conf)
/usr/lib/python2./site-packages/pymysql/cursors.py:: Warning: (, u'Duplicate index `ix_image_properties_image_id_name`. This is deprecated and will be disallowed in a future release.')
  result = self._query(query)

完成安装，启动镜像服务

每个controller节点都需要执行：
# systemctl enable openstack-glance-api.service openstack-glance-registry.service
# systemctl start openstack-glance-api.service openstack-glance-registry.service

Haproxy 详解
http://blog.itpub.net/28624388/viewspace-1288651/

listen galera_cluster
    mode tcp
    bind 192.168.0.10:
    balance source
    option mysql-check user haproxy
    server controller1 192.168.0.11: check inter  rise  fall  backup
    server controller2 192.168.0.12: check inter  rise  fall
    server controller3 192.168.0.13: check inter  rise  fall  backup

listen memcache_cluster
    mode tcp
    bind 192.168.0.10:
    balance source
    server controller1 192.168.0.11: check inter  rise  fall
    server controller2 192.168.0.12: check inter  rise  fall
    server controller3 192.168.0.13: check inter  rise  fall  

listen dashboard_cluster
    mode tcp
    bind 192.168.0.10:
    balance source
    option tcplog
    option httplog
    server controller1 192.168.0.11: check inter  rise  fall
    server controller2 192.168.0.12: check inter  rise  fall
    server controller3 192.168.0.13: check inter  rise  fall 

listen keystone_admin_cluster
    mode tcp
    bind 192.168.0.10:
    balance source
    option tcplog
    option httplog
    server controller1 192.168.0.11: check inter  rise  fall
    server controller2 192.168.0.12: check inter  rise  fall
    server controller3 192.168.0.13: check inter  rise  fall
listen keystone_public_internal_cluster
    mode tcp
    bind 192.168.0.10:
    balance source
    option tcplog
    option httplog
    server controller1 192.168.0.11: check inter  rise  fall
    server controller2 192.168.0.12: check inter  rise  fall
    server controller3 192.168.0.13: check inter  rise  fall 

listen glance_api_cluster
    mode tcp
    bind 192.168.0.10:
    balance source
    option tcplog
    option httplog
    server controller1 192.168.0.11: check inter  rise  fall
    server controller2 192.168.0.12: check inter  rise  fall
    server controller3 192.168.0.13: check inter  rise  fall 

确认无误，拷贝到其他controller节点

[root@controller1 glance]# systemctl restart haproxy
[root@controller1 glance]# netstat -ntplu | grep haproxy
tcp               192.168.0.10:       0.0.0.0:*               LISTEN      /haproxy
tcp               192.168.0.10:       0.0.0.0:*               LISTEN      /haproxy
tcp               192.168.0.10:       0.0.0.0:*               LISTEN      /haproxy
tcp               192.168.0.10:       0.0.0.0:*               LISTEN      /haproxy
tcp　　　　 0　　　　0 192.168.0.10:80　　　　　0.0.0.0:*　　　　　　　　  LISTEN　　　 10560/haproxy
tcp               192.168.0.10:      0.0.0.0:*               LISTEN      /haproxy
udp               0.0.0.0:           0.0.0.0:*                           /haproxy

[root@controller1 ~]# scp /etc/haproxy/haproxy.cfg controller2:/etc/haproxy/
haproxy.cfg                                                                                                                %      .6KB/s   :
[root@controller1 ~]# scp /etc/haproxy/haproxy.cfg controller3:/etc/haproxy/
haproxy.cfg                                                                                                                %      .6KB/s   :

haproxy配置务必保持一致。

验证操作：

选择任意节点下载镜像：

# wget http://download.cirros-cloud.net/0.3.4/cirros-0.3.4-x86_64-disk.img     # 可提前使用迅雷下载

使用QCOW2磁盘格式，bare容器格式上传镜像到镜像服务并设置公共可见，这样所有的项目都可以访问它：

# openstack image create "cirros" --file cirros-0.3.-x86_64-disk.img --disk-format qcow2 --container-format bare --public

创建成功，确认镜像上传并验证属性：

# openstack image list

glance部署成功。