nova image-list
ERROR (ClientException): The server has either erred or is incapable of performi9e-6cdca5eee7b2)

recital
36 ●2 ●2 ●7

I am installing liberty release on centos7 with one controller and one compute node.
nova service-list and nova endpoints work fine. But, nova image-list returns the following error.

ERROR(ClientException) : Unexpected API Error. Please report this at http://bugs.launchpad.net/nova and attach the Nova API log if possible.

<class 'glanceclient.exc.HTTPInternalServerError'> (HTTP 500) (Request-ID: ...)

glance image-list works fine. Pls, help me out.

the nova-api.log is following.

2015-12-14 16:29:56.071 9986 INFO nova.osapi_compute.wsgi.server [req-496b5df0-e28f-486b-8386-96f704433daf 504f2af1b9044a3e97bc69e80daf5809 8de4c51458804564b79932efa364524b - - -] 192.168.219.11 "GET /v2/ HTTP/1.1" status: 200 len: 572 time: 0.0285130

2015-12-14 16:30:01.676 9986 ERROR nova.api.openstack.extensions [req-e65f8242-8d2c-43f1-af66-362f3161b655 504f2af1b9044a3e97bc69e80daf5809 8de4c51458804564b79932efa364524b - - -] Unexpected exception in API method

2015-12-14 16:30:01.676 9986 ERROR nova.api.openstack.extensions Traceback (most recent call last):

2015-12-14 16:30:01.676 9986 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/api/openstack/extensions.py", line 478, in wrapped

2015-12-14 16:30:01.676 9986 ERROR nova.api.openstack.extensions     return f(*args, **kwargs)

2015-12-14 16:30:01.676 9986 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/api/openstack/compute/images.py", line 145, in detail

2015-12-14 16:30:01.676 9986 ERROR nova.api.openstack.extensions     **page_params)

2015-12-14 16:30:01.676 9986 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/image/api.py", line 68, in get_all

2015-12-14 16:30:01.676 9986 ERROR nova.api.openstack.extensions     return session.detail(context, **kwargs)

2015-12-14 16:30:01.676 9986 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/image/glance.py", line 284, in detail

2015-12-14 16:30:01.676 9986 ERROR nova.api.openstack.extensions     for image in images:

2015-12-14 16:30:01.676 9986 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/glanceclient/v1/images.py", line 254, in list

2015-12-14 16:30:01.676 9986 ERROR nova.api.openstack.extensions     for image in paginate(params, return_request_id):

2015-12-14 16:30:01.676 9986 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/glanceclient/v1/images.py", line 238, in paginate

2015-12-14 16:30:01.676 9986 ERROR nova.api.openstack.extensions     images, resp = self._list(url, "images")

2015-12-14 16:30:01.676 9986 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/glanceclient/v1/images.py", line 63, in _list

2015-12-14 16:30:01.676 9986 ERROR nova.api.openstack.extensions     resp, body = self.client.get(url)

2015-12-14 16:30:01.676 9986 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/glanceclient/common/http.py", line 280, in get

2015-12-14 16:30:01.676 9986 ERROR nova.api.openstack.extensions     return self._request('GET', url, **kwargs)

2015-12-14 16:30:01.676 9986 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/glanceclient/common/http.py", line 272, in _request

2015-12-14 16:30:01.676 9986 ERROR nova.api.openstack.extensions ...

(more)

add a comment

2 answers

Sort by » oldest newest most voted

answered Dec 15 '15

recital
36 ●2 ●2 ●7

updated Dec 15 '15

I solved this problem.
It's because keystone version is set as v2.0. You should change it as v3.

In "openstack endpoint list", it should be like this.

public & internal : http://controller:5000/v2.0 --> http://controller:5000/v3

admin : http://controller:5000/v2.0 --> http://controller:35357/v3

I refered to this site to change keystone db.

http://www.cloudkb.net/how-to-change-keystone-api-v2-v3/

You don't have to change "policy.json" file as instructed in the above site. After change the db, reboot your system. And all the CLI commands work well.

Thanks. recital.

link

Comments

I have the same problem and they same set up like you, but changing version didn't do the trick for me

still got the error after I rebooted the box, is this a bug and is there already a bug report?

thrawn (Dec 24 '15)

okay found my problem. Password was not the same in glance-registry.conf and glance-api.conf https://bugs.launchpad.net/nova/+bug/1514480 (https://bugs.launchpad.net/nova/+bug/...)

thrawn (Dec 24 '15)

add a comment

answered Dec 14 '15

Prateek K
341 ●1 ●5 ●9

You might have missed this configuration in nova.conf

[glance]
api_servers = http:://<controllerip>:9292

link

Comments

I inserted "api_servers=http://controller:9292" in glance section on the controller node.
After that, "su -s /bin/sh -c "nova-manage db sync" nova" and restart all the nova services.
But, same problem happens when executing "nova image-list" on the controller node.

recital (Dec 14 '15)

OK ... try this and see if it works now:---

[glance]
host = controller

Prateek K (Dec 14 '15)

I used the configuration at the first time. It didn't work...

recital (Dec 14 '15)

ok... now it is becoming interesting... can you run the following command and paste the output here :-

nova --debug image-list

Prateek K (Dec 14 '15)

I posted the logs for "nova --debug image-list" on the above.

recital (Dec 14 '15)

How to change keystone API V2 to V3

Posted on November ,  by Gopalakrishnan S     Comments

The Keystone Identity Service allows clients to obtain tokens that can be used to access OpenStack cloud services. This document is intended for software developers interested in developing applications that utilize the Keystone Identity Service API for authentication. The OpenStack Identity API is implemented using a RESTful web service interface. All requests to authenticate and operate against the OpenStack Identity API should be performed using SSL over HTTP (HTTPS) on TCP port .

keystone V3 Advantages

) Authentication is totally pluggable. You can write our own custom auth method. Beause of this extensible auth method, now keystone supports oauth1, federation ( federation is not fully done)

) Authorization : V2 is either “admin” or none. In v3 you can control who can call each method. ( Provided you define your own policy file )

) Separate drivers for assignments and identity

) Rich set of APIs. There are lot more API available than v2.. Also there are no vendor specic extension. If you check v2., most of the role apis are Rackspace extensions

Before proceed to migrate keystone v2 to v3, you must check previous services are working fine. Use the following commands to verify the list of services works.

How to change keystone API V2 to V3?

[root@localhost ~(keystone_admin)]# keystone user-list

WARNING: Bypassing authentication using a token & endpoint (authentication credentials are being ignored).

+———————————-+————+———+———————-+

| id | name | enabled | email |

+———————————-+————+———+———————-+

| ed03407c56054729bee58be7f7710786 | admin | True | root@localhost |

| 3b52f88a70f149a791e295b1859ae8f4 | ceilometer | True | ceilometer@localhost |

[root@localhost ~(keystone_admin)]# nova service-list

+——————+———–+———-+———+——-+—————————-+—————–+

| Binary | Host | Zone | Status | State | Updated_at | Disabled Reason |

+——————+———–+———-+———+——-+—————————-+—————–+

| nova-consoleauth | packstack | internal | enabled | up | --13T10::52.000000 | – |

| nova-scheduler | packstack | internal | enabled | up | --13T10::50.000000 | – |

| nova-conductor | packstack | internal | enabled | up | --13T10::54.000000 | – |

| nova-compute | packstack | nova | enabled | up | --13T10::51.000000 | – |

| nova-cert | packstack | internal | enabled | up | --13T10::52.000000 | – |

| nova-console | packstack | internal | enabled | up | --13T10::51.000000 | – |

+——————+———–+———-+———+——-+—————————-+—————–+

[root@localhost ~(keystone_admin)]# glance image-list

+————————————–+——–+————-+——————+———-+——–+

| ID | Name | Disk Format | Container Format | Size | Status |

+————————————–+——–+————-+——————+———-+——–+

| f4c137ca-8dd8-47f3-be70-106eac2f241f | cirros | qcow2 | bare |  | active |

+————————————–+——–+————-+——————+———-+——–+

If all the services are working fine then proceed to migrate endpoint urls to V3 in your keystone databases.  Login your mysql server and change endpoint URLs.

mysql> use keystone;

Reading table information for completion of table and column names

You can turn off this feature to get a quicker startup with -A

Database changed

mysql> select interface, url from endpoint e, service s where s.id=e.service_id and s.type=”identity”;

+———–+———————————-+

| interface | url |

+———–+———————————-+

| admin | http://192.168.1.133:35357/v2.0 |

| internal | http://192.168.1.133:5000/v2.0 |

| public | http://192.168.1.133:5000/v2.0 |

+———–+———————————-+

 rows in set (0.01 sec)

Get the identity service ID

mysql> select id from service where type=”identity”;

+———————————-+

| id |

+———————————-+

| e32101fdfe4145d1a6a22351b41d88e5 |

+———————————-+

 row in set (0.00 sec)

Use this query to replace URLs as per service id where  ports

mysql> update endpoint set url=”http://192.168.1.196:5000/v3″ where url=”http://192.168.1.196:5000/v2.0″ and service_id=”76e23f322c2a48d18293db89dbca9e70″;

Query OK,  rows affected (0.00 sec)

Rows matched:  Changed:  Warnings: 

Use this query to replace  ports

mysql> update endpoint set url=”http://192.168.1.196:35357/v3″ where url=”http://192.168.1.196:35357/v2.0″ and service_id=”76e23f322c2a48d18293db89dbca9e70″;

Query OK,  row affected (0.00 sec)

Rows matched:  Changed:  Warnings: 

Thats all, you can verify the changed URLs.

mysql> select interface, url from endpoint e, service s where s.id=e.service_id and s.type=”identity”;

+———–+——————————–+

| interface | url |

+———–+——————————–+

| admin | http://192.168.1.133:35357/v3 |

| internal | http://192.168.1.133:5000/v3 |

| public | http://192.168.1.133:5000/v3 |

+———–+——————————–+

 rows in set (0.00 sec)

mysql>

upgrade Keystone Policy File

Policy is just a set of rules combined by or/and logic. It should become more readable in future releases, The Openstack Identity v3 API, provided by Keystone, offers features that were lacking in the previous version. Among these features, it introduces the concept of domains, allowing isolation of projects and users. For instance, an administrator allowed to create projects and users in a given domain, may not have any right in another one. While these features look very exciting, some configuration needs to be done to have a working identity v3 service with domains properly set.

Download policy.v3cloudsample.json file

wget https://github.com/openstack/keystone/blob/master/etc/policy.v3cloudsample.json

mv /etc/keystone/policy.json /etc/keystone/policy.json.V2

mv policy.v3cloudsample.json /etc/keystone/policy.json

chown keystone.keystone policy.json

Update Keystone Endpoint Environment.

export OS_USERNAME=admin

export OS_TENANT_NAME=admin

export OS_PASSWORD=<password>

export OS_AUTH_URL=http://192.168.1.133:5000/v3

export SERVICE_ENDPOINT=http://192.168.1.133:35357/v3

export SERVICE_TOKEN=c50f58a02dde43f286517af102786be0

Restart OpenStack Services

/etc/init.d/openstack-keystone restart

Troubleshooting

If you received “horizon unauthorized (http )” errors, you can revert back policy.json v2 file and try to restart services.

How to Enable Multi Domains on openstack horizon

Horizon supports multi domains as well. You need to add only a few changes to local_setting. Apply the correct policy.json file for keystone.

vi /etc/openstack-dashboard/local_settings

uncommand the following settings.

OPENSTACK_API_VERSIONS = {

“identity”:

}

OPENSTACK_KEYSTONE_MULTIDOMAIN_SUPPORT = True

OPENSTACK_KEYSTONE_URL = “http://192.168.1.133:5000/v3”

Save local_settings and restart openstack-dashboard.

/etc/init.d/httpd restart