openstack team mailing list archive

Thread
Date
Re: boot command fails

To: Eoghan Glynn <eglynn@xxxxxxxxxx>
From: Afef MDHAFFAR <afef.mdhaffar@xxxxxxxxx>
Date: Tue, 4 Sep 2012 14:11:34 +0200
Cc: openstack@xxxxxxxxxxxxxxxxxxx
In-reply-to: <929522880.9929778.1346758878465.JavaMail.root@redhat.com>
For the moment, I use one node. It is an Ubuntu 12.04. Under ubuntu, Xen
Server is running.
As explained in installation guide of Essex, nova-api, nova-scheduler,
nova-cert and nova-console are running on Dom0.
On the other hand, nova-compute and nova-network are running on a
para-virtualized VM (called pv in my case).
Here are the outputs of "nova-manage service list" from dom0 and pv:
root@node086:/var/log/rabbitmq# nova-manage service list
2012-09-04 13:55:29 DEBUG nova.utils
[req-0991eff5-2c92-4603-a02a-403815a51bd8 None None] backend <module
'nova.db.sqlalchemy.api' from
'/usr/lib/python2.7/dist-packages/nova/db/sqlalchemy/api.pyc'> from
(pid=30318) __get_backend /usr/lib/python2.7/dist-packages/nova/utils.py:658
Binary           Host                                 Zone
Status     State Updated_At
nova-scheduler   node086                              nova
enabled    :-)   2012-09-04 11:55:20
nova-compute     pv                                   nova
enabled    :-)   2012-09-04 11:55:19
nova-network     pv                                   nova
enabled    :-)   2012-09-04 11:55:19
nova-cert        node086                              nova
enabled    :-)   2012-09-04 11:55:26
nova-consoleauth node086                              nova
enabled    :-)   2012-09-04 11:55:26

---------
root@pv:~# nova-manage service list
2012-09-04 13:55:51 DEBUG nova.utils
[req-34d76ac3-63b6-4670-a78d-a530b8d62141 None None] backend <module
'nova.db.sqlalchemy.api' from
'/usr/lib/python2.7/dist-packages/nova/db/sqlalchemy/api.pyc'> from
(pid=1698) __get_backend /usr/lib/python2.7/dist-packages/nova/utils.py:658
Binary           Host                                 Zone
Status     State Updated_At
nova-scheduler   node086                              nova
enabled    :-)   2012-09-04 11:55:50
nova-compute     pv                                   nova
enabled    :-)   2012-09-04 11:55:50
nova-network     pv                                   nova
enabled    :-)   2012-09-04 11:55:49
nova-cert        node086                              nova
enabled    :-)   2012-09-04 11:55:46
nova-consoleauth node086                              nova
enabled    :-)   2012-09-04 11:55:46

I restarted nova-compute on pv (Is there any way to restart it from dom0?).
It is working and responding. Here is nova-compute log file:
2012-09-04 13:57:20 DEBUG nova.service [-] memcached_servers : None from
(pid=1748) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-] logging_default_format_string :
%(asctime)s %(levelname)s %(name)s [-] %(instance)s%(message)s from
(pid=1748) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-] osapi_volume_ext_list : [] from
(pid=1748) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-] find_host_timeout : 30 from
(pid=1748) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-] libvirt_wait_soft_reboot_seconds
: 120 from (pid=1748) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-]
quota_max_injected_file_path_bytes : 255 from (pid=1748) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-] default_os_type : linux from
(pid=1748) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-] fake_rabbit : False from
(pid=1748) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-] log_date_format : %Y-%m-%d
%H:%M:%S from (pid=1748) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-] timeout_nbd : 10 from (pid=1748)
wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-] block_device_creation_timeout :
10 from (pid=1748) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-] rabbit_host : ip from (pid=1748)
wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-] rescue_timeout : 0 from
(pid=1748) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-] live_migration_flag :
VIR_MIGRATE_UNDEFINE_SOURCE, VIR_MIGRATE_PEER2PEER from (pid=1748) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-] policy_default_rule : default
from (pid=1748) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-] xenapi_login_timeout : 10 from
(pid=1748) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-] vncserver_listen : 127.0.0.1
from (pid=1748) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-] use_syslog : False from
(pid=1748) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-] rpc_thread_pool_size : 1024 from
(pid=1748) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-] use_single_default_gateway :
False from (pid=1748) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-] osapi_path : /v1.1/ from
(pid=1748) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-] syslog_log_facility : LOG_USER
from (pid=1748) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-] ec2_path : /services/Cloud from
(pid=1748) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-] vmware_vif_driver :
nova.virt.vmwareapi.vif.VMWareVlanBridgeDriver from (pid=1748) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-] vmwareapi_api_retry_count : 10
from (pid=1748) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-] xenapi_vhd_coalesce_max_attempts
: 5 from (pid=1748) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-] linuxnet_interface_driver :
nova.network.linux_net.LinuxBridgeInterfaceDriver from (pid=1748) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-] bindir :
/usr/lib/python2.7/dist-packages/bin from (pid=1748) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-] rabbit_use_ssl : False from
(pid=1748) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-] rabbit_retry_interval : 1 from
(pid=1748) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-] config_file :
['/tmp/nova-conf-qaf821/tmpzW3M9B.conf',
'/tmp/nova-conf-qaf821/tmpKPMpdo.conf'] from (pid=1748) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-] rbd_secret_uuid : None from
(pid=1748) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-] agent_version_timeout : 300 from
(pid=1748) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-] network_api_class :
nova.network.api.API from (pid=1748) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-] node_availability_zone : nova
from (pid=1748) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-] rbd_user : None from (pid=1748)
wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-] db_driver : nova.db from
(pid=1748) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-] rbd_pool : rbd from (pid=1748)
wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-]
create_unique_mac_address_attempts : 5 from (pid=1748) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-] img_handlers : ['loop', 'nbd',
'guestfs'] from (pid=1748) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-] volume_manager :
nova.volume.manager.VolumeManager from (pid=1748) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-] start_guests_on_host_boot :
False from (pid=1748) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-] pybasedir :
/usr/lib/python2.7/dist-packages from (pid=1748) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-] xenapi_generate_swap : False
from (pid=1748) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-] vlan_start : 100 from (pid=1748)
wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-] metadata_manager :
nova.api.manager.MetadataManager from (pid=1748) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-] sr_matching_filter :
other-config:i18n-key=local-storage from (pid=1748) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-] l3_lib :
nova.network.l3.LinuxNetL3 from (pid=1748) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-] isolated_images : [] from
(pid=1748) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-] vnc_enabled : True from
(pid=1748) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-] api_paste_config :
/etc/nova/api-paste.ini from (pid=1748) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-] quota_security_group_rules : 20
from (pid=1748) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-] xenapi_connection_password :
FLAG SET  from (pid=1748) wait
/usr/lib/python2.7/dist-packages/nova/service.py:409
2012-09-04 13:57:20 DEBUG nova.service [-] rabbit_virtual_host : / from
(pid=1748) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-] libvirt_volume_drivers :
['iscsi=nova.virt.libvirt.volume.LibvirtISCSIVolumeDriver',
'local=nova.virt.libvirt.volume.LibvirtVolumeDriver',
'fake=nova.virt.libvirt.volume.LibvirtFakeVolumeDriver',
'rbd=nova.virt.libvirt.volume.LibvirtNetVolumeDriver',
'sheepdog=nova.virt.libvirt.volume.LibvirtNetVolumeDriver'] from (pid=1748)
wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-] network_driver :
nova.network.linux_net from (pid=1748) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-] quota_instances : 10 from
(pid=1748) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-] vnc_keymap : FLAG SET  from
(pid=1748) wait /usr/lib/python2.7/dist-packages/nova/service.py:409
2012-09-04 13:57:20 DEBUG nova.service [-] image_service :
nova.image.glance.GlanceImageService from (pid=1748) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-] libvirt_inject_password : FLAG
SET  from (pid=1748) wait
/usr/lib/python2.7/dist-packages/nova/service.py:409
2012-09-04 13:57:20 DEBUG nova.service [-] control_exchange : nova from
(pid=1748) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-] volume_group : nova-volumes from
(pid=1748) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-] log_file : None from (pid=1748)
wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-] compute_manager :
nova.compute.manager.ComputeManager from (pid=1748) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-] compute_driver :
nova.virt.connection.get_connection from (pid=1748) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 DEBUG nova.service [-] network_topic : network from
(pid=1748) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 13:57:20 AUDIT nova.service [-] Starting compute node (version
2012.1-LOCALBRANCH:LOCALREVISION)
2012-09-04 13:57:21 DEBUG nova.utils
[req-e6a1c8d2-ceca-40b3-baeb-e18453770f8f None None] backend <module
'nova.db.sqlalchemy.api' from
'/usr/lib/python2.7/dist-packages/nova/db/sqlalchemy/api.pyc'> from
(pid=1748) __get_backend /usr/lib/python2.7/dist-packages/nova/utils.py:658
2012-09-04 13:57:21 DEBUG nova.virt.libvirt.connection [-] Connecting to
libvirt: xen://node086/ from (pid=1748) _get_connection
/usr/lib/python2.7/dist-packages/nova/virt/libvirt/connection.py:295
2012-09-04 13:57:21 ERROR nova.virt.libvirt.connection [-] Getting disk
size of pv: [Errno 2] No such file or directory: '/afef/PV1/openstack.img'
2012-09-04 13:57:21 INFO nova.virt.libvirt.connection [-] Compute_service
record updated for pv
2012-09-04 13:57:21 INFO nova.rpc.common [-] Connected to AMQP server on
ip:5672
2012-09-04 13:57:21 DEBUG nova.service [-] Creating Consumer connection for
Service compute from (pid=1748) start
/usr/lib/python2.7/dist-packages/nova/service.py:178

I also restarted nova-scheduler. It responds. here is nova-scheduler log
file

2012-09-04 14:00:22 DEBUG nova.scheduler.host_manager
[req-4ca0482f-1144-4a18-9a8f-aa27c9cfda41 None None] Received compute
service update from pv. from (pid=30414) update_service_capabilities
/usr/lib/python2.7/dist-packages/nova/scheduler/host_manager.py:273
2012-09-04 14:01:08 DEBUG nova.service [-] Full set of FLAGS: from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:402
2012-09-04 14:01:08 DEBUG nova.service [-] storage_availability_zone : nova
from (pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:08 DEBUG nova.service [-] default_publisher_id : node086
from (pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:08 DEBUG nova.service [-] sql_connection_debug : 0 from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:08 DEBUG nova.service [-] compute_topic : compute from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:08 DEBUG nova.service [-] glance_port : 9292 from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:08 DEBUG nova.service [-] glance_api_servers : ['ip:9292']
from (pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:08 DEBUG nova.service [-] rabbit_password : FLAG SET  from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:409
2012-09-04 14:01:08 DEBUG nova.service [-] osapi_compute_listen_port : 8774
from (pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:08 DEBUG nova.service [-] s3_dmz : ip from (pid=30502)
wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:08 DEBUG nova.service [-] quota_ram : 51200 from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:08 DEBUG nova.service [-] osapi_compute_listen : 0.0.0.0
from (pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:08 DEBUG nova.service [-] cache_images : True from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:08 DEBUG nova.service [-] aws_access_key_id : FLAG SET
 from (pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:409
2012-09-04 14:01:08 DEBUG nova.service [-] bandwith_poll_interval : 600
from (pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:08 DEBUG nova.service [-] host_state_interval : 120 from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:08 DEBUG nova.service [-] enable_new_services : True from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:08 DEBUG nova.service [-] my_ip : ip from (pid=30502) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:08 DEBUG nova.service [-] quota_security_groups : 10 from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:08 DEBUG nova.service [-] live_migration_retry_count : 30
from (pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:08 DEBUG nova.service [-] ec2_dmz_host : ip from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:08 DEBUG nova.service [-] password_length : 12 from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:08 DEBUG nova.service [-] quota_max_injected_files : 5
from (pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:08 DEBUG nova.service [-] security_group_handler :
nova.network.quantum.sg.NullSecurityGroupHandler from (pid=30502) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:08 DEBUG nova.service [-] default_schedule_zone : None
from (pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:08 DEBUG nova.service [-] logdir : /var/log/nova from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:08 DEBUG nova.service [-] osapi_volume_listen : 0.0.0.0
from (pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:08 DEBUG nova.service [-] sqlite_db : nova.sqlite from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:08 DEBUG nova.service [-] osapi_compute_extension :
['nova.api.openstack.compute.contrib.standard_extensions'] from (pid=30502)
wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:08 DEBUG nova.service [-] allow_resize_to_same_host :
False from (pid=30502) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:08 DEBUG nova.service [-] reclaim_instance_interval : 0
from (pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:08 DEBUG nova.service [-] scheduler_json_config_location :
 from (pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:08 DEBUG nova.service [-] cert_manager :
nova.cert.manager.CertManager from (pid=30502) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:08 DEBUG nova.service [-] notification_driver :
nova.notifier.no_op_notifier from (pid=30502) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:08 DEBUG nova.service [-] osapi_max_limit : 1000 from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:08 DEBUG nova.service [-] enable_instance_password : FLAG
SET  from (pid=30502) wait
/usr/lib/python2.7/dist-packages/nova/service.py:409
2012-09-04 14:01:08 DEBUG nova.service [-] compute_api_class :
nova.compute.api.API from (pid=30502) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:08 DEBUG nova.service [-] rabbit_port : 5672 from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:08 DEBUG nova.service [-] default_access_ip_network_name :
None from (pid=30502) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:08 DEBUG nova.service [-] rabbit_max_retries : 0 from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:08 DEBUG nova.service [-] resume_guests_state_on_host_boot
: False from (pid=30502) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:08 DEBUG nova.service [-] ec2_listen : 0.0.0.0 from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:08 DEBUG nova.service [-] logfile : None from (pid=30502)
wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:08 DEBUG nova.service [-] floating_ip_dns_manager :
nova.network.dns_driver.DNSDriver from (pid=30502) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:08 DEBUG nova.service [-] snapshot_name_template :
snapshot-%08x from (pid=30502) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:08 DEBUG nova.service [-] resize_confirm_window : 0 from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:08 DEBUG nova.service [-] vncserver_proxyclient_address :
127.0.0.1 from (pid=30502) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:08 DEBUG nova.service [-] metadata_host : ip from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:08 DEBUG nova.service [-] quota_cores : 20 from
(pid=30502) wait
/usr/lib/python2.7/dist-packages/nova/service.py:4112012-09-04 14:01:08
DEBUG nova.service [-] heal_instance_info_cache_interval : 60 from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:08 DEBUG nova.service [-] debug : False from (pid=30502)
wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:08 DEBUG nova.service [-] auth_strategy : keystone from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:08 DEBUG nova.service [-] policy_file : policy.json from
(pid=30502) wait
/usr/lib/python2.7/dist-packages/nova/service.py:4112012-09-04 14:01:08
DEBUG nova.service [-] default_log_levels : ['amqplib=WARN',
'sqlalchemy=WARN', 'boto=WARN', 'suds=INFO', 'eventlet.wsgi.server=WARN']
from (pid=30502) wait
/usr/lib/python2.7/dist-packages/nova/service.py:4112012-09-04 14:01:08
DEBUG nova.service [-] volume_topic : volume from (pid=30502) wait
/usr/lib/python2.7/dist-packages/nova/service.py:4112012-09-04 14:01:08
DEBUG nova.service [-] osapi_glance_link_prefix : None from (pid=30502)
wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:08 DEBUG nova.service [-] volume_name_template :
volume-%08x from (pid=30502) wait
/usr/lib/python2.7/dist-packages/nova/service.py:4112012-09-04 14:01:08
DEBUG nova.service [-] lock_path : /var/lock/nova from (pid=30502) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:08 DEBUG nova.service [-] volume_scheduler_driver :
nova.scheduler.chance.ChanceScheduler from (pid=30502) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:08 DEBUG nova.service [-] state_path : /var/lib/nova from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:08 DEBUG nova.service [-] log_config : None from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:08 DEBUG nova.service [-] use_stderr : True from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:08 DEBUG nova.service [-] connection_type : libvirt from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:08 DEBUG nova.service [-] default_project : openstack from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:08 DEBUG nova.service [-] s3_port : 3333 from (pid=30502)
wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:08 DEBUG nova.service [-] logfile_mode : 0644 from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:08 DEBUG nova.service [-] default_ephemeral_format : None
from (pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:08 DEBUG nova.service [-] logging_context_format_string :
%(asctime)s %(levelname)s %(name)s [%(request_id)s %(user_id)s
%(project_id)s] %(instance)s%(message)s from (pid=30502) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:08 DEBUG nova.service [-] metadata_listen_port : 8775 from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:08 DEBUG nova.service [-] compute_scheduler_driver :
nova.scheduler.filter_scheduler.FilterScheduler from (pid=30502) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] isolated_hosts : [] from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] instance_name_template :
instance-%08x from (pid=30502) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] ec2_host : ip from (pid=30502)
wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] instance_usage_audit_period :
month from (pid=30502) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] log_dir : None from (pid=30502)
wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] rabbit_durable_queues : False
from (pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] quota_metadata_items : 128 from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] logging_debug_format_suffix :
from (pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] stub_network : False from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] console_manager :
nova.console.manager.ConsoleProxyManager from (pid=30502) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-]
zombie_instance_updated_at_window : 172800 from (pid=30502) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] rpc_backend :
nova.rpc.impl_kombu from (pid=30502) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] rabbit_userid : guest from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-]
running_deleted_instance_poll_interval : 30 from (pid=30502) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] osapi_volume_extension :
['nova.api.openstack.volume.contrib.standard_extensions'] from (pid=30502)
wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] osapi_scheme : http from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] sql_connection : FLAG SET  from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:409
2012-09-04 14:01:09 DEBUG nova.service [-] console_topic : console from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] instances_path :
/var/lib/nova/instances from (pid=30502) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] api_rate_limit : True from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] use_local_volumes : True from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] host : node086 from (pid=30502)
wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] instance_dns_domain :  from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] running_deleted_instance_action
: log from (pid=30502) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] console_host : node086 from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-]
quota_max_injected_file_content_bytes : 10240 from (pid=30502) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] reboot_timeout : 0 from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] glance_num_retries : 0 from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] db_backend : sqlalchemy from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] image_cache_manager_interval :
40 from (pid=30502) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] sql_retry_interval : 10 from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] volume_driver :
nova.volume.driver.ISCSIDriver from (pid=30502) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-]
compute_fill_first_cost_fn_weight : -1.0 from (pid=30502) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] monkey_patch : False from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] rpc_conn_pool_size : 30 from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] s3_host : ip from (pid=30502)
wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] sqlite_synchronous : True from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] reserved_host_disk_mb : 0 from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] volume_force_update_capabilities
: False from (pid=30502) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] scheduler_topic : scheduler from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] verbose : True from (pid=30502)
wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] sql_max_retries : 10 from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] noop_cost_fn_weight : 1.0 from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] default_instance_type : m1.small
from (pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] metadata_listen : 0.0.0.0 from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] firewall_driver :
nova.virt.firewall.IptablesFirewallDriver from (pid=30502) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] periodic_interval : 60 from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] vpn_key_suffix : FLAG SET  from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:409
2012-09-04 14:01:09 DEBUG nova.service [-] use_cow_images : True from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] scheduler_host_manager :
nova.scheduler.host_manager.HostManager from (pid=30502) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] osapi_volume_listen_port : 8776
from (pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] null_kernel : nokernel from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] instance_format : [instance:
%(uuid)s]  from (pid=30502) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] osapi_compute_link_prefix : None
from (pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] rpc_response_timeout : 60 from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] osapi_compute_ext_list : [] from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] default_notification_level :
INFO from (pid=30502) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] publish_errors : False from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] consoleauth_topic : consoleauth
from (pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] novncproxy_base_url :
http://127.0.0.1:6080/vnc_auto.html from (pid=30502) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] service_down_time : 60 from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] logging_exception_prefix :
%(asctime)s TRACE %(name)s %(instance)s from (pid=30502) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] enabled_apis : ['ec2',
'osapi_compute', 'osapi_volume', 'metadata'] from (pid=30502) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] volume_api_class :
nova.volume.api.API from (pid=30502) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] report_interval : 10 from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] start_guests_on_host_boot :
False from (pid=30502) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] pybasedir :
/usr/lib/python2.7/dist-packages from (pid=30502) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] metadata_manager :
nova.api.manager.MetadataManager from (pid=30502) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] isolated_images : [] from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] vnc_enabled : True from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] api_paste_config : api-paste.ini
from (pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] quota_security_group_rules : 20
from (pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] rabbit_virtual_host : / from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] network_driver :
nova.network.linux_net from (pid=30502) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] quota_instances : 10 from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] ram_allocation_ratio : 1.5 from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] vnc_keymap : FLAG SET  from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:409
2012-09-04 14:01:09 DEBUG nova.service [-] image_service :
nova.image.glance.GlanceImageService from (pid=30502) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] control_exchange : nova from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] log_file : None from (pid=30502)
wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] compute_manager :
nova.compute.manager.ComputeManager from (pid=30502) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] compute_driver :
nova.virt.connection.get_connection from (pid=30502) wait
/usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 DEBUG nova.service [-] network_topic : network from
(pid=30502) wait /usr/lib/python2.7/dist-packages/nova/service.py:411
2012-09-04 14:01:09 AUDIT nova.service [-] Starting scheduler node (version
2012.1-LOCALBRANCH:LOCALREVISION)
2012-09-04 14:01:09 DEBUG nova.utils [-] Found lockfile nova-iptables.lock
with link count 2 from (pid=30502) cleanup_file_locks
/usr/lib/python2.7/dist-packages/nova/utils.py:1023
2012-09-04 14:01:09 DEBUG nova.utils
[req-d4a8af8f-e06b-4216-857b-266c589dbe80 None None] backend <module
'nova.db.sqlalchemy.api' from
'/usr/lib/python2.7/dist-packages/nova/db/sqlalchemy/api.pyc'> from
(pid=30502) __get_backend /usr/lib/python2.7/dist-packages/nova/utils.py:658
2012-09-04 14:01:09 INFO nova.rpc.common
[req-d4a8af8f-e06b-4216-857b-266c589dbe80 None None] Connected to AMQP
server on localhost:5672
2012-09-04 14:01:09 DEBUG nova.service
[req-d4a8af8f-e06b-4216-857b-266c589dbe80 None None] Creating Consumer
connection for Service scheduler from (pid=30502) start
/usr/lib/python2.7/dist-packages/nova/service.py:178
2012-09-04 14:01:23 DEBUG nova.rpc.amqp [-] received {u'_context_roles':
[u'admin'], u'_context_request_id':
u'req-cb2fc380-600d-4133-ae3b-4bbda7b07a49', u'_context_read_deleted':
u'no', u'args': {u'service_name': u'compute', u'host': u'pv',
u'capabilities': {u'disk_available': 6, u'vcpus_used': 5,
u'hypervisor_type': u'Xen', u'disk_total': 7, u'host_memory_free': -6228,
u'vcpus': 1, u'disk_used': 1, u'host_memory_total': 512,
u'hypervisor_version': 4001000, u'cpu_info': {u'arch': u'x86_64',
u'features': [], u'topology': {}}}}, u'_context_auth_token': '<SANITIZED>',
u'_context_is_admin': True, u'_context_project_id': None,
u'_context_timestamp': u'2012-09-04T12:01:22.711033', u'_context_user_id':
None, u'method': u'update_service_capabilities',
u'_context_remote_address': None} from (pid=30502) _safe_log
/usr/lib/python2.7/dist-packages/nova/rpc/common.py:160
2012-09-04 14:01:23 DEBUG nova.rpc.amqp
[req-cb2fc380-600d-4133-ae3b-4bbda7b07a49 None None] unpacked context:
{'user_id': None, 'roles': [u'admin'], 'timestamp':
'2012-09-04T12:01:22.711033', 'auth_token': '<SANITIZED>',
'remote_address': None, 'is_admin': True, 'request_id':
u'req-cb2fc380-600d-4133-ae3b-4bbda7b07a49', 'project_id': None,
'read_deleted': u'no'} from (pid=30502) _safe_log
/usr/lib/python2.7/dist-packages/nova/rpc/common.py:160
2012-09-04 14:01:23 DEBUG nova.scheduler.host_manager
[req-cb2fc380-600d-4133-ae3b-4bbda7b07a49 None None] Received compute
service update from pv. from (pid=30502) update_service_capabilities
/usr/lib/python2.7/dist-packages/nova/scheduler/host_manager.py:273
2012-09-04 14:01:23 DEBUG nova.scheduler.host_manager
[req-cb2fc380-600d-4133-ae3b-4bbda7b07a49 None None] Received compute
service update from pv. from (pid=30502) update_service_capabilities
/usr/lib/python2.7/dist-packages/nova/scheduler/host_manager.py:273
2012-09-04 14:02:23 DEBUG nova.rpc.amqp [-] received {u'_context_roles':
[u'admin'], u'_context_request_id':
u'req-1a4c9600-dbba-43df-9262-152a447c01a9', u'_context_read_deleted':
u'no', u'args': {u'service_name': u'compute', u'host': u'pv',
u'capabilities': {u'disk_available': 6, u'vcpus_used': 5,
u'hypervisor_type': u'Xen', u'disk_total': 7, u'host_memory_free': -6228,
u'vcpus': 1, u'disk_used': 1, u'host_memory_total': 512,
u'hypervisor_version': 4001000, u'cpu_info': {u'arch': u'x86_64',
u'features': [], u'topology': {}}}}, u'_context_auth_token': '<SANITIZED>',
u'_context_is_admin': True, u'_context_project_id': None,
u'_context_timestamp': u'2012-09-04T12:02:22.916311', u'_context_user_id':
None, u'method': u'update_service_capabilities',
u'_context_remote_address': None} from (pid=30502) _safe_log
/usr/lib/python2.7/dist-packages/nova/rpc/common.py:160
2012-09-04 14:02:23 DEBUG nova.rpc.amqp
[req-1a4c9600-dbba-43df-9262-152a447c01a9 None None] unpacked context:
{'user_id': None, 'roles': [u'admin'], 'timestamp':
'2012-09-04T12:02:22.916311', 'auth_token': '<SANITIZED>',
'remote_address': None, 'is_admin': True, 'request_id':
u'req-1a4c9600-dbba-43df-9262-152a447c01a9', 'project_id': None,
'read_deleted': u'no'} from (pid=30502) _safe_log
/usr/lib/python2.7/dist-packages/nova/rpc/common.py:160
2012-09-04 14:02:23 DEBUG nova.scheduler.host_manager
[req-1a4c9600-dbba-43df-9262-152a447c01a9 None None] Received compute
service update from pv. from (pid=30502) update_service_capabilities
/usr/lib/python2.7/dist-packages/nova/scheduler/host_manager.py:273
2012-09-04 14:02:23 DEBUG nova.scheduler.host_manager
[req-1a4c9600-dbba-43df-9262-152a447c01a9 None None] Received compute
service update from pv. from (pid=30502) update_service_capabilities
/usr/lib/python2.7/dist-packages/nova/scheduler/host_manager.py:273
2012-09-04 14:03:23 DEBUG nova.rpc.amqp [-] received {u'_context_roles':
[u'admin'], u'_context_request_id':
u'req-1e5c2f4a-d0ae-43f2-9c6d-b1e37b044cde', u'_context_read_deleted':
u'no', u'args': {u'service_name': u'compute', u'host': u'pv',
u'capabilities': {u'disk_available': 6, u'vcpus_used': 5,
u'hypervisor_type': u'Xen', u'disk_total': 7, u'host_memory_free': -6228,
u'vcpus': 1, u'disk_used': 1, u'host_memory_total': 512,
u'hypervisor_version': 4001000, u'cpu_info': {u'arch': u'x86_64',
u'features': [], u'topology': {}}}}, u'_context_auth_token': '<SANITIZED>',
u'_context_is_admin': True, u'_context_project_id': None,
u'_context_timestamp': u'2012-09-04T12:03:23.184058', u'_context_user_id':
None, u'method': u'update_service_capabilities',
u'_context_remote_address': None} from (pid=30502) _safe_log
/usr/lib/python2.7/dist-packages/nova/rpc/common.py:160
2012-09-04 14:03:23 DEBUG nova.rpc.amqp
[req-1e5c2f4a-d0ae-43f2-9c6d-b1e37b044cde None None] unpacked context:
{'user_id': None, 'roles': [u'admin'], 'timestamp':
'2012-09-04T12:03:23.184058', 'auth_token': '<SANITIZED>',
'remote_address': None, 'is_admin': True, 'request_id':
u'req-1e5c2f4a-d0ae-43f2-9c6d-b1e37b044cde', 'project_id': None,
'read_deleted': u'no'} from (pid=30502) _safe_log
/usr/lib/python2.7/dist-packages/nova/rpc/common.py:160
2012-09-04 14:03:23 DEBUG nova.scheduler.host_manager
[req-1e5c2f4a-d0ae-43f2-9c6d-b1e37b044cde None None] Received compute
service update from pv. from (pid=30502) update_service_capabilities
/usr/lib/python2.7/dist-packages/nova/scheduler/host_manager.py:273
2012-09-04 14:03:23 DEBUG nova.scheduler.host_manager
[req-1e5c2f4a-d0ae-43f2-9c6d-b1e37b044cde None None] Received compute
service update from pv. from (pid=30502) update_service_capabilities
/usr/lib/python2.7/dist-packages/nova/scheduler/host_manager.py:273
2012-09-04 14:04:23 DEBUG nova.rpc.amqp [-] received {u'_context_roles':
[u'admin'], u'_context_request_id':
u'req-d15378ee-20fa-4b63-830e-a9207ce11a55', u'_context_read_deleted':
u'no', u'args': {u'service_name': u'compute', u'host': u'pv',
u'capabilities': {u'disk_available': 6, u'vcpus_used': 5,
u'hypervisor_type': u'Xen', u'disk_total': 7, u'host_memory_free': -6228,
u'vcpus': 1, u'disk_used': 1, u'host_memory_total': 512,
u'hypervisor_version': 4001000, u'cpu_info': {u'arch': u'x86_64',
u'features': [], u'topology': {}}}}, u'_context_auth_token': '<SANITIZED>',
u'_context_is_admin': True, u'_context_project_id': None,
u'_context_timestamp': u'2012-09-04T12:04:23.403376', u'_context_user_id':
None, u'method': u'update_service_capabilities',
u'_context_remote_address': None} from (pid=30502) _safe_log
/usr/lib/python2.7/dist-packages/nova/rpc/common.py:160
2012-09-04 14:04:23 DEBUG nova.rpc.amqp
[req-d15378ee-20fa-4b63-830e-a9207ce11a55 None None] unpacked context:
{'user_id': None, 'roles': [u'admin'], 'timestamp':
'2012-09-04T12:04:23.403376', 'auth_token': '<SANITIZED>',
'remote_address': None, 'is_admin': True, 'request_id':
u'req-d15378ee-20fa-4b63-830e-a9207ce11a55', 'project_id': None,
'read_deleted': u'no'} from (pid=30502) _safe_log
/usr/lib/python2.7/dist-packages/nova/rpc/common.py:160
2012-09-04 14:04:23 DEBUG nova.scheduler.host_manager
[req-d15378ee-20fa-4b63-830e-a9207ce11a55 None None] Received compute
service update from pv. from (pid=30502) update_service_capabilities
/usr/lib/python2.7/dist-packages/nova/scheduler/host_manager.py:273
2012-09-04 14:04:23 DEBUG nova.scheduler.host_manager
[req-d15378ee-20fa-4b63-830e-a9207ce11a55 None None] Received compute
service update from pv. from (pid=30502) update_service_capabilities
/usr/lib/python2.7/dist-packages/nova/scheduler/host_manager.py:273






2012/9/4 Eoghan Glynn <eglynn@xxxxxxxxxx>

>
>
> Given that the get_console_log RPC call times out (i.e. the
> compute-node-specific topic message is not being processed)
> and that the instance is stuck in the scheduling task, this
> suggests an issue with the nova-compute service on the node
> that your new instance is being scheduled to.
>
> Can you check if the nova-compute service on that host is
> responsive (check the scheduler logs to figure out which
> node if you have several) and restart it if necessary.
>
> Cheers,
> Eoghan
>
> ----- Original Message -----
> >
> > Thank you for you answer.
> > Actually, the problem was related to many issues ... I tried to solve
> > them.
> > However, I am still not able to launch an instance. When booting the
> > image, everything seems to be ok (no errors) but the status of the
> > instance stucks on "BUILD" and does not switch to "Active".
> > Here is the output of boot --debug:
> > nova --debug boot --flavor 1 --image
> > 387e6ac0-9e51-449f-871f-5c350d28a05f op1
> > connect: (ip, 5000)
> > send: 'POST /v2.0/tokens HTTP/1.1\r\nHost: ip:5000\r\nContent-Length:
> > 117\r\ncontent-type: application/json\r\naccept-encoding: gzip,
> > deflate\r\naccept: application/json\r\nuser-agent:
> > python-novaclient\r\n\r\n{"auth": {"tenantName": "openstackDemo",
> > "passwordCredentials": {"username": "adminUser", "password":
> > "secretword"}}}'
> > reply: 'HTTP/1.1 200 OK\r\n'
> > header: Content-Type: application/json
> > header: Vary: X-Auth-Token
> > header: Date: Tue, 04 Sep 2012 10:56:33 GMT
> > header: Transfer-Encoding: chunked
> > connect: (ip, 8774)
> > send: u'GET /v2/141d12e2431f47a5bf77f90da4800960/flavors/1
> > HTTP/1.1\r\nHost: ip:8774\r\nx-auth-project-id:
> > openstackDemo\r\nx-auth-token:
> > db508fb3c43d455eb8f55a089a5a9812\r\naccept-encoding: gzip,
> > deflate\r\naccept: application/json\r\nuser-agent:
> > python-novaclient\r\n\r\n'
> > reply: 'HTTP/1.1 200 OK\r\n'
> > header: X-Compute-Request-Id:
> > req-3f66603d-05e5-4603-bce6-621b528719c4
> > header: Content-Type: application/json
> > header: Content-Length: 349
> > header: Date: Tue, 04 Sep 2012 10:56:33 GMT
> > send: u'GET
> >
> /v2/141d12e2431f47a5bf77f90da4800960/images/387e6ac0-9e51-449f-871f-5c350d28a05f
> > HTTP/1.1\r\nHost: ip:8774\r\nx-auth-project-id:
> > openstackDemo\r\nx-auth-token:
> > db508fb3c43d455eb8f55a089a5a9812\r\naccept-encoding: gzip,
> > deflate\r\naccept: application/json\r\nuser-agent:
> > python-novaclient\r\n\r\n'
> > reply: 'HTTP/1.1 200 OK\r\n'
> > header: X-Compute-Request-Id:
> > req-578567ec-d4a1-40e4-bf7f-00e57af73f7e
> > header: Content-Type: application/json
> > header: Content-Length: 786
> > header: Date: Tue, 04 Sep 2012 10:56:33 GMT
> > send: u'GET
> >
> /v2/141d12e2431f47a5bf77f90da4800960/images/387e6ac0-9e51-449f-871f-5c350d28a05f
> > HTTP/1.1\r\nHost: ip:8774\r\nx-auth-project-id:
> > openstackDemo\r\nx-auth-token:
> > db508fb3c43d455eb8f55a089a5a9812\r\naccept-encoding: gzip,
> > deflate\r\naccept: application/json\r\nuser-agent:
> > python-novaclient\r\n\r\n'
> > reply: 'HTTP/1.1 200 OK\r\n'
> > header: X-Compute-Request-Id:
> > req-18d1f242-ff9b-49a4-abd6-1e4f975e7cbc
> > header: Content-Type: application/json
> > header: Content-Length: 786
> > header: Date: Tue, 04 Sep 2012 10:56:33 GMT
> > send: u'GET /v2/141d12e2431f47a5bf77f90da4800960/flavors/1
> > HTTP/1.1\r\nHost: ip:8774\r\nx-auth-project-id:
> > openstackDemo\r\nx-auth-token:
> > db508fb3c43d455eb8f55a089a5a9812\r\naccept-encoding: gzip,
> > deflate\r\naccept: application/json\r\nuser-agent:
> > python-novaclient\r\n\r\n'
> > reply: 'HTTP/1.1 200 OK\r\n'
> > header: X-Compute-Request-Id:
> > req-95eb694e-7ce6-47e6-b64b-bca88cceb8a7
> > header: Content-Type: application/json
> > header: Content-Length: 349
> > header: Date: Tue, 04 Sep 2012 10:56:33 GMT
> > send: u'POST /v2/141d12e2431f47a5bf77f90da4800960/servers
> > HTTP/1.1\r\nHost: ip:8774\r\nContent-Length:
> > 129\r\nx-auth-project-id: openstackDemo\r\naccept-encoding: gzip,
> > deflate\r\naccept: application/json\r\nx-auth-token:
> > db508fb3c43d455eb8f55a089a5a9812\r\nuser-agent:
> > python-novaclient\r\ncontent-type:
> > application/json\r\n\r\n{"server": {"min_count": 1, "flavorRef":
> > "1", "name": "op1", "imageRef":
> > "387e6ac0-9e51-449f-871f-5c350d28a05f", "max_count": 1}}'
> > reply: 'HTTP/1.1 202 Accepted\r\n'
> > header: X-Compute-Request-Id:
> > req-cda73f6f-6410-4368-af4a-4b29018e0ae0
> > header: Location:
> >
> http://ip:8774/v2/141d12e2431f47a5bf77f90da4800960/servers/2314f007-d446-477a-bcf0-6a5f77d4d25b
> > header: Content-Type: application/json
> > header: Content-Length: 396
> > header: Date: Tue, 04 Sep 2012 10:56:34 GMT
> > send: u'GET
> >
> /v2/141d12e2431f47a5bf77f90da4800960/servers/2314f007-d446-477a-bcf0-6a5f77d4d25b
> > HTTP/1.1\r\nHost: ip:8774\r\nx-auth-project-id:
> > openstackDemo\r\nx-auth-token:
> > db508fb3c43d455eb8f55a089a5a9812\r\naccept-encoding: gzip,
> > deflate\r\naccept: application/json\r\nuser-agent:
> > python-novaclient\r\n\r\n'
> > reply: 'HTTP/1.1 200 OK\r\n'
> > header: X-Compute-Request-Id:
> > req-f64a287d-26b3-47ca-8287-a506e53a52e8
> > header: Content-Type: application/json
> > header: Content-Length: 1267
> > header: Date: Tue, 04 Sep 2012 10:56:34 GMT
> > send: u'GET /v2/141d12e2431f47a5bf77f90da4800960/flavors/1
> > HTTP/1.1\r\nHost: ip:8774\r\nx-auth-project-id:
> > openstackDemo\r\nx-auth-token:
> > db508fb3c43d455eb8f55a089a5a9812\r\naccept-encoding: gzip,
> > deflate\r\naccept: application/json\r\nuser-agent:
> > python-novaclient\r\n\r\n'
> > reply: 'HTTP/1.1 200 OK\r\n'
> > header: X-Compute-Request-Id:
> > req-72fe38ae-5696-460b-ae31-00c3514cf996
> > header: Content-Type: application/json
> > header: Content-Length: 349
> > header: Date: Tue, 04 Sep 2012 10:56:34 GMT
> > send: u'GET
> >
> /v2/141d12e2431f47a5bf77f90da4800960/images/387e6ac0-9e51-449f-871f-5c350d28a05f
> > HTTP/1.1\r\nHost: ip:8774\r\nx-auth-project-id:
> > openstackDemo\r\nx-auth-token:
> > db508fb3c43d455eb8f55a089a5a9812\r\naccept-encoding: gzip,
> > deflate\r\naccept: application/json\r\nuser-agent:
> > python-novaclient\r\n\r\n'
> > reply: 'HTTP/1.1 200 OK\r\n'
> > header: X-Compute-Request-Id:
> > req-c5c6c0df-4ac7-4f50-b92a-35afb89aaa45
> > header: Content-Type: application/json
> > header: Content-Length: 786
> > header: Date: Tue, 04 Sep 2012 10:56:35 GMT
> >
> +-------------------------------------+--------------------------------------+
> > | Property | Value |
> >
> +-------------------------------------+--------------------------------------+
> > | OS-DCF:diskConfig | MANUAL |
> > | OS-EXT-SRV-ATTR:host | None |
> > | OS-EXT-SRV-ATTR:hypervisor_hostname | None |
> > | OS-EXT-SRV-ATTR:instance_name | instance-00000045 |
> > | OS-EXT-STS:power_state | 0 |
> > | OS-EXT-STS:task_state | scheduling |
> > | OS-EXT-STS:vm_state | building |
> > | accessIPv4 | |
> > | accessIPv6 | |
> > | adminPass | vRxK5r8mYK6H |
> > | config_drive | |
> > | created | 2012-09-04T10:56:34Z |
> > | flavor | m1.tiny |
> > | hostId | |
> > | id | 2314f007-d446-477a-bcf0-6a5f77d4d25b |
> > | image | tty-linux |
> > | key_name | |
> > | metadata | {} |
> > | name | op1 |
> > | progress | 0 |
> > | status | BUILD |
> > | tenant_id | 141d12e2431f47a5bf77f90da4800960 |
> > | updated | 2012-09-04T10:56:34Z |
> > | user_id | cf8971efd8934844b559d26e238506cc |
> >
> +-------------------------------------+--------------------------------------+
> >
> >
> > Log files (nova-api, nova-scheduler, nova-compute, nova-network) show
> > no errors.
> > "nova-manage logs errors" shows no errors.
> >
> >
> > When I try to launch "nova console-log op1", it shows the http 500
> > error. Then a new timeout error is added to nova-api.log. Here is
> > the error shown in nova-api.log
> > 2012-09-04 08:31:01 DEBUG nova.rpc.amqp
> > [req-0c9fe15a-0d0c-4e4a-a506-aff83886bc48
> > cf8971efd8934844b559d26e238506cc 141d12e2431f47a5bf77f90da4800960]
> > Making asynchronous cast on scheduler... from (pid=431) cast
> > /usr/lib/python2.7/dist-packages/nova/rpc/amqp.py:351
> > 2012-09-04 08:31:01 INFO nova.api.openstack.wsgi
> > [req-0c9fe15a-0d0c-4e4a-a506-aff83886bc48
> > cf8971efd8934844b559d26e238506cc 141d12e2431f47a5bf77f90da4800960]
> > http://ip:8774/v2/141d12e2431f47a5bf77f90da4800960/servers returned
> > with HTTP 202
> > 2012-09-04 08:31:01 INFO nova.api.openstack.wsgi
> > [req-3f4b9980-85cc-46ff-bf06-7d60659756f4
> > cf8971efd8934844b559d26e238506cc 141d12e2431f47a5bf77f90da4800960]
> > GET
> >
> http://ip:8774/v2/141d12e2431f47a5bf77f90da4800960/servers/83035d31-86d7-461e-b42e-b03300111766
> > "/var/log/nova/nova-api.log" 9795L, 2009777C 1,1 Top
> > 2012-09-04 13:09:16 TRACE nova.rpc.common return
> > connection.drain_events(**kwargs)
> > 2012-09-04 13:09:16 TRACE nova.rpc.common File
> > "/usr/lib/python2.7/dist-packages/kombu/transport/pyamqplib.py",
> > line 57, in drain_events
> > 2012-09-04 13:09:16 TRACE nova.rpc.common return
> > self.wait_multi(self.channels.values(), timeout=timeout)
> > 2012-09-04 13:09:16 TRACE nova.rpc.common File
> > "/usr/lib/python2.7/dist-packages/kombu/transport/pyamqplib.py",
> > line 63, in wait_multi
> > 2012-09-04 13:09:16 TRACE nova.rpc.common chanmap.keys(),
> > allowed_methods, timeout=timeout)
> > 2012-09-04 13:09:16 TRACE nova.rpc.common File
> > "/usr/lib/python2.7/dist-packages/kombu/transport/pyamqplib.py",
> > line 120, in _wait_multiple
> > 2012-09-04 13:09:16 TRACE nova.rpc.common channel, method_sig, args,
> > content = read_timeout(timeout)
> > 2012-09-04 13:09:16 TRACE nova.rpc.common File
> > "/usr/lib/python2.7/dist-packages/kombu/transport/pyamqplib.py",
> > line 94, in read_timeout
> > 2012-09-04 13:09:16 TRACE nova.rpc.common return
> > self.method_reader.read_method()
> > 2012-09-04 13:09:16 TRACE nova.rpc.common File
> > "/usr/lib/python2.7/dist-packages/amqplib/client_0_8/method_framing.py",
> > line 221, in read_method
> > 2012-09-04 13:09:16 TRACE nova.rpc.common raise m
> > 2012-09-04 13:09:16 TRACE nova.rpc.common timeout: timed out
> > 2012-09-04 13:09:16 TRACE nova.rpc.common
> > 2012-09-04 13:09:16 ERROR nova.api.openstack
> > [req-ebaafb8a-770f-467e-b0c4-d89527bc87b4
> > cf8971efd8934844b559d26e238506cc 141d12e2431f47a5bf77f90da4800960]
> > Caught error: Timeout while waiting on RPC response.
> > 2012-09-04 13:09:16 TRACE nova.api.openstack Traceback (most recent
> > call last):
> > 2012-09-04 13:09:16 TRACE nova.api.openstack File
> > "/usr/lib/python2.7/dist-packages/nova/api/openstack/__init__.py",
> > line 41, in __call__
> > 2012-09-04 13:09:16 TRACE nova.api.openstack return
> > req.get_response(self.application)
> > 2012-09-04 13:09:16 TRACE nova.api.openstack File
> > "/usr/lib/python2.7/dist-packages/webob/request.py", line 1086, in
> > get_response
> > 2012-09-04 13:09:16 TRACE nova.api.openstack application,
> > catch_exc_info=False)
> > 2012-09-04 13:09:16 TRACE nova.api.openstack File
> > "/usr/lib/python2.7/dist-packages/webob/request.py", line 1055, in
> > call_application
> > 2012-09-04 13:09:16 TRACE nova.api.openstack app_iter =
> > application(self.environ, start_response)
> > 2012-09-04 13:09:16 TRACE nova.api.openstack File
> > "/usr/lib/python2.7/dist-packages/keystone/middleware/auth_token.py",
> > line 176, in __call__
> > 2012-09-04 13:09:16 TRACE nova.api.openstack return self.app(env,
> > start_response)
> > 2012-09-04 13:09:16 TRACE nova.api.openstack File
> > "/usr/lib/python2.7/dist-packages/webob/dec.py", line 159, in
> > __call__
> > 2012-09-04 13:09:16 TRACE nova.api.openstack return resp(environ,
> > start_response)
> > 2012-09-04 13:09:16 TRACE nova.api.openstack File
> > "/usr/lib/python2.7/dist-packages/webob/dec.py", line 159, in
> > __call__
> > 2012-09-04 13:09:16 TRACE nova.api.openstack return resp(environ,
> > start_response)
> > 2012-09-04 13:09:16 TRACE nova.api.openstack File
> > "/usr/lib/python2.7/dist-packages/webob/dec.py", line 159, in
> > __call__
> > 2012-09-04 13:09:16 TRACE nova.api.openstack return resp(environ,
> > start_response)
> > 2012-09-04 13:09:16 TRACE nova.api.openstack File
> > "/usr/lib/python2.7/dist-packages/routes/middleware.py", line 131,
> > in __call__
> > 2012-09-04 13:09:16 TRACE nova.api.openstack response =
> > self.app(environ, start_response)
> > 2012-09-04 13:09:16 TRACE nova.api.openstack File
> > "/usr/lib/python2.7/dist-packages/webob/dec.py", line 159, in
> > __call__
> > 2012-09-04 13:09:16 TRACE nova.api.openstack return resp(environ,
> > start_response)
> > 2012-09-04 13:09:16 TRACE nova.api.openstack File
> > "/usr/lib/python2.7/dist-packages/webob/dec.py", line 147, in
> > __call__
> > 2012-09-04 13:09:16 TRACE nova.api.openstack resp =
> > self.call_func(req, *args, **self.kwargs)
> > 2012-09-04 13:09:16 TRACE nova.api.openstack File
> > "/usr/lib/python2.7/dist-packages/webob/dec.py", line 210, in
> > call_func
> > 2012-09-04 13:09:16 TRACE nova.api.openstack return self.func(req,
> > *args, **kwargs)
> > 2012-09-04 13:09:16 TRACE nova.api.openstack File
> > "/usr/lib/python2.7/dist-packages/nova/api/openstack/wsgi.py", line
> > 803, in __call__
> > 2012-09-04 13:09:16 TRACE nova.api.openstack content_type, body,
> > accept)
> > 2012-09-04 13:09:16 TRACE nova.api.openstack File
> > "/usr/lib/python2.7/dist-packages/nova/api/openstack/wsgi.py", line
> > 851, in _process_stack
> > 2012-09-04 13:09:16 TRACE nova.api.openstack action_result =
> > self.dispatch(meth, request, action_args)
> > 2012-09-04 13:09:16 TRACE nova.api.openstack File
> > "/usr/lib/python2.7/dist-packages/nova/api/openstack/wsgi.py", line
> > 926, in dispatch
> > 2012-09-04 13:09:16 TRACE nova.api.openstack return
> > method(req=request, **action_args)
> > 2012-09-04 13:09:16 TRACE nova.api.openstack File
> >
> "/usr/lib/python2.7/dist-packages/nova/api/openstack/compute/contrib/console_output.py",
> > line 57, in get_console_output
> > 2012-09-04 13:09:16 TRACE nova.api.openstack length)
> > 2012-09-04 13:09:16 TRACE nova.api.openstack File
> > "/usr/lib/python2.7/dist-packages/nova/compute/api.py", line 100, in
> > wrapped
> > 2012-09-04 13:09:16 TRACE nova.api.openstack return func(self,
> > context, target, *args, **kwargs)
> > 2012-09-04 13:09:16 TRACE nova.api.openstack File
> > "/usr/lib/python2.7/dist-packages/nova/compute/api.py", line 1549,
> > in get_console_output
> > 2012-09-04 13:09:16 TRACE nova.api.openstack instance, params=params)
> > 2012-09-04 13:09:16 TRACE nova.api.openstack File
> > "/usr/lib/python2.7/dist-packages/nova/compute/api.py", line 151, in
> > _call_compute_message
> > 2012-09-04 13:09:16 TRACE nova.api.openstack return
> > self._cast_or_call_compute_message(rpc.call, *args, **kwargs)
> > 2012-09-04 13:09:16 TRACE nova.api.openstack File
> > "/usr/lib/python2.7/dist-packages/nova/compute/api.py", line 143, in
> > _cast_or_call_compute_message
> > 2012-09-04 13:09:16 TRACE nova.api.openstack return
> > rpc_method(context, queue, kwargs)
> > 2012-09-04 13:09:16 TRACE nova.api.openstack File
> > "/usr/lib/python2.7/dist-packages/nova/rpc/__init__.py", line 68, in
> > call
> > 2012-09-04 13:09:16 TRACE nova.api.openstack return
> > _get_impl().call(context, topic, msg, timeout)
> > 2012-09-04 13:09:16 TRACE nova.api.openstack File
> > "/usr/lib/python2.7/dist-packages/nova/rpc/impl_kombu.py", line 674,
> > in call
> > 2012-09-04 13:09:16 TRACE nova.api.openstack return
> > rpc_amqp.call(context, topic, msg, timeout, Connection.pool)
> > 2012-09-04 13:09:16 TRACE nova.api.openstack File
> > "/usr/lib/python2.7/dist-packages/nova/rpc/amqp.py", line 343, in
> > call
> > 2012-09-04 13:09:16 TRACE nova.api.openstack rv = list(rv)
> > 2012-09-04 13:09:16 TRACE nova.api.openstack File
> > "/usr/lib/python2.7/dist-packages/nova/rpc/amqp.py", line 304, in
> > __iter__
> > 2012-09-04 13:09:16 TRACE nova.api.openstack self.done()
> > 2012-09-04 13:09:16 TRACE nova.api.openstack File
> > "/usr/lib/python2.7/contextlib.py", line 24, in __exit__
> > 2012-09-04 13:09:16 TRACE nova.api.openstack self.gen.next()
> > 2012-09-04 13:09:16 TRACE nova.api.openstack File
> > "/usr/lib/python2.7/dist-packages/nova/rpc/amqp.py", line 301, in
> > __iter__
> > 2012-09-04 13:09:16 TRACE nova.api.openstack self._iterator.next()
> > 2012-09-04 13:09:16 TRACE nova.api.openstack File
> > "/usr/lib/python2.7/dist-packages/nova/rpc/impl_kombu.py", line 572,
> > in iterconsume
> > 2012-09-04 13:09:16 TRACE nova.api.openstack yield
> > self.ensure(_error_callback, _consume)
> > 2012-09-04 13:09:16 TRACE nova.api.openstack File
> > "/usr/lib/python2.7/dist-packages/nova/rpc/impl_kombu.py", line 503,
> > in ensure
> > 2012-09-04 13:09:16 TRACE nova.api.openstack error_callback(e)
> > 2012-09-04 13:09:16 TRACE nova.api.openstack File
> > "/usr/lib/python2.7/dist-packages/nova/rpc/impl_kombu.py", line 553,
> > in _error_callback
> > 2012-09-04 13:09:16 TRACE nova.api.openstack raise
> > rpc_common.Timeout()
> > 2012-09-04 13:09:16 TRACE nova.api.openstack Timeout: Timeout while
> > waiting on RPC response.
> > 2012-09-04 13:09:16 TRACE nova.api.openstack
> > 2012-09-04 13:09:16 INFO nova.api.openstack
> > [req-ebaafb8a-770f-467e-b0c4-d89527bc87b4
> > cf8971efd8934844b559d26e238506cc 141d12e2431f47a5bf77f90da4800960]
> >
> http://ip:8774/v2/141d12e2431f47a5bf77f90da4800960/servers/2314f007-d446-477a-bcf0-6a5f77d4d25b/action
> > returned with HTTP 500
> >
> >
> >
> >
> >
> > 2012/9/3 Eoghan Glynn < eglynn@xxxxxxxxxx >
> >
> >
> >
> >
> >
> > > While trying to create a VM instance on openstack, the boot command
> > > (nova boot) returns the following error:
> > > ---
> > > ERROR: The server has either erred or is incapable of performing
> > > the
> > > requested operation. (HTTP 500)
> > > ---
> > > everything seems to be working (nova services are starting).
> > >
> > >
> > > I am using an Ubuntu 12.04 server (amd64) with Xen as a
> > > virtualization technology + the Essex version of openstack
> > >
> > >
> > > The used image was manually created (it is an ubuntu also). I can
> > > start it via xm commands.
> > >
> > >
> > > Any idea how to solve this problem?
> >
> >
> > The first step would be to surface more detailed information on the
> > failure
> > that has occurred.
> >
> > In Essex, most internal nova exceptions are mapped directly to 500
> > Server Error,
> > which effectively hides the underlying error condition from the
> > client.
> >
> > Folsom is more permissive in this regard, so that internal exceptions
> > declared
> > safe for exposure are returned to the user.
> >
> > So in your case, you'll need to scour the nova-api, nova-scheduler &
> > nova-compute
> > logs to get visibility on the underlying error condition.
> >
> > A quick short-cut would be to note the request ID returned (use "nova
> > --debug boot ...")
> > and then grep for this in the logs mentioned above.
> >
> > Cheers,
> > Eoghan
> >
> >
> >
> >
> >
> >
> >
> >
>



-- 
Afef MDHAFFAR
http://www.redcad.org/members/mdhaffar/
References

Re: boot command fails
From: Afef MDHAFFAR, 2012-09-04
Re: boot command fails
From: Eoghan Glynn, 2012-09-04