yahoo-eng-team team mailing list archive
-
yahoo-eng-team team
-
Mailing list archive
-
Message #63789
[Bug 1688249] [NEW] Instance create was failed.
Public bug reported:
I try create instance using "openstack server create". but instance create was not end.
I checked the log. it is following error.
Also, "reboot", "stop", and "start" is fine. it issue was only "create".
# openstack server create --flavor 1.Micro_EV --image Ubuntu16.04_x86_64 --nic net-id=1ae44feb-48be-4bf4-9130-f2e4791b91ce --security-group default --key-name my test
+--------------------------------------+-----------------------------------------------------------+
| Field | Value |
+--------------------------------------+-----------------------------------------------------------+
| OS-DCF:diskConfig | MANUAL |
| OS-EXT-AZ:availability_zone | |
| OS-EXT-SRV-ATTR:host | None |
| OS-EXT-SRV-ATTR:hypervisor_hostname | None |
| OS-EXT-SRV-ATTR:instance_name | instance-0000003b |
| OS-EXT-STS:power_state | NOSTATE |
| OS-EXT-STS:task_state | scheduling |
| OS-EXT-STS:vm_state | building |
| OS-SRV-USG:launched_at | None |
| OS-SRV-USG:terminated_at | None |
| accessIPv4 | |
| accessIPv6 | |
| addresses | |
| adminPass | 7oS2JcLYfNek |
| config_drive | |
| created | 2017-05-04T12:52:10Z |
| flavor | 1.Micro_EV (c10bcfa9-e6dc-46a1-9dbe-171dde0f87e8) |
| hostId | |
| id | 4c113eb1-a392-4ac4-a517-c3d20ef3a161 |
| image | Ubuntu16.04_x86_64 (2f14ad56-4cf7-411c-a163-bbafa76bb4d0) |
| key_name | my |
| name | test |
| os-extended-volumes:volumes_attached | [] |
| progress | 0 |
| project_id | e9d59586015f49bfa29e9856b0857fcc |
| properties | |
| security_groups | [{u'name': u'default'}] |
| status | BUILD |
| updated | 2017-05-04T12:52:11Z |
| user_id | f66a4379b9ab46de8f075b1a3d5bb663 |
+--------------------------------------+-----------------------------------------------------------+
nova instance-action-list 4c113eb1-a392-4ac4-a517-c3d20ef3a161
+--------+------------+---------+------------+
| Action | Request_ID | Message | Start_Time |
+--------+------------+---------+------------+
+--------+------------+---------+------------+
May 4 21:52:11 openstack nova-compute: 2017-05-04 21:52:11.627 14714 INFO nova.compute.manager [req-91859bf3-d097-4c4b-83df-e472a7315da7 f66a4379b9ab46de8f075b1a3d5bb663 e9d59586015f49bfa29e9856b0857fcc - - -] [instance: 4c113eb1-a392-4ac4-a517-c3d20ef3a161] Successfully reverted task state from scheduling on failure for instance.
May 4 21:52:11 openstack nova-compute[14714]: Traceback (most recent call last):
May 4 21:52:11 openstack nova-compute[14714]: File "/usr/lib/python2.7/dist-packages/eventlet/queue.py", line 118, in switch
May 4 21:52:11 openstack nova-compute[14714]: self.greenlet.switch(value)
May 4 21:52:11 openstack nova-compute[14714]: File "/usr/lib/python2.7/dist-packages/nova/utils.py", line 1113, in context_wrapper
May 4 21:52:11 openstack nova-compute[14714]: func(*args, **kwargs)
May 4 21:52:11 openstack nova-compute[14714]: File "/usr/lib/python2.7/dist-packages/oslo_concurrency/lockutils.py", line 274, in inner
May 4 21:52:11 openstack nova-compute[14714]: return f(*args, **kwargs)
May 4 21:52:11 openstack nova-compute[14714]: File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1711, in _locked_do_build_and_run_instance
May 4 21:52:11 openstack nova-compute[14714]: self._do_build_and_run_instance(*args, **kwargs)
May 4 21:52:11 openstack nova-compute[14714]: File "/usr/lib/python2.7/dist-packages/nova/hooks.py", line 154, in inner
May 4 21:52:11 openstack nova-compute[14714]: rv = f(*args, **kwargs)
May 4 21:52:11 openstack nova-compute[14714]: File "/usr/lib/python2.7/dist-packages/nova/exception_wrapper.py", line 75, in wrapped
May 4 21:52:11 openstack nova-compute[14714]: function_name, call_dict, binary)
May 4 21:52:11 openstack nova-compute[14714]: File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
May 4 21:52:11 openstack nova-compute[14714]: self.force_reraise()
May 4 21:52:11 openstack nova-compute[14714]: File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
May 4 21:52:11 openstack nova-compute[14714]: six.reraise(self.type_, self.value, self.tb)
May 4 21:52:11 openstack nova-compute[14714]: File "/usr/lib/python2.7/dist-packages/nova/exception_wrapper.py", line 66, in wrapped
May 4 21:52:11 openstack nova-compute[14714]: return f(self, context, *args, **kw)
May 4 21:52:11 openstack nova-compute[14714]: File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 188, in decorated_function
May 4 21:52:11 openstack nova-compute[14714]: LOG.warning(msg, e, instance=instance)
May 4 21:52:11 openstack nova-compute[14714]: File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
May 4 21:52:11 openstack nova-compute[14714]: self.force_reraise()
May 4 21:52:11 openstack nova-compute[14714]: File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
May 4 21:52:11 openstack nova-compute[14714]: six.reraise(self.type_, self.value, self.tb)
May 4 21:52:11 openstack nova-compute[14714]: File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 157, in decorated_function
May 4 21:52:11 openstack nova-compute[14714]: return function(self, context, *args, **kwargs)
May 4 21:52:11 openstack nova-compute[14714]: File "/usr/lib/python2.7/dist-packages/nova/compute/utils.py", line 685, in decorated_function
May 4 21:52:11 openstack nova-compute[14714]: with EventReporter(context, event_name, instance_uuid):
May 4 21:52:11 openstack nova-compute[14714]: File "/usr/lib/python2.7/dist-packages/nova/compute/utils.py", line 656, in __enter__
May 4 21:52:11 openstack nova-compute[14714]: self.context, uuid, self.event_name, want_result=False)
May 4 21:52:11 openstack nova-compute[14714]: File "/usr/lib/python2.7/dist-packages/oslo_versionedobjects/base.py", line 177, in wrapper
May 4 21:52:11 openstack nova-compute[14714]: args, kwargs)
May 4 21:52:11 openstack nova-compute[14714]: File "/usr/lib/python2.7/dist-packages/nova/conductor/rpcapi.py", line 239, in object_class_action_versions
May 4 21:52:11 openstack nova-compute[14714]: args=args, kwargs=kwargs)
May 4 21:52:11 openstack nova-compute[14714]: File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/client.py", line 169, in call
May 4 21:52:11 openstack nova-compute[14714]: retry=self.retry)
May 4 21:52:11 openstack nova-compute[14714]: File "/usr/lib/python2.7/dist-packages/oslo_messaging/transport.py", line 97, in _send
May 4 21:52:11 openstack nova-compute[14714]: timeout=timeout, retry=retry)
May 4 21:52:11 openstack nova-compute[14714]: File "/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 458, in send
May 4 21:52:11 openstack nova-compute[14714]: retry=retry)
May 4 21:52:11 openstack nova-compute[14714]: File "/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 449, in _send
May 4 21:52:11 openstack nova-compute[14714]: raise result
May 4 21:52:11 openstack nova-compute[14714]: InstanceActionNotFound_Remote: Action for request_id req-91859bf3-d097-4c4b-83df-e472a7315da7 on instance 4c113eb1-a392-4ac4-a517-c3d20ef3a161 not found
May 4 21:52:11 openstack nova-compute[14714]: Traceback (most recent call last):
May 4 21:52:11 openstack nova-compute[14714]: File "/usr/lib/python2.7/dist-packages/nova/conductor/manager.py", line 92, in _object_dispatch
May 4 21:52:11 openstack nova-compute[14714]: return getattr(target, method)(*args, **kwargs)
May 4 21:52:11 openstack nova-compute[14714]: File "/usr/lib/python2.7/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper
May 4 21:52:11 openstack nova-compute[14714]: result = fn(cls, context, *args, **kwargs)
May 4 21:52:11 openstack nova-compute[14714]: File "/usr/lib/python2.7/dist-packages/nova/objects/instance_action.py", line 169, in event_start
May 4 21:52:11 openstack nova-compute[14714]: db_event = db.action_event_start(context, values)
May 4 21:52:11 openstack nova-compute[14714]: File "/usr/lib/python2.7/dist-packages/nova/db/api.py", line 1938, in action_event_start
May 4 21:52:11 openstack nova-compute[14714]: return IMPL.action_event_start(context, values)
May 4 21:52:11 openstack nova-compute[14714]: File "/usr/lib/python2.7/dist-packages/nova/db/sqlalchemy/api.py", line 251, in wrapped
May 4 21:52:11 openstack nova-compute[14714]: return f(context, *args, **kwargs)
May 4 21:52:11 openstack nova-compute[14714]: File "/usr/lib/python2.7/dist-packages/nova/db/sqlalchemy/api.py", line 6199, in action_event_start
May 4 21:52:11 openstack nova-compute[14714]: instance_uuid=values['instance_uuid'])
May 4 21:52:11 openstack nova-compute[14714]: InstanceActionNotFound: Action for request_id req-91859bf3-d097-4c4b-83df-e472a7315da7 on instance 4c113eb1-a392-4ac4-a517-c3d20ef3a161 not found
Package lists.
ii nova-api 2:15.0.2-0ubuntu1~cloud0 all OpenStack Compute - API frontend
ii nova-cert 2:15.0.2-0ubuntu1~cloud0 all OpenStack Compute - certificate management
ii nova-common 2:15.0.2-0ubuntu1~cloud0 all OpenStack Compute - common files
ii nova-compute 2:15.0.2-0ubuntu1~cloud0 all OpenStack Compute - compute node base
ii nova-compute-kvm 2:15.0.2-0ubuntu1~cloud0 all OpenStack Compute - compute node (KVM)
ii nova-compute-libvirt 2:15.0.2-0ubuntu1~cloud0 all OpenStack Compute - compute node libvirt support
ii nova-conductor 2:15.0.2-0ubuntu1~cloud0 all OpenStack Compute - conductor service
ii nova-consoleauth 2:15.0.2-0ubuntu1~cloud0 all OpenStack Compute - Console Authenticator
ii nova-novncproxy 2:15.0.2-0ubuntu1~cloud0 all OpenStack Compute - NoVNC proxy
ii nova-placement-api 2:15.0.2-0ubuntu1~cloud0 all OpenStack Compute - placement API frontend
ii nova-scheduler 2:15.0.2-0ubuntu1~cloud0 all OpenStack Compute - virtual machine scheduler
ii python-nova 2:15.0.2-0ubuntu1~cloud0 all OpenStack Compute Python libraries
ii python-novaclient 2:7.1.0-0ubuntu1~cloud0 all client library for OpenStack Compute API - Python 2.7
** Affects: nova
Importance: Undecided
Status: New
--
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1688249
Title:
Instance create was failed.
Status in OpenStack Compute (nova):
New
Bug description:
I try create instance using "openstack server create". but instance create was not end.
I checked the log. it is following error.
Also, "reboot", "stop", and "start" is fine. it issue was only "create".
# openstack server create --flavor 1.Micro_EV --image Ubuntu16.04_x86_64 --nic net-id=1ae44feb-48be-4bf4-9130-f2e4791b91ce --security-group default --key-name my test
+--------------------------------------+-----------------------------------------------------------+
| Field | Value |
+--------------------------------------+-----------------------------------------------------------+
| OS-DCF:diskConfig | MANUAL |
| OS-EXT-AZ:availability_zone | |
| OS-EXT-SRV-ATTR:host | None |
| OS-EXT-SRV-ATTR:hypervisor_hostname | None |
| OS-EXT-SRV-ATTR:instance_name | instance-0000003b |
| OS-EXT-STS:power_state | NOSTATE |
| OS-EXT-STS:task_state | scheduling |
| OS-EXT-STS:vm_state | building |
| OS-SRV-USG:launched_at | None |
| OS-SRV-USG:terminated_at | None |
| accessIPv4 | |
| accessIPv6 | |
| addresses | |
| adminPass | 7oS2JcLYfNek |
| config_drive | |
| created | 2017-05-04T12:52:10Z |
| flavor | 1.Micro_EV (c10bcfa9-e6dc-46a1-9dbe-171dde0f87e8) |
| hostId | |
| id | 4c113eb1-a392-4ac4-a517-c3d20ef3a161 |
| image | Ubuntu16.04_x86_64 (2f14ad56-4cf7-411c-a163-bbafa76bb4d0) |
| key_name | my |
| name | test |
| os-extended-volumes:volumes_attached | [] |
| progress | 0 |
| project_id | e9d59586015f49bfa29e9856b0857fcc |
| properties | |
| security_groups | [{u'name': u'default'}] |
| status | BUILD |
| updated | 2017-05-04T12:52:11Z |
| user_id | f66a4379b9ab46de8f075b1a3d5bb663 |
+--------------------------------------+-----------------------------------------------------------+
nova instance-action-list 4c113eb1-a392-4ac4-a517-c3d20ef3a161
+--------+------------+---------+------------+
| Action | Request_ID | Message | Start_Time |
+--------+------------+---------+------------+
+--------+------------+---------+------------+
May 4 21:52:11 openstack nova-compute: 2017-05-04 21:52:11.627 14714 INFO nova.compute.manager [req-91859bf3-d097-4c4b-83df-e472a7315da7 f66a4379b9ab46de8f075b1a3d5bb663 e9d59586015f49bfa29e9856b0857fcc - - -] [instance: 4c113eb1-a392-4ac4-a517-c3d20ef3a161] Successfully reverted task state from scheduling on failure for instance.
May 4 21:52:11 openstack nova-compute[14714]: Traceback (most recent call last):
May 4 21:52:11 openstack nova-compute[14714]: File "/usr/lib/python2.7/dist-packages/eventlet/queue.py", line 118, in switch
May 4 21:52:11 openstack nova-compute[14714]: self.greenlet.switch(value)
May 4 21:52:11 openstack nova-compute[14714]: File "/usr/lib/python2.7/dist-packages/nova/utils.py", line 1113, in context_wrapper
May 4 21:52:11 openstack nova-compute[14714]: func(*args, **kwargs)
May 4 21:52:11 openstack nova-compute[14714]: File "/usr/lib/python2.7/dist-packages/oslo_concurrency/lockutils.py", line 274, in inner
May 4 21:52:11 openstack nova-compute[14714]: return f(*args, **kwargs)
May 4 21:52:11 openstack nova-compute[14714]: File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1711, in _locked_do_build_and_run_instance
May 4 21:52:11 openstack nova-compute[14714]: self._do_build_and_run_instance(*args, **kwargs)
May 4 21:52:11 openstack nova-compute[14714]: File "/usr/lib/python2.7/dist-packages/nova/hooks.py", line 154, in inner
May 4 21:52:11 openstack nova-compute[14714]: rv = f(*args, **kwargs)
May 4 21:52:11 openstack nova-compute[14714]: File "/usr/lib/python2.7/dist-packages/nova/exception_wrapper.py", line 75, in wrapped
May 4 21:52:11 openstack nova-compute[14714]: function_name, call_dict, binary)
May 4 21:52:11 openstack nova-compute[14714]: File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
May 4 21:52:11 openstack nova-compute[14714]: self.force_reraise()
May 4 21:52:11 openstack nova-compute[14714]: File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
May 4 21:52:11 openstack nova-compute[14714]: six.reraise(self.type_, self.value, self.tb)
May 4 21:52:11 openstack nova-compute[14714]: File "/usr/lib/python2.7/dist-packages/nova/exception_wrapper.py", line 66, in wrapped
May 4 21:52:11 openstack nova-compute[14714]: return f(self, context, *args, **kw)
May 4 21:52:11 openstack nova-compute[14714]: File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 188, in decorated_function
May 4 21:52:11 openstack nova-compute[14714]: LOG.warning(msg, e, instance=instance)
May 4 21:52:11 openstack nova-compute[14714]: File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
May 4 21:52:11 openstack nova-compute[14714]: self.force_reraise()
May 4 21:52:11 openstack nova-compute[14714]: File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
May 4 21:52:11 openstack nova-compute[14714]: six.reraise(self.type_, self.value, self.tb)
May 4 21:52:11 openstack nova-compute[14714]: File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 157, in decorated_function
May 4 21:52:11 openstack nova-compute[14714]: return function(self, context, *args, **kwargs)
May 4 21:52:11 openstack nova-compute[14714]: File "/usr/lib/python2.7/dist-packages/nova/compute/utils.py", line 685, in decorated_function
May 4 21:52:11 openstack nova-compute[14714]: with EventReporter(context, event_name, instance_uuid):
May 4 21:52:11 openstack nova-compute[14714]: File "/usr/lib/python2.7/dist-packages/nova/compute/utils.py", line 656, in __enter__
May 4 21:52:11 openstack nova-compute[14714]: self.context, uuid, self.event_name, want_result=False)
May 4 21:52:11 openstack nova-compute[14714]: File "/usr/lib/python2.7/dist-packages/oslo_versionedobjects/base.py", line 177, in wrapper
May 4 21:52:11 openstack nova-compute[14714]: args, kwargs)
May 4 21:52:11 openstack nova-compute[14714]: File "/usr/lib/python2.7/dist-packages/nova/conductor/rpcapi.py", line 239, in object_class_action_versions
May 4 21:52:11 openstack nova-compute[14714]: args=args, kwargs=kwargs)
May 4 21:52:11 openstack nova-compute[14714]: File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/client.py", line 169, in call
May 4 21:52:11 openstack nova-compute[14714]: retry=self.retry)
May 4 21:52:11 openstack nova-compute[14714]: File "/usr/lib/python2.7/dist-packages/oslo_messaging/transport.py", line 97, in _send
May 4 21:52:11 openstack nova-compute[14714]: timeout=timeout, retry=retry)
May 4 21:52:11 openstack nova-compute[14714]: File "/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 458, in send
May 4 21:52:11 openstack nova-compute[14714]: retry=retry)
May 4 21:52:11 openstack nova-compute[14714]: File "/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 449, in _send
May 4 21:52:11 openstack nova-compute[14714]: raise result
May 4 21:52:11 openstack nova-compute[14714]: InstanceActionNotFound_Remote: Action for request_id req-91859bf3-d097-4c4b-83df-e472a7315da7 on instance 4c113eb1-a392-4ac4-a517-c3d20ef3a161 not found
May 4 21:52:11 openstack nova-compute[14714]: Traceback (most recent call last):
May 4 21:52:11 openstack nova-compute[14714]: File "/usr/lib/python2.7/dist-packages/nova/conductor/manager.py", line 92, in _object_dispatch
May 4 21:52:11 openstack nova-compute[14714]: return getattr(target, method)(*args, **kwargs)
May 4 21:52:11 openstack nova-compute[14714]: File "/usr/lib/python2.7/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper
May 4 21:52:11 openstack nova-compute[14714]: result = fn(cls, context, *args, **kwargs)
May 4 21:52:11 openstack nova-compute[14714]: File "/usr/lib/python2.7/dist-packages/nova/objects/instance_action.py", line 169, in event_start
May 4 21:52:11 openstack nova-compute[14714]: db_event = db.action_event_start(context, values)
May 4 21:52:11 openstack nova-compute[14714]: File "/usr/lib/python2.7/dist-packages/nova/db/api.py", line 1938, in action_event_start
May 4 21:52:11 openstack nova-compute[14714]: return IMPL.action_event_start(context, values)
May 4 21:52:11 openstack nova-compute[14714]: File "/usr/lib/python2.7/dist-packages/nova/db/sqlalchemy/api.py", line 251, in wrapped
May 4 21:52:11 openstack nova-compute[14714]: return f(context, *args, **kwargs)
May 4 21:52:11 openstack nova-compute[14714]: File "/usr/lib/python2.7/dist-packages/nova/db/sqlalchemy/api.py", line 6199, in action_event_start
May 4 21:52:11 openstack nova-compute[14714]: instance_uuid=values['instance_uuid'])
May 4 21:52:11 openstack nova-compute[14714]: InstanceActionNotFound: Action for request_id req-91859bf3-d097-4c4b-83df-e472a7315da7 on instance 4c113eb1-a392-4ac4-a517-c3d20ef3a161 not found
Package lists.
ii nova-api 2:15.0.2-0ubuntu1~cloud0 all OpenStack Compute - API frontend
ii nova-cert 2:15.0.2-0ubuntu1~cloud0 all OpenStack Compute - certificate management
ii nova-common 2:15.0.2-0ubuntu1~cloud0 all OpenStack Compute - common files
ii nova-compute 2:15.0.2-0ubuntu1~cloud0 all OpenStack Compute - compute node base
ii nova-compute-kvm 2:15.0.2-0ubuntu1~cloud0 all OpenStack Compute - compute node (KVM)
ii nova-compute-libvirt 2:15.0.2-0ubuntu1~cloud0 all OpenStack Compute - compute node libvirt support
ii nova-conductor 2:15.0.2-0ubuntu1~cloud0 all OpenStack Compute - conductor service
ii nova-consoleauth 2:15.0.2-0ubuntu1~cloud0 all OpenStack Compute - Console Authenticator
ii nova-novncproxy 2:15.0.2-0ubuntu1~cloud0 all OpenStack Compute - NoVNC proxy
ii nova-placement-api 2:15.0.2-0ubuntu1~cloud0 all OpenStack Compute - placement API frontend
ii nova-scheduler 2:15.0.2-0ubuntu1~cloud0 all OpenStack Compute - virtual machine scheduler
ii python-nova 2:15.0.2-0ubuntu1~cloud0 all OpenStack Compute Python libraries
ii python-novaclient 2:7.1.0-0ubuntu1~cloud0 all client library for OpenStack Compute API - Python 2.7
To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1688249/+subscriptions
Follow ups
