yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1793766] [NEW] An unknown error has occurred when trying to get the list of nodes from the Ironic inventory. Error: StrictVersion instance has no attribute 'version'

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: Matt Riedemann <mriedem.os@xxxxxxxxx>
Date: Fri, 21 Sep 2018 14:20:28 -0000
Reply-to: Bug 1793766 <1793766@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
Public bug reported:

Seen in Ironic CI jobs since Rocky when version discovery was added to
the ironic virt driver in nova-compute:

http://logs.openstack.org/27/602127/2/check/ironic-tempest-dsvm-ipa-
wholedisk-bios-agent_ipmitool-
tinyipa/4238d0f/controller/logs/screen-n-cpu.txt.gz?level=TRACE#_Sep_20_21_52_53_685133

Sep 20 21:52:03.587629 ubuntu-xenial-inap-mtl01-0002177186 nova-compute[14241]: ERROR oslo_service.periodic_task Traceback (most recent call last):
Sep 20 21:52:03.587816 ubuntu-xenial-inap-mtl01-0002177186 nova-compute[14241]: ERROR oslo_service.periodic_task   File "/usr/local/lib/python2.7/dist-packages/oslo_service/periodic_task.py", line 220, in run_periodic_tasks
Sep 20 21:52:03.588019 ubuntu-xenial-inap-mtl01-0002177186 nova-compute[14241]: ERROR oslo_service.periodic_task     task(self, context)
Sep 20 21:52:03.588182 ubuntu-xenial-inap-mtl01-0002177186 nova-compute[14241]: ERROR oslo_service.periodic_task   File "/opt/stack/nova/nova/compute/manager.py", line 7462, in _sync_power_states
Sep 20 21:52:03.588344 ubuntu-xenial-inap-mtl01-0002177186 nova-compute[14241]: ERROR oslo_service.periodic_task     num_vm_instances = self.driver.get_num_instances()
Sep 20 21:52:03.588517 ubuntu-xenial-inap-mtl01-0002177186 nova-compute[14241]: ERROR oslo_service.periodic_task   File "/opt/stack/nova/nova/virt/driver.py", line 183, in get_num_instances
Sep 20 21:52:03.588714 ubuntu-xenial-inap-mtl01-0002177186 nova-compute[14241]: ERROR oslo_service.periodic_task     return len(self.list_instances())
Sep 20 21:52:03.588885 ubuntu-xenial-inap-mtl01-0002177186 nova-compute[14241]: ERROR oslo_service.periodic_task   File "/opt/stack/nova/nova/virt/ironic/driver.py", line 624, in list_instances
Sep 20 21:52:03.589071 ubuntu-xenial-inap-mtl01-0002177186 nova-compute[14241]: ERROR oslo_service.periodic_task     fields=['instance_uuid'], limit=0)
Sep 20 21:52:03.589263 ubuntu-xenial-inap-mtl01-0002177186 nova-compute[14241]: ERROR oslo_service.periodic_task   File "/opt/stack/nova/nova/virt/ironic/driver.py", line 611, in _get_node_list
Sep 20 21:52:03.589447 ubuntu-xenial-inap-mtl01-0002177186 nova-compute[14241]: ERROR oslo_service.periodic_task     raise exception.VirtDriverNotReady()
Sep 20 21:52:03.589602 ubuntu-xenial-inap-mtl01-0002177186 nova-compute[14241]: ERROR oslo_service.periodic_task VirtDriverNotReady: Virt driver is not ready.
Sep 20 21:52:03.589770 ubuntu-xenial-inap-mtl01-0002177186 nova-compute[14241]: ERROR oslo_service.periodic_task 
Sep 20 21:52:53.625466 ubuntu-xenial-inap-mtl01-0002177186 nova-compute[14241]: ERROR nova.compute.manager [None req-2339900e-55df-468b-95ff-b904d73d5728 None None] No compute node record for host ubuntu-xenial-inap-mtl01-0002177186: ComputeHostNotFound_Remote: Compute host ubuntu-xenial-inap-mtl01-0002177186 could not be found.
Sep 20 21:52:53.685133 ubuntu-xenial-inap-mtl01-0002177186 nova-compute[14241]: ERROR nova.virt.ironic.driver [None req-2339900e-55df-468b-95ff-b904d73d5728 None None] An unknown error has occurred when trying to get the list of nodes from the Ironic inventory. Error: StrictVersion instance has no attribute 'version'
Sep 20 21:52:53.685496 ubuntu-xenial-inap-mtl01-0002177186 nova-compute[14241]: WARNING nova.compute.manager [None req-2339900e-55df-468b-95ff-b904d73d5728 None None] Virt driver is not ready.: VirtDriverNotReady: Virt driver is not ready.

The virt driver not ready error is normal/expected while ironic is
coming up after nova-compute, but the StrictVersion thing should be
handled probably.

** Affects: nova
     Importance: Low
         Status: Confirmed


** Tags: compute ironic

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1793766

Title:
  An unknown error has occurred when trying to get the list of nodes
  from the Ironic inventory. Error: StrictVersion instance has no
  attribute 'version'

Status in OpenStack Compute (nova):
  Confirmed

Bug description:
  Seen in Ironic CI jobs since Rocky when version discovery was added to
  the ironic virt driver in nova-compute:

  http://logs.openstack.org/27/602127/2/check/ironic-tempest-dsvm-ipa-
  wholedisk-bios-agent_ipmitool-
  tinyipa/4238d0f/controller/logs/screen-n-cpu.txt.gz?level=TRACE#_Sep_20_21_52_53_685133

  Sep 20 21:52:03.587629 ubuntu-xenial-inap-mtl01-0002177186 nova-compute[14241]: ERROR oslo_service.periodic_task Traceback (most recent call last):
  Sep 20 21:52:03.587816 ubuntu-xenial-inap-mtl01-0002177186 nova-compute[14241]: ERROR oslo_service.periodic_task   File "/usr/local/lib/python2.7/dist-packages/oslo_service/periodic_task.py", line 220, in run_periodic_tasks
  Sep 20 21:52:03.588019 ubuntu-xenial-inap-mtl01-0002177186 nova-compute[14241]: ERROR oslo_service.periodic_task     task(self, context)
  Sep 20 21:52:03.588182 ubuntu-xenial-inap-mtl01-0002177186 nova-compute[14241]: ERROR oslo_service.periodic_task   File "/opt/stack/nova/nova/compute/manager.py", line 7462, in _sync_power_states
  Sep 20 21:52:03.588344 ubuntu-xenial-inap-mtl01-0002177186 nova-compute[14241]: ERROR oslo_service.periodic_task     num_vm_instances = self.driver.get_num_instances()
  Sep 20 21:52:03.588517 ubuntu-xenial-inap-mtl01-0002177186 nova-compute[14241]: ERROR oslo_service.periodic_task   File "/opt/stack/nova/nova/virt/driver.py", line 183, in get_num_instances
  Sep 20 21:52:03.588714 ubuntu-xenial-inap-mtl01-0002177186 nova-compute[14241]: ERROR oslo_service.periodic_task     return len(self.list_instances())
  Sep 20 21:52:03.588885 ubuntu-xenial-inap-mtl01-0002177186 nova-compute[14241]: ERROR oslo_service.periodic_task   File "/opt/stack/nova/nova/virt/ironic/driver.py", line 624, in list_instances
  Sep 20 21:52:03.589071 ubuntu-xenial-inap-mtl01-0002177186 nova-compute[14241]: ERROR oslo_service.periodic_task     fields=['instance_uuid'], limit=0)
  Sep 20 21:52:03.589263 ubuntu-xenial-inap-mtl01-0002177186 nova-compute[14241]: ERROR oslo_service.periodic_task   File "/opt/stack/nova/nova/virt/ironic/driver.py", line 611, in _get_node_list
  Sep 20 21:52:03.589447 ubuntu-xenial-inap-mtl01-0002177186 nova-compute[14241]: ERROR oslo_service.periodic_task     raise exception.VirtDriverNotReady()
  Sep 20 21:52:03.589602 ubuntu-xenial-inap-mtl01-0002177186 nova-compute[14241]: ERROR oslo_service.periodic_task VirtDriverNotReady: Virt driver is not ready.
  Sep 20 21:52:03.589770 ubuntu-xenial-inap-mtl01-0002177186 nova-compute[14241]: ERROR oslo_service.periodic_task 
  Sep 20 21:52:53.625466 ubuntu-xenial-inap-mtl01-0002177186 nova-compute[14241]: ERROR nova.compute.manager [None req-2339900e-55df-468b-95ff-b904d73d5728 None None] No compute node record for host ubuntu-xenial-inap-mtl01-0002177186: ComputeHostNotFound_Remote: Compute host ubuntu-xenial-inap-mtl01-0002177186 could not be found.
  Sep 20 21:52:53.685133 ubuntu-xenial-inap-mtl01-0002177186 nova-compute[14241]: ERROR nova.virt.ironic.driver [None req-2339900e-55df-468b-95ff-b904d73d5728 None None] An unknown error has occurred when trying to get the list of nodes from the Ironic inventory. Error: StrictVersion instance has no attribute 'version'
  Sep 20 21:52:53.685496 ubuntu-xenial-inap-mtl01-0002177186 nova-compute[14241]: WARNING nova.compute.manager [None req-2339900e-55df-468b-95ff-b904d73d5728 None None] Virt driver is not ready.: VirtDriverNotReady: Virt driver is not ready.

  The virt driver not ready error is normal/expected while ironic is
  coming up after nova-compute, but the StrictVersion thing should be
  handled probably.

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1793766/+subscriptions