← Back to team overview

yahoo-eng-team team mailing list archive

  1. yahoo-eng-team team
  2. Mailing list archive
  3. Message #36656

[Bug 1482738] [NEW] _poll_bandwidth_usage task fails to create bw usage object with TypeError

  Thread Previous • Date Previous • • Thread Next 
*** This bug is a duplicate of bug 1442749 ***
    https://bugs.launchpad.net/bugs/1442749

Public bug reported:

I noticed this in the logs of a citrix xenserver CI job run:

http://dd6b71949550285df7dc-
dda4e480e005aaa13ec303551d2d8155.r49.cf1.rackcdn.com/15/210515/1/7541//logs/screen-n-cpu.txt.gz

2015-08-07 17:05:19.168 ERROR oslo_service.periodic_task [req-129cdac2-1a3a-458c-ab38-7eeebcea9672 None None] Error during ComputeManager._poll_bandwidth_usage
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task Traceback (most recent call last):
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task   File "/usr/local/lib/python2.7/dist-packages/oslo_service/periodic_task.py", line 218, in run_periodic_tasks
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task     task(self, context)
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task   File "/opt/stack/new/nova/nova/compute/manager.py", line 5680, in _poll_bandwidth_usage
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task     update_cells=update_cells)
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task   File "/opt/stack/new/nova/nova/objects/base.py", line 493, in wrapper
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task     return fn(obj, *args, **kwargs)
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task   File "/usr/local/lib/python2.7/dist-packages/oslo_versionedobjects/base.py", line 195, in wrapper
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task     ctxt, self, fn.__name__, args, kwargs)
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task   File "/opt/stack/new/nova/nova/conductor/rpcapi.py", line 248, in object_action
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task     objmethod=objmethod, args=args, kwargs=kwargs)
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task   File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/client.py", line 158, in call
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task     retry=self.retry)
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task   File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/transport.py", line 90, in _send
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task     timeout=timeout, retry=retry)
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task   File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 431, in send
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task     retry=retry)
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task   File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 422, in _send
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task     raise result
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task TypeError: 'NoneType' object has no attribute '__getitem__'
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task Traceback (most recent call last):
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task 
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task   File "/opt/stack/new/nova/nova/conductor/manager.py", line 442, in _object_dispatch
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task     return getattr(target, method)(*args, **kwargs)
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task 
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task   File "/opt/stack/new/nova/nova/objects/base.py", line 493, in wrapper
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task     return fn(obj, *args, **kwargs)
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task 
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task   File "/usr/local/lib/python2.7/dist-packages/oslo_versionedobjects/base.py", line 211, in wrapper
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task     return fn(self, *args, **kwargs)
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task 
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task   File "/opt/stack/new/nova/nova/objects/bandwidth_usage.py", line 69, in create
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task     self._from_db_object(self._context, self, db_bw_usage)
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task 
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task   File "/opt/stack/new/nova/nova/objects/bandwidth_usage.py", line 42, in _from_db_object
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task     bw_usage[field] = db_bw_usage['uuid']
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task 
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task TypeError: 'NoneType' object has no attribute '__getitem__'
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task 
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task 

The only thing I can think that broke it is
https://review.openstack.org/#/c/189397/ but that merged awhile ago.

Otherwise there could be some regression in oslo.versionedobjects 0.7.0
since that was released on 8/3.

** Affects: nova
     Importance: Undecided
         Status: Confirmed


** Tags: compute unified-objects xenserver

** Tags removed: xenserver
** Tags added: compute unified-objects

** Changed in: nova
       Status: New => Confirmed

** Tags added: xenserver

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1482738

Title:
  _poll_bandwidth_usage task fails to create bw usage object with
  TypeError

Status in OpenStack Compute (nova):
  Confirmed

Bug description:
  I noticed this in the logs of a citrix xenserver CI job run:

  http://dd6b71949550285df7dc-
  dda4e480e005aaa13ec303551d2d8155.r49.cf1.rackcdn.com/15/210515/1/7541//logs/screen-n-cpu.txt.gz

  2015-08-07 17:05:19.168 ERROR oslo_service.periodic_task [req-129cdac2-1a3a-458c-ab38-7eeebcea9672 None None] Error during ComputeManager._poll_bandwidth_usage
  2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task Traceback (most recent call last):
  2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task   File "/usr/local/lib/python2.7/dist-packages/oslo_service/periodic_task.py", line 218, in run_periodic_tasks
  2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task     task(self, context)
  2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task   File "/opt/stack/new/nova/nova/compute/manager.py", line 5680, in _poll_bandwidth_usage
  2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task     update_cells=update_cells)
  2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task   File "/opt/stack/new/nova/nova/objects/base.py", line 493, in wrapper
  2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task     return fn(obj, *args, **kwargs)
  2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task   File "/usr/local/lib/python2.7/dist-packages/oslo_versionedobjects/base.py", line 195, in wrapper
  2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task     ctxt, self, fn.__name__, args, kwargs)
  2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task   File "/opt/stack/new/nova/nova/conductor/rpcapi.py", line 248, in object_action
  2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task     objmethod=objmethod, args=args, kwargs=kwargs)
  2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task   File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/client.py", line 158, in call
  2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task     retry=self.retry)
  2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task   File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/transport.py", line 90, in _send
  2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task     timeout=timeout, retry=retry)
  2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task   File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 431, in send
  2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task     retry=retry)
  2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task   File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 422, in _send
  2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task     raise result
  2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task TypeError: 'NoneType' object has no attribute '__getitem__'
  2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task Traceback (most recent call last):
  2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task 
  2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task   File "/opt/stack/new/nova/nova/conductor/manager.py", line 442, in _object_dispatch
  2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task     return getattr(target, method)(*args, **kwargs)
  2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task 
  2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task   File "/opt/stack/new/nova/nova/objects/base.py", line 493, in wrapper
  2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task     return fn(obj, *args, **kwargs)
  2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task 
  2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task   File "/usr/local/lib/python2.7/dist-packages/oslo_versionedobjects/base.py", line 211, in wrapper
  2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task     return fn(self, *args, **kwargs)
  2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task 
  2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task   File "/opt/stack/new/nova/nova/objects/bandwidth_usage.py", line 69, in create
  2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task     self._from_db_object(self._context, self, db_bw_usage)
  2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task 
  2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task   File "/opt/stack/new/nova/nova/objects/bandwidth_usage.py", line 42, in _from_db_object
  2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task     bw_usage[field] = db_bw_usage['uuid']
  2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task 
  2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task TypeError: 'NoneType' object has no attribute '__getitem__'
  2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task 
  2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task 

  The only thing I can think that broke it is
  https://review.openstack.org/#/c/189397/ but that merged awhile ago.

  Otherwise there could be some regression in oslo.versionedobjects
  0.7.0 since that was released on 8/3.

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1482738/+subscriptions
  Thread Previous • Date Previous • • Thread Next