← Back to team overview

yahoo-eng-team team mailing list archive

[Bug 1755205] [NEW] ValueError: Field value 21 is invalid

 

Public bug reported:

we just upgraded to Pike from ocata and a new error is now seen in the
log files. We have not done any config changes, just upgraded the
containers

We are running kolla-ansible

neutron-server.log

2018-03-12 16:13:09.298 53 DEBUG neutron_lib.callbacks.manager [req-8351b200-f441-425d-87a9-a29dbe01a729 - - - - -] Notify callbacks ['neutron.services.segments.plugin.NovaSegmentNotifier._notify_host_addition_to_aggregate-16251827'] for segment_host_mapping, after_create _notify_loop /var/lib/kolla/venv/lib/python2.7/site-packages/neutron_lib/callbacks/manager.py:167
2018-03-12 16:13:09.335 53 DEBUG oslo_concurrency.lockutils [-] Lock "notifier-59bf1c54-b85b-4380-b08c-061c0cb242a2" acquired by "neutron.notifiers.batch_notifier.synced_send" :: waited 0.000s inner /var/lib/kolla/venv/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:270
2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server [req-cf93a4c0-9462-41e5-9922-b9b55ef6d1e2 - - - - -] Exception during message handling: ValueError: Field value 21 is invalid
2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server Traceback (most recent call last):
2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 160, in _process_incoming
2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 213, in dispatch
2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 183, in _do_dispatch
2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 232, in inner
2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python2.7/site-packages/neutron/api/rpc/handlers/resources_rpc.py", line 143, in bulk_pull
2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server     **filter_kwargs)]
2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python2.7/site-packages/neutron/objects/base.py", line 468, in get_objects
2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server     return [cls._load_object(context, db_obj) for db_obj in db_objs]
2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python2.7/site-packages/neutron/objects/base.py", line 403, in _load_object
2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server     obj.from_db_object(db_obj)
2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python2.7/site-packages/neutron/objects/base.py", line 346, in from_db_object
2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server     setattr(self, field, fields[field])
2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_versionedobjects/base.py", line 72, in setter
2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server     field_value = field.coerce(self, name, value)
2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_versionedobjects/fields.py", line 195, in coerce
2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server     return self._type.coerce(obj, attr, value)
2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_versionedobjects/fields.py", line 317, in coerce
2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server     raise ValueError(msg)
2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server ValueError: Field value 21 is invalid
2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server
2018-03-12 16:13:11.336 53 DEBUG oslo_concurrency.lockutils [-] Lock "notifier-59bf1c54-b85b-4380-b08c-061c0cb242a2" released by "neutron.notifiers.batch_notifier.synced_send" :: held 2.002s inner /var/lib/kolla/venv/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:282
2018-03-12 16:13:11.727 56 DEBUG neutron_lib.callbacks.manager [req-c10e276c-512a-43b3-a21d-03a3fe198c4d - - - - -] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223372036848016538'] for agent, after_update _notify_loop /var/lib/kolla/venv/lib/python2.7/site-packages/neutron_lib/callbacks/manager.py:167
2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server [req-a88c8346-db34-48d6-bb79-432b9261ba16 - - - - -] Exception during message handling: ValueError: Field value 21 is invalid
2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server Traceback (most recent call last):
2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 160, in _process_incoming
2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 213, in dispatch
2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 183, in _do_dispatch
2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 232, in inner
2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python2.7/site-packages/neutron/api/rpc/handlers/resources_rpc.py", line 143, in bulk_pull
2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server     **filter_kwargs)]
2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python2.7/site-packages/neutron/objects/base.py", line 468, in get_objects
2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server     return [cls._load_object(context, db_obj) for db_obj in db_objs]
2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python2.7/site-packages/neutron/objects/base.py", line 403, in _load_object
2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server     obj.from_db_object(db_obj)
2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python2.7/site-packages/neutron/objects/base.py", line 346, in from_db_object
2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server     setattr(self, field, fields[field])
2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_versionedobjects/base.py", line 72, in setter
2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server     field_value = field.coerce(self, name, value)
2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_versionedobjects/fields.py", line 195, in coerce
2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server     return self._type.coerce(obj, attr, value)
2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_versionedobjects/fields.py", line 317, in coerce
2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server     raise ValueError(msg)
2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server ValueError: Field value 21 is invalid
2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server

** Affects: neutron
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1755205

Title:
   ValueError: Field value 21 is invalid

Status in neutron:
  New

Bug description:
  we just upgraded to Pike from ocata and a new error is now seen in the
  log files. We have not done any config changes, just upgraded the
  containers

  We are running kolla-ansible

  neutron-server.log

  2018-03-12 16:13:09.298 53 DEBUG neutron_lib.callbacks.manager [req-8351b200-f441-425d-87a9-a29dbe01a729 - - - - -] Notify callbacks ['neutron.services.segments.plugin.NovaSegmentNotifier._notify_host_addition_to_aggregate-16251827'] for segment_host_mapping, after_create _notify_loop /var/lib/kolla/venv/lib/python2.7/site-packages/neutron_lib/callbacks/manager.py:167
  2018-03-12 16:13:09.335 53 DEBUG oslo_concurrency.lockutils [-] Lock "notifier-59bf1c54-b85b-4380-b08c-061c0cb242a2" acquired by "neutron.notifiers.batch_notifier.synced_send" :: waited 0.000s inner /var/lib/kolla/venv/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:270
  2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server [req-cf93a4c0-9462-41e5-9922-b9b55ef6d1e2 - - - - -] Exception during message handling: ValueError: Field value 21 is invalid
  2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server Traceback (most recent call last):
  2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 160, in _process_incoming
  2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
  2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 213, in dispatch
  2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
  2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 183, in _do_dispatch
  2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
  2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 232, in inner
  2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
  2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python2.7/site-packages/neutron/api/rpc/handlers/resources_rpc.py", line 143, in bulk_pull
  2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server     **filter_kwargs)]
  2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python2.7/site-packages/neutron/objects/base.py", line 468, in get_objects
  2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server     return [cls._load_object(context, db_obj) for db_obj in db_objs]
  2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python2.7/site-packages/neutron/objects/base.py", line 403, in _load_object
  2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server     obj.from_db_object(db_obj)
  2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python2.7/site-packages/neutron/objects/base.py", line 346, in from_db_object
  2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server     setattr(self, field, fields[field])
  2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_versionedobjects/base.py", line 72, in setter
  2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server     field_value = field.coerce(self, name, value)
  2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_versionedobjects/fields.py", line 195, in coerce
  2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server     return self._type.coerce(obj, attr, value)
  2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_versionedobjects/fields.py", line 317, in coerce
  2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server     raise ValueError(msg)
  2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server ValueError: Field value 21 is invalid
  2018-03-12 16:13:10.956 65 ERROR oslo_messaging.rpc.server
  2018-03-12 16:13:11.336 53 DEBUG oslo_concurrency.lockutils [-] Lock "notifier-59bf1c54-b85b-4380-b08c-061c0cb242a2" released by "neutron.notifiers.batch_notifier.synced_send" :: held 2.002s inner /var/lib/kolla/venv/lib/python2.7/site-packages/oslo_concurrency/lockutils.py:282
  2018-03-12 16:13:11.727 56 DEBUG neutron_lib.callbacks.manager [req-c10e276c-512a-43b3-a21d-03a3fe198c4d - - - - -] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent--9223372036848016538'] for agent, after_update _notify_loop /var/lib/kolla/venv/lib/python2.7/site-packages/neutron_lib/callbacks/manager.py:167
  2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server [req-a88c8346-db34-48d6-bb79-432b9261ba16 - - - - -] Exception during message handling: ValueError: Field value 21 is invalid
  2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server Traceback (most recent call last):
  2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 160, in _process_incoming
  2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
  2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 213, in dispatch
  2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
  2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 183, in _do_dispatch
  2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
  2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 232, in inner
  2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
  2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python2.7/site-packages/neutron/api/rpc/handlers/resources_rpc.py", line 143, in bulk_pull
  2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server     **filter_kwargs)]
  2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python2.7/site-packages/neutron/objects/base.py", line 468, in get_objects
  2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server     return [cls._load_object(context, db_obj) for db_obj in db_objs]
  2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python2.7/site-packages/neutron/objects/base.py", line 403, in _load_object
  2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server     obj.from_db_object(db_obj)
  2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python2.7/site-packages/neutron/objects/base.py", line 346, in from_db_object
  2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server     setattr(self, field, fields[field])
  2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_versionedobjects/base.py", line 72, in setter
  2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server     field_value = field.coerce(self, name, value)
  2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_versionedobjects/fields.py", line 195, in coerce
  2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server     return self._type.coerce(obj, attr, value)
  2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_versionedobjects/fields.py", line 317, in coerce
  2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server     raise ValueError(msg)
  2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server ValueError: Field value 21 is invalid
  2018-03-12 16:13:12.596 50 ERROR oslo_messaging.rpc.server

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/1755205/+subscriptions


Follow ups