yahoo-eng-team team mailing list archive

[Kevin Benton <1628377@xxxxxxxxxxxxxxxxxx>]

That's just a debug statement because it's a non-fatal exception (one
retried by the DB API retry wrapper). Also, it wasn't for a request
related to this test (req-dfcdfd65-63b9-45cd-913c-43f6287e2e37 for port
a90e06cc).

Here are the relevant request IDs for the two ports referenced in that
test failure. None experienced any errors (not even transient retried
ones).

For port 04c2e178:
Creates port: req-d2302b30-f1bb-4c12-a140-69099c027d77
Update port to no fixed IPs: req-275b94a9-07ba-45b8-b92b-e61d672f7546
Update port to place fixed IPs back on it: req-dde006ac-79b0-4d6b-8ca0-cbd33f0b5f22
Deletes port: req-907865dc-f7af-4d1d-8a62-eb19ee3c5267


For port 0255770f:
Creates port: req-413031d7-8531-427e-9ab6-362807becbd0
Updates port to no fixed IPs: req-24c5d3c3-d5f9-4534-9897-07a619ba6580
Deletes port: req-d8ad416a-cee1-428e-9a94-d597f796d93e


I'm not familiar with the internals of how heat is determining which port is associated with the stack, but from what I can see Neutron did everything normally in this case.

** Project changed: neutron => heat

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1628377

Title:
  test_stack_update_replace_with_ip_rollback filure

Status in heat:
  New

Bug description:
  heat integration tests test_stack_update_replace_with_ip_rollback
  failed with below error. Though there no previous occurrences of this
  error, I can see db errors in neutron logs[1].

  http://logs.openstack.org/39/377439/2/gate/gate-heat-dsvm-functional-
  convg-mysql-lbaasv2/8b93a55/console.html

  2016-09-28 04:06:13.600724 | 2016-09-28 04:06:13.600 | Captured traceback:
  2016-09-28 04:06:13.601965 | 2016-09-28 04:06:13.601 | ~~~~~~~~~~~~~~~~~~~
  2016-09-28 04:06:13.603681 | 2016-09-28 04:06:13.603 |     Traceback (most recent call last):
  2016-09-28 04:06:13.605168 | 2016-09-28 04:06:13.604 |       File "/opt/stack/new/heat/heat_integrationtests/functional/test_create_update_neutron_port.py", line 119, in test_stack_update_replace_with_ip_rollback
  2016-09-28 04:06:13.607511 | 2016-09-28 04:06:13.606 |         self.assertEqual(_id, new_id)
  2016-09-28 04:06:13.608660 | 2016-09-28 04:06:13.608 |       File "/usr/local/lib/python2.7/dist-packages/testtools/testcase.py", line 411, in assertEqual
  2016-09-28 04:06:13.611349 | 2016-09-28 04:06:13.611 |         self.assertThat(observed, matcher, message)
  2016-09-28 04:06:13.613880 | 2016-09-28 04:06:13.613 |       File "/usr/local/lib/python2.7/dist-packages/testtools/testcase.py", line 498, in assertThat
  2016-09-28 04:06:13.616079 | 2016-09-28 04:06:13.615 |         raise mismatch_error
  2016-09-28 04:06:13.617343 | 2016-09-28 04:06:13.617 |     testtools.matchers._impl.MismatchError: !=:
  2016-09-28 04:06:13.619135 | 2016-09-28 04:06:13.618 |     reference = u'04c2e178-5c96-4f22-9072-faea92fa6560'
  2016-09-28 04:06:13.620321 | 2016-09-28 04:06:13.620 |     actual    = u'0255770f-e6a5-45de-b604-10c06f12d42c'

  [1]

  http://logs.openstack.org/39/377439/2/gate/gate-heat-dsvm-functional-
  convg-mysql-
  lbaasv2/8b93a55/logs/screen-q-svc.txt.gz#_2016-09-28_04_06_01_173

  2016-09-28 04:06:01.173 4912 DEBUG neutron.callbacks.manager [req-f70ab80e-2870-4bbe-aad0-1841203355d8 demo -] Notify callbacks [('neutron.db.l3_db._notify_routers_callback-8748586454487', <function _notify_routers_callback at 0x7f4f0634dd70>), ('neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification--9223372036829987228', <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f4f10337d50>>), ('neutron.db.l3_dvrscheduler_db._notify_port_delete-8748585805241', <function _notify_port_delete at 0x7f4f05965b90>)] for port, after_delete _notify_loop /opt/stack/new/neutron/neutron/callbacks/manager.py:142
  2016-09-28 04:06:01.173 4914 DEBUG neutron.db.api [req-dfcdfd65-63b9-45cd-913c-43f6287e2e37 - -] Retry wrapper got retriable exception: Traceback (most recent call last):
    File "/opt/stack/new/neutron/neutron/db/api.py", line 119, in wrapped
      return f(*dup_args, **dup_kwargs)
    File "/opt/stack/new/neutron/neutron/plugins/ml2/plugin.py", line 1733, in update_port_status
      context.session.flush()
    File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/session.py", line 2019, in flush
      self._flush(objects)
    File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/session.py", line 2137, in _flush
      transaction.rollback(_capture_exception=True)
    File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/util/langhelpers.py", line 60, in __exit__
      compat.reraise(exc_type, exc_value, exc_tb)
    File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/session.py", line 2101, in _flush
      flush_context.execute()
    File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/unitofwork.py", line 373, in execute
      rec.execute(self)
    File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/unitofwork.py", line 532, in execute
      uow
    File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/persistence.py", line 170, in save_obj
      mapper, table, update)
    File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/persistence.py", line 728, in _emit_update_statements
      (table.description, len(records), rows))
  StaleDataError: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched.
   wrapped /opt/stack/new/neutron/neutron/db/api.py:124

To manage notifications about this bug go to:
https://bugs.launchpad.net/heat/+bug/1628377/+subscriptions