← Back to team overview

yahoo-eng-team team mailing list archive

[Bug 2116186] [NEW] Py3.13: nova-conductor crash during report status

 

Public bug reported:

Hi,

When running nova-conductor from Epoxy under Debian Trixie (meaning
Python 3.13), I get the below traceback. Not sure what's going on.
Here's the traceback from the nova-conductor.log:

 [-] Unexpected error while reporting service status: sqlalchemy.exc.OperationalError: (pymysql.err.OperationalError) (1020, "Record has changed since last read in table 'services'")
[SQL: UPDATE services SET report_count=%(report_count)s, last_seen_up=%(last_seen_up)s, updated_at=%(updated_at)s WHERE services.id = %(services_id)s]
[parameters: {'report_count': 61664, 'last_seen_up': datetime.datetime(2025, 7, 8, 13, 43, 16, 904402), 'updated_at': datetime.datetime(2025, 7, 8, 13, 43, 16, 904641), 'services_id': 6}]
(Background on this error at: https://sqlalche.me/e/20/e3q8)
 Traceback (most recent call last):
   File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1964, in _exec_single_context
     self.dialect.do_execute(
     ~~~~~~~~~~~~~~~~~~~~~~~^
         cursor, str_statement, effective_parameters, context
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
     )
     ^
   File "/usr/lib/python3/dist-packages/sqlalchemy/engine/default.py", line 945, in do_execute
     cursor.execute(statement, parameters)
     ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^
   File "/usr/lib/python3/dist-packages/pymysql/cursors.py", line 153, in execute
     result = self._query(query)
   File "/usr/lib/python3/dist-packages/pymysql/cursors.py", line 322, in _query
     conn.query(q)
     ~~~~~~~~~~^^^
   File "/usr/lib/python3/dist-packages/pymysql/connections.py", line 563, in query
     self._affected_rows = self._read_query_result(unbuffered=unbuffered)
                           ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^
   File "/usr/lib/python3/dist-packages/pymysql/connections.py", line 825, in _read_query_result
     result.read()
     ~~~~~~~~~~~^^
   File "/usr/lib/python3/dist-packages/pymysql/connections.py", line 1199, in read
     first_packet = self.connection._read_packet()
   File "/usr/lib/python3/dist-packages/pymysql/connections.py", line 775, in _read_packet
     packet.raise_for_error()
     ~~~~~~~~~~~~~~~~~~~~~~^^
   File "/usr/lib/python3/dist-packages/pymysql/protocol.py", line 219, in raise_for_error
     err.raise_mysql_exception(self._data)
     ~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^
   File "/usr/lib/python3/dist-packages/pymysql/err.py", line 150, in raise_mysql_exception
     raise errorclass(errno, errval)
 pymysql.err.OperationalError: (1020, "Record has changed since last read in table 'services'")

** Affects: nova
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/2116186

Title:
  Py3.13: nova-conductor crash during report status

Status in OpenStack Compute (nova):
  New

Bug description:
  Hi,

  When running nova-conductor from Epoxy under Debian Trixie (meaning
  Python 3.13), I get the below traceback. Not sure what's going on.
  Here's the traceback from the nova-conductor.log:

   [-] Unexpected error while reporting service status: sqlalchemy.exc.OperationalError: (pymysql.err.OperationalError) (1020, "Record has changed since last read in table 'services'")
  [SQL: UPDATE services SET report_count=%(report_count)s, last_seen_up=%(last_seen_up)s, updated_at=%(updated_at)s WHERE services.id = %(services_id)s]
  [parameters: {'report_count': 61664, 'last_seen_up': datetime.datetime(2025, 7, 8, 13, 43, 16, 904402), 'updated_at': datetime.datetime(2025, 7, 8, 13, 43, 16, 904641), 'services_id': 6}]
  (Background on this error at: https://sqlalche.me/e/20/e3q8)
   Traceback (most recent call last):
     File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1964, in _exec_single_context
       self.dialect.do_execute(
       ~~~~~~~~~~~~~~~~~~~~~~~^
           cursor, str_statement, effective_parameters, context
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
       )
       ^
     File "/usr/lib/python3/dist-packages/sqlalchemy/engine/default.py", line 945, in do_execute
       cursor.execute(statement, parameters)
       ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^
     File "/usr/lib/python3/dist-packages/pymysql/cursors.py", line 153, in execute
       result = self._query(query)
     File "/usr/lib/python3/dist-packages/pymysql/cursors.py", line 322, in _query
       conn.query(q)
       ~~~~~~~~~~^^^
     File "/usr/lib/python3/dist-packages/pymysql/connections.py", line 563, in query
       self._affected_rows = self._read_query_result(unbuffered=unbuffered)
                             ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^
     File "/usr/lib/python3/dist-packages/pymysql/connections.py", line 825, in _read_query_result
       result.read()
       ~~~~~~~~~~~^^
     File "/usr/lib/python3/dist-packages/pymysql/connections.py", line 1199, in read
       first_packet = self.connection._read_packet()
     File "/usr/lib/python3/dist-packages/pymysql/connections.py", line 775, in _read_packet
       packet.raise_for_error()
       ~~~~~~~~~~~~~~~~~~~~~~^^
     File "/usr/lib/python3/dist-packages/pymysql/protocol.py", line 219, in raise_for_error
       err.raise_mysql_exception(self._data)
       ~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^
     File "/usr/lib/python3/dist-packages/pymysql/err.py", line 150, in raise_mysql_exception
       raise errorclass(errno, errval)
   pymysql.err.OperationalError: (1020, "Record has changed since last read in table 'services'")

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/2116186/+subscriptions



Follow ups