yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1619367] [NEW] neutron db upgrade raise error

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: Jeffrey Zhang <1619367@xxxxxxxxxxxxxxxxxx>
Date: Thu, 01 Sep 2016 15:48:50 -0000
Reply-to: Bug 1619367 <1619367@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
Public bug reported:

here is the logs:

2016-09-01 14:46:26.838319 | Traceback (most recent call last):
2016-09-01 14:46:26.838344 |   File "/var/lib/kolla/venv/bin/neutron-db-manage", line 10, in <module>
2016-09-01 14:46:26.838356 |     sys.exit(main())
2016-09-01 14:46:26.838389 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/neutron/db/migration/cli.py", line 686, in main
2016-09-01 14:46:26.838413 |     return_val |= bool(CONF.command.func(config, CONF.command.name))
2016-09-01 14:46:26.838448 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/neutron/db/migration/cli.py", line 207, in do_upgrade
2016-09-01 14:46:26.838464 |     desc=branch, sql=CONF.command.sql)
2016-09-01 14:46:26.838500 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/neutron/db/migration/cli.py", line 108, in do_alembic_command
2016-09-01 14:46:26.838522 |     getattr(alembic_command, cmd)(config, *args, **kwargs)
2016-09-01 14:46:26.838563 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/alembic/command.py", line 174, in upgrade
2016-09-01 14:46:26.838578 |     script.run_env()
2016-09-01 14:46:26.838610 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/alembic/script/base.py", line 407, in run_env
2016-09-01 14:46:26.838629 |     util.load_python_file(self.dir, 'env.py')
2016-09-01 14:46:26.838663 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/alembic/util/pyfiles.py", line 93, in load_python_file
2016-09-01 14:46:26.838682 |     module = load_module_py(module_id, path)
2016-09-01 14:46:26.838715 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/alembic/util/compat.py", line 79, in load_module_py
2016-09-01 14:46:26.838734 |     mod = imp.load_source(module_id, path, fp)
2016-09-01 14:46:26.838772 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/neutron/db/migration/alembic_migrations/env.py", line 120, in <module>
2016-09-01 14:46:26.838787 |     run_migrations_online()
2016-09-01 14:46:26.838828 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/neutron/db/migration/alembic_migrations/env.py", line 114, in run_migrations_online
2016-09-01 14:46:26.838848 |     context.run_migrations()
2016-09-01 14:46:26.838867 |   File "<string>", line 8, in run_migrations
2016-09-01 14:46:26.838908 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/alembic/runtime/environment.py", line 797, in run_migrations
2016-09-01 14:46:26.838927 |     self.get_context().run_migrations(**kw)
2016-09-01 14:46:26.838962 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/alembic/runtime/migration.py", line 312, in run_migrations
2016-09-01 14:46:26.838976 |     step.migration_fn(**kw)
2016-09-01 14:46:26.839039 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/neutron/db/migration/alembic_migrations/versions/newton/contract/b12a3ef66e62_add_standardattr_to_qos_policies.py", line 60, in upgrade
2016-09-01 14:46:26.839059 |     existing_server_default=False)
2016-09-01 14:46:26.839077 |   File "<string>", line 8, in alter_column
2016-09-01 14:46:26.839095 |   File "<string>", line 3, in alter_column
2016-09-01 14:46:26.839129 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/alembic/operations/ops.py", line 1414, in alter_column
2016-09-01 14:46:26.839146 |     return operations.invoke(alt)
2016-09-01 14:46:26.839178 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/alembic/operations/base.py", line 318, in invoke
2016-09-01 14:46:26.839194 |     return fn(self, operation)
2016-09-01 14:46:26.839228 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/alembic/operations/toimpl.py", line 53, in alter_column
2016-09-01 14:46:26.839240 |     **operation.kw
2016-09-01 14:46:26.839273 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/alembic/ddl/mysql.py", line 67, in alter_column
2016-09-01 14:46:26.839289 |     else existing_autoincrement
2016-09-01 14:46:26.839319 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/alembic/ddl/impl.py", line 118, in _exec
2016-09-01 14:46:26.839341 |     return conn.execute(construct, *multiparams, **params)
2016-09-01 14:46:26.839374 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 914, in execute
2016-09-01 14:46:26.839392 |     return meth(self, multiparams, params)
2016-09-01 14:46:26.839427 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/sqlalchemy/sql/ddl.py", line 68, in _execute_on_connection
2016-09-01 14:46:26.839450 |     return connection._execute_ddl(self, multiparams, params)
2016-09-01 14:46:26.839483 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 968, in _execute_ddl
2016-09-01 14:46:26.839495 |     compiled
2016-09-01 14:46:26.839530 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context
2016-09-01 14:46:26.839541 |     context)
2016-09-01 14:46:26.839578 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception
2016-09-01 14:46:26.839596 |     util.raise_from_cause(newraise, exc_info)
2016-09-01 14:46:26.839631 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/sqlalchemy/util/compat.py", line 202, in raise_from_cause
2016-09-01 14:46:26.839654 |     reraise(type(exception), exception, tb=exc_tb, cause=cause)
2016-09-01 14:46:26.839689 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context
2016-09-01 14:46:26.839700 |     context)
2016-09-01 14:46:26.839734 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/sqlalchemy/engine/default.py", line 450, in do_execute
2016-09-01 14:46:26.839752 |     cursor.execute(statement, parameters)
2016-09-01 14:46:26.839783 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/pymysql/cursors.py", line 167, in execute
2016-09-01 14:46:26.839799 |     result = self._query(query)
2016-09-01 14:46:26.839830 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/pymysql/cursors.py", line 323, in _query
2016-09-01 14:46:26.839842 |     conn.query(q)
2016-09-01 14:46:26.839877 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/pymysql/connections.py", line 836, in query
2016-09-01 14:46:26.839903 |     self._affected_rows = self._read_query_result(unbuffered=unbuffered)
2016-09-01 14:46:26.839938 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/pymysql/connections.py", line 1020, in _read_query_result
2016-09-01 14:46:26.839950 |     result.read()
2016-09-01 14:46:26.839982 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/pymysql/connections.py", line 1303, in read
2016-09-01 14:46:26.840002 |     first_packet = self.connection._read_packet()
2016-09-01 14:46:26.840043 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/pymysql/connections.py", line 982, in _read_packet
2016-09-01 14:46:26.840060 |     packet.check_error()
2016-09-01 14:46:26.840093 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/pymysql/connections.py", line 394, in check_error
2016-09-01 14:46:26.840111 |     err.raise_mysql_exception(self._data)
2016-09-01 14:46:26.840145 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/pymysql/err.py", line 120, in raise_mysql_exception
2016-09-01 14:46:26.840161 |     _check_mysql_exception(errinfo)
2016-09-01 14:46:26.840195 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/pymysql/err.py", line 115, in _check_mysql_exception
2016-09-01 14:46:26.840213 |     raise InternalError(errno, errorvalue)
2016-09-01 14:46:26.840279 | oslo_db.exception.DBError: (pymysql.err.InternalError) (1832, u"Cannot change column 'standard_attr_id': used in a foreign key constraint 'qos_policies_ibfk_1'") [SQL: u'ALTER TABLE qos_policies MODIFY standard_attr_id BIGINT NOT NULL']
2016-09-01 14:46:26.840290 | + copy_logs

more info please check[0]. Maybe this PS can fix this[1]

[0] http://logs.openstack.org/10/364310/2/check/gate-kolla-dsvm-deploy-
centos-source-
centos-7-nv/3fa8604/console.html#_2016-09-01_14_46_26_840279

[1] https://review.openstack.org/#/c/364336/

** Affects: neutron
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1619367

Title:
  neutron db upgrade raise error

Status in neutron:
  New

Bug description:
  here is the logs:

  2016-09-01 14:46:26.838319 | Traceback (most recent call last):
  2016-09-01 14:46:26.838344 |   File "/var/lib/kolla/venv/bin/neutron-db-manage", line 10, in <module>
  2016-09-01 14:46:26.838356 |     sys.exit(main())
  2016-09-01 14:46:26.838389 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/neutron/db/migration/cli.py", line 686, in main
  2016-09-01 14:46:26.838413 |     return_val |= bool(CONF.command.func(config, CONF.command.name))
  2016-09-01 14:46:26.838448 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/neutron/db/migration/cli.py", line 207, in do_upgrade
  2016-09-01 14:46:26.838464 |     desc=branch, sql=CONF.command.sql)
  2016-09-01 14:46:26.838500 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/neutron/db/migration/cli.py", line 108, in do_alembic_command
  2016-09-01 14:46:26.838522 |     getattr(alembic_command, cmd)(config, *args, **kwargs)
  2016-09-01 14:46:26.838563 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/alembic/command.py", line 174, in upgrade
  2016-09-01 14:46:26.838578 |     script.run_env()
  2016-09-01 14:46:26.838610 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/alembic/script/base.py", line 407, in run_env
  2016-09-01 14:46:26.838629 |     util.load_python_file(self.dir, 'env.py')
  2016-09-01 14:46:26.838663 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/alembic/util/pyfiles.py", line 93, in load_python_file
  2016-09-01 14:46:26.838682 |     module = load_module_py(module_id, path)
  2016-09-01 14:46:26.838715 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/alembic/util/compat.py", line 79, in load_module_py
  2016-09-01 14:46:26.838734 |     mod = imp.load_source(module_id, path, fp)
  2016-09-01 14:46:26.838772 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/neutron/db/migration/alembic_migrations/env.py", line 120, in <module>
  2016-09-01 14:46:26.838787 |     run_migrations_online()
  2016-09-01 14:46:26.838828 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/neutron/db/migration/alembic_migrations/env.py", line 114, in run_migrations_online
  2016-09-01 14:46:26.838848 |     context.run_migrations()
  2016-09-01 14:46:26.838867 |   File "<string>", line 8, in run_migrations
  2016-09-01 14:46:26.838908 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/alembic/runtime/environment.py", line 797, in run_migrations
  2016-09-01 14:46:26.838927 |     self.get_context().run_migrations(**kw)
  2016-09-01 14:46:26.838962 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/alembic/runtime/migration.py", line 312, in run_migrations
  2016-09-01 14:46:26.838976 |     step.migration_fn(**kw)
  2016-09-01 14:46:26.839039 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/neutron/db/migration/alembic_migrations/versions/newton/contract/b12a3ef66e62_add_standardattr_to_qos_policies.py", line 60, in upgrade
  2016-09-01 14:46:26.839059 |     existing_server_default=False)
  2016-09-01 14:46:26.839077 |   File "<string>", line 8, in alter_column
  2016-09-01 14:46:26.839095 |   File "<string>", line 3, in alter_column
  2016-09-01 14:46:26.839129 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/alembic/operations/ops.py", line 1414, in alter_column
  2016-09-01 14:46:26.839146 |     return operations.invoke(alt)
  2016-09-01 14:46:26.839178 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/alembic/operations/base.py", line 318, in invoke
  2016-09-01 14:46:26.839194 |     return fn(self, operation)
  2016-09-01 14:46:26.839228 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/alembic/operations/toimpl.py", line 53, in alter_column
  2016-09-01 14:46:26.839240 |     **operation.kw
  2016-09-01 14:46:26.839273 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/alembic/ddl/mysql.py", line 67, in alter_column
  2016-09-01 14:46:26.839289 |     else existing_autoincrement
  2016-09-01 14:46:26.839319 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/alembic/ddl/impl.py", line 118, in _exec
  2016-09-01 14:46:26.839341 |     return conn.execute(construct, *multiparams, **params)
  2016-09-01 14:46:26.839374 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 914, in execute
  2016-09-01 14:46:26.839392 |     return meth(self, multiparams, params)
  2016-09-01 14:46:26.839427 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/sqlalchemy/sql/ddl.py", line 68, in _execute_on_connection
  2016-09-01 14:46:26.839450 |     return connection._execute_ddl(self, multiparams, params)
  2016-09-01 14:46:26.839483 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 968, in _execute_ddl
  2016-09-01 14:46:26.839495 |     compiled
  2016-09-01 14:46:26.839530 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context
  2016-09-01 14:46:26.839541 |     context)
  2016-09-01 14:46:26.839578 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception
  2016-09-01 14:46:26.839596 |     util.raise_from_cause(newraise, exc_info)
  2016-09-01 14:46:26.839631 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/sqlalchemy/util/compat.py", line 202, in raise_from_cause
  2016-09-01 14:46:26.839654 |     reraise(type(exception), exception, tb=exc_tb, cause=cause)
  2016-09-01 14:46:26.839689 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context
  2016-09-01 14:46:26.839700 |     context)
  2016-09-01 14:46:26.839734 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/sqlalchemy/engine/default.py", line 450, in do_execute
  2016-09-01 14:46:26.839752 |     cursor.execute(statement, parameters)
  2016-09-01 14:46:26.839783 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/pymysql/cursors.py", line 167, in execute
  2016-09-01 14:46:26.839799 |     result = self._query(query)
  2016-09-01 14:46:26.839830 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/pymysql/cursors.py", line 323, in _query
  2016-09-01 14:46:26.839842 |     conn.query(q)
  2016-09-01 14:46:26.839877 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/pymysql/connections.py", line 836, in query
  2016-09-01 14:46:26.839903 |     self._affected_rows = self._read_query_result(unbuffered=unbuffered)
  2016-09-01 14:46:26.839938 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/pymysql/connections.py", line 1020, in _read_query_result
  2016-09-01 14:46:26.839950 |     result.read()
  2016-09-01 14:46:26.839982 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/pymysql/connections.py", line 1303, in read
  2016-09-01 14:46:26.840002 |     first_packet = self.connection._read_packet()
  2016-09-01 14:46:26.840043 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/pymysql/connections.py", line 982, in _read_packet
  2016-09-01 14:46:26.840060 |     packet.check_error()
  2016-09-01 14:46:26.840093 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/pymysql/connections.py", line 394, in check_error
  2016-09-01 14:46:26.840111 |     err.raise_mysql_exception(self._data)
  2016-09-01 14:46:26.840145 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/pymysql/err.py", line 120, in raise_mysql_exception
  2016-09-01 14:46:26.840161 |     _check_mysql_exception(errinfo)
  2016-09-01 14:46:26.840195 |   File "/var/lib/kolla/venv/lib/python2.7/site-packages/pymysql/err.py", line 115, in _check_mysql_exception
  2016-09-01 14:46:26.840213 |     raise InternalError(errno, errorvalue)
  2016-09-01 14:46:26.840279 | oslo_db.exception.DBError: (pymysql.err.InternalError) (1832, u"Cannot change column 'standard_attr_id': used in a foreign key constraint 'qos_policies_ibfk_1'") [SQL: u'ALTER TABLE qos_policies MODIFY standard_attr_id BIGINT NOT NULL']
  2016-09-01 14:46:26.840290 | + copy_logs

  more info please check[0]. Maybe this PS can fix this[1]

  [0] http://logs.openstack.org/10/364310/2/check/gate-kolla-dsvm-
  deploy-centos-source-
  centos-7-nv/3fa8604/console.html#_2016-09-01_14_46_26_840279

  [1] https://review.openstack.org/#/c/364336/

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/1619367/+subscriptions
Follow ups

[Bug 1619367] Re: neutron db upgrade raise error
From: Launchpad Bug Tracker, 2017-01-31