yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1714212] [NEW] neutron-db-manage on subproject neutron-fwaas fails in Pike

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: Jens Offenbach <wolle5050@xxxxxx>
Date: Thu, 31 Aug 2017 09:39:14 -0000
Reply-to: Bug 1714212 <1714212@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
Public bug reported:

I have set up OpenStack Pike on Ubuntu 16.04.

Running:
$ su -s /bin/sh -c "neutron-db-manage --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --subproject neutron_fwaas upgrade head" neutron

fails with the following error:

INFO  [alembic.runtime.migration] Running upgrade f83a0b2964d0 -> fd38cd995cc0, change shared attribute for firewall resource
Traceback (most recent call last):
  File "/usr/bin/neutron-db-manage", line 10, in <module>
    sys.exit(main())
  File "/usr/lib/python2.7/dist-packages/neutron/db/migration/cli.py", line 687, in main
    return_val |= bool(CONF.command.func(config, CONF.command.name))
  File "/usr/lib/python2.7/dist-packages/neutron/db/migration/cli.py", line 208, in do_upgrade
    desc=branch, sql=CONF.command.sql)
  File "/usr/lib/python2.7/dist-packages/neutron/db/migration/cli.py", line 109, in do_alembic_command
    getattr(alembic_command, cmd)(config, *args, **kwargs)
  File "/usr/lib/python2.7/dist-packages/alembic/command.py", line 174, in upgrade
    script.run_env()
  File "/usr/lib/python2.7/dist-packages/alembic/script/base.py", line 416, in run_env
    util.load_python_file(self.dir, 'env.py')
  File "/usr/lib/python2.7/dist-packages/alembic/util/pyfiles.py", line 93, in load_python_file
    module = load_module_py(module_id, path)
  File "/usr/lib/python2.7/dist-packages/alembic/util/compat.py", line 79, in load_module_py
    mod = imp.load_source(module_id, path, fp)
  File "/usr/lib/python2.7/dist-packages/neutron_fwaas/db/migration/alembic_migrations/env.py", line 86, in <module>
    run_migrations_online()
  File "/usr/lib/python2.7/dist-packages/neutron_fwaas/db/migration/alembic_migrations/env.py", line 77, in run_migrations_online
    context.run_migrations()
  File "<string>", line 8, in run_migrations
  File "/usr/lib/python2.7/dist-packages/alembic/runtime/environment.py", line 807, in run_migrations
    self.get_context().run_migrations(**kw)
  File "/usr/lib/python2.7/dist-packages/alembic/runtime/migration.py", line 321, in run_migrations
    step.migration_fn(**kw)
  File "/usr/lib/python2.7/dist-packages/neutron_fwaas/db/migration/alembic_migrations/versions/pike/contract/fd38cd995cc0_shared_attribute_for_firewall_resources.py", line 33, in upgrade
    existing_type=sa.Boolean)
  File "<string>", line 8, in alter_column
  File "<string>", line 3, in alter_column
  File "/usr/lib/python2.7/dist-packages/alembic/operations/ops.py", line 1420, in alter_column
    return operations.invoke(alt)
  File "/usr/lib/python2.7/dist-packages/alembic/operations/base.py", line 318, in invoke
    return fn(self, operation)
  File "/usr/lib/python2.7/dist-packages/alembic/operations/toimpl.py", line 53, in alter_column
    **operation.kw
  File "/usr/lib/python2.7/dist-packages/alembic/ddl/mysql.py", line 48, in alter_column
    else existing_autoincrement
  File "/usr/lib/python2.7/dist-packages/alembic/ddl/impl.py", line 118, in _exec
    return conn.execute(construct, *multiparams, **params)
  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 945, in execute
    return meth(self, multiparams, params)
  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/ddl.py", line 68, in _execute_on_connection
    return connection._execute_ddl(self, multiparams, params)
  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1002, in _execute_ddl
    compiled
  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1189, in _execute_context
    context)
  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1398, in _handle_dbapi_exception
    util.raise_from_cause(newraise, exc_info)
  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 203, in raise_from_cause
    reraise(type(exception), exception, tb=exc_tb, cause=cause)
  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1182, in _execute_context
    context)
  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 470, in do_execute
    cursor.execute(statement, parameters)
  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 166, in execute
    result = self._query(query)
  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 322, in _query
    conn.query(q)
  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 852, in query
    self._affected_rows = self._read_query_result(unbuffered=unbuffered)
  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1053, in _read_query_result
    result.read()
  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1336, in read
    first_packet = self.connection._read_packet()
  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1010, in _read_packet
    packet.check_error()
  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 393, in check_error
    err.raise_mysql_exception(self._data)
  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 107, in raise_mysql_exception
    raise errorclass(errno, errval)
oslo_db.exception.DBError: (pymysql.err.InternalError) (1054, u"Unknown column 'public' in 'CHECK'") [SQL: u'ALTER TABLE firewall_rules_v2 CHANGE public shared BOOL NULL']

The script tries to rename the column "public" to "shared", which is
disallowed by tables's schema.

May someone please have a look?

Regards,
Jens

** Affects: neutron
     Importance: Undecided
         Status: New

** Description changed:

+ I have set up OpenStack Pike on Ubuntu 16.04.
+ 
  Running:
  $ su -s /bin/sh -c "neutron-db-manage --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --subproject neutron_fwaas upgrade head" neutron
  
  fails with the following error:
+ 
  INFO  [alembic.runtime.migration] Running upgrade f83a0b2964d0 -> fd38cd995cc0, change shared attribute for firewall resource
  Traceback (most recent call last):
-   File "/usr/bin/neutron-db-manage", line 10, in <module>
-     sys.exit(main())
-   File "/usr/lib/python2.7/dist-packages/neutron/db/migration/cli.py", line 687, in main
-     return_val |= bool(CONF.command.func(config, CONF.command.name))
-   File "/usr/lib/python2.7/dist-packages/neutron/db/migration/cli.py", line 208, in do_upgrade
-     desc=branch, sql=CONF.command.sql)
-   File "/usr/lib/python2.7/dist-packages/neutron/db/migration/cli.py", line 109, in do_alembic_command
-     getattr(alembic_command, cmd)(config, *args, **kwargs)
-   File "/usr/lib/python2.7/dist-packages/alembic/command.py", line 174, in upgrade
-     script.run_env()
-   File "/usr/lib/python2.7/dist-packages/alembic/script/base.py", line 416, in run_env
-     util.load_python_file(self.dir, 'env.py')
-   File "/usr/lib/python2.7/dist-packages/alembic/util/pyfiles.py", line 93, in load_python_file
-     module = load_module_py(module_id, path)
-   File "/usr/lib/python2.7/dist-packages/alembic/util/compat.py", line 79, in load_module_py
-     mod = imp.load_source(module_id, path, fp)
-   File "/usr/lib/python2.7/dist-packages/neutron_fwaas/db/migration/alembic_migrations/env.py", line 86, in <module>
-     run_migrations_online()
-   File "/usr/lib/python2.7/dist-packages/neutron_fwaas/db/migration/alembic_migrations/env.py", line 77, in run_migrations_online
-     context.run_migrations()
-   File "<string>", line 8, in run_migrations
-   File "/usr/lib/python2.7/dist-packages/alembic/runtime/environment.py", line 807, in run_migrations
-     self.get_context().run_migrations(**kw)
-   File "/usr/lib/python2.7/dist-packages/alembic/runtime/migration.py", line 321, in run_migrations
-     step.migration_fn(**kw)
-   File "/usr/lib/python2.7/dist-packages/neutron_fwaas/db/migration/alembic_migrations/versions/pike/contract/fd38cd995cc0_shared_attribute_for_firewall_resources.py", line 33, in upgrade
-     existing_type=sa.Boolean)
-   File "<string>", line 8, in alter_column
-   File "<string>", line 3, in alter_column
-   File "/usr/lib/python2.7/dist-packages/alembic/operations/ops.py", line 1420, in alter_column
-     return operations.invoke(alt)
-   File "/usr/lib/python2.7/dist-packages/alembic/operations/base.py", line 318, in invoke
-     return fn(self, operation)
-   File "/usr/lib/python2.7/dist-packages/alembic/operations/toimpl.py", line 53, in alter_column
-     **operation.kw
-   File "/usr/lib/python2.7/dist-packages/alembic/ddl/mysql.py", line 48, in alter_column
-     else existing_autoincrement
-   File "/usr/lib/python2.7/dist-packages/alembic/ddl/impl.py", line 118, in _exec
-     return conn.execute(construct, *multiparams, **params)
-   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 945, in execute
-     return meth(self, multiparams, params)
-   File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/ddl.py", line 68, in _execute_on_connection
-     return connection._execute_ddl(self, multiparams, params)
-   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1002, in _execute_ddl
-     compiled
-   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1189, in _execute_context
-     context)
-   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1398, in _handle_dbapi_exception
-     util.raise_from_cause(newraise, exc_info)
-   File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 203, in raise_from_cause
-     reraise(type(exception), exception, tb=exc_tb, cause=cause)
-   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1182, in _execute_context
-     context)
-   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 470, in do_execute
-     cursor.execute(statement, parameters)
-   File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 166, in execute
-     result = self._query(query)
-   File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 322, in _query
-     conn.query(q)
-   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 852, in query
-     self._affected_rows = self._read_query_result(unbuffered=unbuffered)
-   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1053, in _read_query_result
-     result.read()
-   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1336, in read
-     first_packet = self.connection._read_packet()
-   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1010, in _read_packet
-     packet.check_error()
-   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 393, in check_error
-     err.raise_mysql_exception(self._data)
-   File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 107, in raise_mysql_exception
-     raise errorclass(errno, errval)
+   File "/usr/bin/neutron-db-manage", line 10, in <module>
+     sys.exit(main())
+   File "/usr/lib/python2.7/dist-packages/neutron/db/migration/cli.py", line 687, in main
+     return_val |= bool(CONF.command.func(config, CONF.command.name))
+   File "/usr/lib/python2.7/dist-packages/neutron/db/migration/cli.py", line 208, in do_upgrade
+     desc=branch, sql=CONF.command.sql)
+   File "/usr/lib/python2.7/dist-packages/neutron/db/migration/cli.py", line 109, in do_alembic_command
+     getattr(alembic_command, cmd)(config, *args, **kwargs)
+   File "/usr/lib/python2.7/dist-packages/alembic/command.py", line 174, in upgrade
+     script.run_env()
+   File "/usr/lib/python2.7/dist-packages/alembic/script/base.py", line 416, in run_env
+     util.load_python_file(self.dir, 'env.py')
+   File "/usr/lib/python2.7/dist-packages/alembic/util/pyfiles.py", line 93, in load_python_file
+     module = load_module_py(module_id, path)
+   File "/usr/lib/python2.7/dist-packages/alembic/util/compat.py", line 79, in load_module_py
+     mod = imp.load_source(module_id, path, fp)
+   File "/usr/lib/python2.7/dist-packages/neutron_fwaas/db/migration/alembic_migrations/env.py", line 86, in <module>
+     run_migrations_online()
+   File "/usr/lib/python2.7/dist-packages/neutron_fwaas/db/migration/alembic_migrations/env.py", line 77, in run_migrations_online
+     context.run_migrations()
+   File "<string>", line 8, in run_migrations
+   File "/usr/lib/python2.7/dist-packages/alembic/runtime/environment.py", line 807, in run_migrations
+     self.get_context().run_migrations(**kw)
+   File "/usr/lib/python2.7/dist-packages/alembic/runtime/migration.py", line 321, in run_migrations
+     step.migration_fn(**kw)
+   File "/usr/lib/python2.7/dist-packages/neutron_fwaas/db/migration/alembic_migrations/versions/pike/contract/fd38cd995cc0_shared_attribute_for_firewall_resources.py", line 33, in upgrade
+     existing_type=sa.Boolean)
+   File "<string>", line 8, in alter_column
+   File "<string>", line 3, in alter_column
+   File "/usr/lib/python2.7/dist-packages/alembic/operations/ops.py", line 1420, in alter_column
+     return operations.invoke(alt)
+   File "/usr/lib/python2.7/dist-packages/alembic/operations/base.py", line 318, in invoke
+     return fn(self, operation)
+   File "/usr/lib/python2.7/dist-packages/alembic/operations/toimpl.py", line 53, in alter_column
+     **operation.kw
+   File "/usr/lib/python2.7/dist-packages/alembic/ddl/mysql.py", line 48, in alter_column
+     else existing_autoincrement
+   File "/usr/lib/python2.7/dist-packages/alembic/ddl/impl.py", line 118, in _exec
+     return conn.execute(construct, *multiparams, **params)
+   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 945, in execute
+     return meth(self, multiparams, params)
+   File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/ddl.py", line 68, in _execute_on_connection
+     return connection._execute_ddl(self, multiparams, params)
+   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1002, in _execute_ddl
+     compiled
+   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1189, in _execute_context
+     context)
+   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1398, in _handle_dbapi_exception
+     util.raise_from_cause(newraise, exc_info)
+   File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 203, in raise_from_cause
+     reraise(type(exception), exception, tb=exc_tb, cause=cause)
+   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1182, in _execute_context
+     context)
+   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 470, in do_execute
+     cursor.execute(statement, parameters)
+   File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 166, in execute
+     result = self._query(query)
+   File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 322, in _query
+     conn.query(q)
+   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 852, in query
+     self._affected_rows = self._read_query_result(unbuffered=unbuffered)
+   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1053, in _read_query_result
+     result.read()
+   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1336, in read
+     first_packet = self.connection._read_packet()
+   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1010, in _read_packet
+     packet.check_error()
+   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 393, in check_error
+     err.raise_mysql_exception(self._data)
+   File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 107, in raise_mysql_exception
+     raise errorclass(errno, errval)
  oslo_db.exception.DBError: (pymysql.err.InternalError) (1054, u"Unknown column 'public' in 'CHECK'") [SQL: u'ALTER TABLE firewall_rules_v2 CHANGE public shared BOOL NULL']
  
  The script tries to rename the column "public" to "shared", which is
  disallowed by tables's schema.
  
  May someone please have a look?
  
  Regards,
  Jens

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1714212

Title:
  neutron-db-manage on subproject neutron-fwaas fails in Pike

Status in neutron:
  New

Bug description:
  I have set up OpenStack Pike on Ubuntu 16.04.

  Running:
  $ su -s /bin/sh -c "neutron-db-manage --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --subproject neutron_fwaas upgrade head" neutron

  fails with the following error:

  INFO  [alembic.runtime.migration] Running upgrade f83a0b2964d0 -> fd38cd995cc0, change shared attribute for firewall resource
  Traceback (most recent call last):
    File "/usr/bin/neutron-db-manage", line 10, in <module>
      sys.exit(main())
    File "/usr/lib/python2.7/dist-packages/neutron/db/migration/cli.py", line 687, in main
      return_val |= bool(CONF.command.func(config, CONF.command.name))
    File "/usr/lib/python2.7/dist-packages/neutron/db/migration/cli.py", line 208, in do_upgrade
      desc=branch, sql=CONF.command.sql)
    File "/usr/lib/python2.7/dist-packages/neutron/db/migration/cli.py", line 109, in do_alembic_command
      getattr(alembic_command, cmd)(config, *args, **kwargs)
    File "/usr/lib/python2.7/dist-packages/alembic/command.py", line 174, in upgrade
      script.run_env()
    File "/usr/lib/python2.7/dist-packages/alembic/script/base.py", line 416, in run_env
      util.load_python_file(self.dir, 'env.py')
    File "/usr/lib/python2.7/dist-packages/alembic/util/pyfiles.py", line 93, in load_python_file
      module = load_module_py(module_id, path)
    File "/usr/lib/python2.7/dist-packages/alembic/util/compat.py", line 79, in load_module_py
      mod = imp.load_source(module_id, path, fp)
    File "/usr/lib/python2.7/dist-packages/neutron_fwaas/db/migration/alembic_migrations/env.py", line 86, in <module>
      run_migrations_online()
    File "/usr/lib/python2.7/dist-packages/neutron_fwaas/db/migration/alembic_migrations/env.py", line 77, in run_migrations_online
      context.run_migrations()
    File "<string>", line 8, in run_migrations
    File "/usr/lib/python2.7/dist-packages/alembic/runtime/environment.py", line 807, in run_migrations
      self.get_context().run_migrations(**kw)
    File "/usr/lib/python2.7/dist-packages/alembic/runtime/migration.py", line 321, in run_migrations
      step.migration_fn(**kw)
    File "/usr/lib/python2.7/dist-packages/neutron_fwaas/db/migration/alembic_migrations/versions/pike/contract/fd38cd995cc0_shared_attribute_for_firewall_resources.py", line 33, in upgrade
      existing_type=sa.Boolean)
    File "<string>", line 8, in alter_column
    File "<string>", line 3, in alter_column
    File "/usr/lib/python2.7/dist-packages/alembic/operations/ops.py", line 1420, in alter_column
      return operations.invoke(alt)
    File "/usr/lib/python2.7/dist-packages/alembic/operations/base.py", line 318, in invoke
      return fn(self, operation)
    File "/usr/lib/python2.7/dist-packages/alembic/operations/toimpl.py", line 53, in alter_column
      **operation.kw
    File "/usr/lib/python2.7/dist-packages/alembic/ddl/mysql.py", line 48, in alter_column
      else existing_autoincrement
    File "/usr/lib/python2.7/dist-packages/alembic/ddl/impl.py", line 118, in _exec
      return conn.execute(construct, *multiparams, **params)
    File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 945, in execute
      return meth(self, multiparams, params)
    File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/ddl.py", line 68, in _execute_on_connection
      return connection._execute_ddl(self, multiparams, params)
    File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1002, in _execute_ddl
      compiled
    File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1189, in _execute_context
      context)
    File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1398, in _handle_dbapi_exception
      util.raise_from_cause(newraise, exc_info)
    File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 203, in raise_from_cause
      reraise(type(exception), exception, tb=exc_tb, cause=cause)
    File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1182, in _execute_context
      context)
    File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 470, in do_execute
      cursor.execute(statement, parameters)
    File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 166, in execute
      result = self._query(query)
    File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 322, in _query
      conn.query(q)
    File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 852, in query
      self._affected_rows = self._read_query_result(unbuffered=unbuffered)
    File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1053, in _read_query_result
      result.read()
    File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1336, in read
      first_packet = self.connection._read_packet()
    File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1010, in _read_packet
      packet.check_error()
    File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 393, in check_error
      err.raise_mysql_exception(self._data)
    File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 107, in raise_mysql_exception
      raise errorclass(errno, errval)
  oslo_db.exception.DBError: (pymysql.err.InternalError) (1054, u"Unknown column 'public' in 'CHECK'") [SQL: u'ALTER TABLE firewall_rules_v2 CHANGE public shared BOOL NULL']

  The script tries to rename the column "public" to "shared", which is
  disallowed by tables's schema.

  May someone please have a look?

  Regards,
  Jens

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/1714212/+subscriptions
Follow ups

[Bug 1714212] Re: neutron-db-manage on subproject neutron-fwaas fails in Pike
From: Reedip, 2017-09-05