← Back to team overview

yahoo-eng-team team mailing list archive

  1. yahoo-eng-team team
  2. Mailing list archive
  3. Message #40836

[Bug 1513733] [NEW] nova api wsgi request lost, system messages show 'ValueError: I/O operation on closed file'

  Thread Previous • Date Previous • • Thread Next 
Public bug reported:

1. Exact version of Nova/OpenStack you are running:
icehouse

2. Relevant log files:
the log in /var/log/messages

Oct 28 17:30:32 controller1 nova-api[4206]: Traceback (most recent call last):
Oct 28 17:30:32 controller1 nova-api[4206]: File "/usr/lib/python2.7/site-packages/eventlet/greenpool.py", line 80, in _spawn_n_impl
Oct 28 17:30:32 controller1 nova-api[4206]: func(*args, **kwargs)
Oct 28 17:30:32 controller1 nova-api[4206]: File "/usr/lib/python2.7/site-packages/eventlet/wsgi.py", line 594, in process_request
Oct 28 17:30:32 controller1 nova-api[4206]: proto.__init__(sock, address, self)
Oct 28 17:30:32 controller1 nova-api[4206]: File "/usr/lib64/python2.7/SocketServer.py", line 649, in __init__
Oct 28 17:30:32 controller1 nova-api[4206]: self.handle()
Oct 28 17:30:32 controller1 nova-api[4206]: File "/usr/lib64/python2.7/BaseHTTPServer.py", line 340, in handle
Oct 28 17:30:32 controller1 nova-api[4206]: self.handle_one_request()
Oct 28 17:30:32 controller1 nova-api[4206]: File "/usr/lib/python2.7/site-packages/eventlet/wsgi.py", line 285, in handle_one_request
Oct 28 17:30:32 controller1 nova-api[4206]: self.handle_one_response()
Oct 28 17:30:32 controller1 nova-api[4206]: File "/usr/lib/python2.7/site-packages/eventlet/wsgi.py", line 453, in handle_one_response
Oct 28 17:30:32 controller1 nova-api[4206]: 'wall_seconds': finish - start,
Oct 28 17:30:32 controller1 nova-api[4206]: File "/usr/lib/python2.7/site-packages/eventlet/wsgi.py", line 603, in log_message
Oct 28 17:30:32 controller1 nova-api[4206]: self.log.write(message + '\n')
Oct 28 17:30:32 controller1 nova-api[4206]: File "/usr/lib/python2.7/site-packages/nova/openstack/common/log.py", line 575, in write
Oct 28 17:30:32 controller1 nova-api[4206]: self.logger.log(self.level, msg.rstrip())
Oct 28 17:30:32 controller1 nova-api[4206]: File "/usr/lib64/python2.7/logging/__init__.py", line 1471, in log
Oct 28 17:30:32 controller1 nova-api[4206]: self.logger.log(level, msg, *args, **kwargs)
Oct 28 17:30:32 controller1 nova-api[4206]: File "/usr/lib64/python2.7/logging/__init__.py", line 1213, in log
Oct 28 17:30:32 controller1 nova-api[4206]: self._log(level, msg, args, **kwargs)
Oct 28 17:30:32 controller1 nova-api[4206]: File "/usr/lib64/python2.7/logging/__init__.py", line 1268, in _log
Oct 28 17:30:32 controller1 nova-api[4206]: self.handle(record)
Oct 28 17:30:32 controller1 nova-api[4206]: File "/usr/lib64/python2.7/logging/__init__.py", line 1278, in handle
Oct 28 17:30:32 controller1 nova-api[4206]: self.callHandlers(record)
Oct 28 17:30:32 controller1 nova-api[4206]: File "/usr/lib64/python2.7/logging/__init__.py", line 1318, in callHandlers
Oct 28 17:30:32 controller1 nova-api[4206]: hdlr.handle(record)
Oct 28 17:30:32 controller1 nova-api[4206]: File "/usr/lib64/python2.7/logging/__init__.py", line 749, in handle
Oct 28 17:30:32 controller1 nova-api[4206]: self.emit(record)
Oct 28 17:30:32 controller1 nova-api[4206]: File "/usr/lib64/python2.7/logging/handlers.py", line 425, in emit
Oct 28 17:30:32 controller1 nova-api[4206]: self.stream.flush()
Oct 28 17:30:32 controller1 nova-api[4206]: ValueError: I/O operation on closed file


3. Reproduce steps:
build many instances.

** Affects: nova
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1513733

Title:
  nova api wsgi request lost, system messages show 'ValueError: I/O
  operation on closed file'

Status in OpenStack Compute (nova):
  New

Bug description:
  1. Exact version of Nova/OpenStack you are running:
  icehouse

  2. Relevant log files:
  the log in /var/log/messages

  Oct 28 17:30:32 controller1 nova-api[4206]: Traceback (most recent call last):
  Oct 28 17:30:32 controller1 nova-api[4206]: File "/usr/lib/python2.7/site-packages/eventlet/greenpool.py", line 80, in _spawn_n_impl
  Oct 28 17:30:32 controller1 nova-api[4206]: func(*args, **kwargs)
  Oct 28 17:30:32 controller1 nova-api[4206]: File "/usr/lib/python2.7/site-packages/eventlet/wsgi.py", line 594, in process_request
  Oct 28 17:30:32 controller1 nova-api[4206]: proto.__init__(sock, address, self)
  Oct 28 17:30:32 controller1 nova-api[4206]: File "/usr/lib64/python2.7/SocketServer.py", line 649, in __init__
  Oct 28 17:30:32 controller1 nova-api[4206]: self.handle()
  Oct 28 17:30:32 controller1 nova-api[4206]: File "/usr/lib64/python2.7/BaseHTTPServer.py", line 340, in handle
  Oct 28 17:30:32 controller1 nova-api[4206]: self.handle_one_request()
  Oct 28 17:30:32 controller1 nova-api[4206]: File "/usr/lib/python2.7/site-packages/eventlet/wsgi.py", line 285, in handle_one_request
  Oct 28 17:30:32 controller1 nova-api[4206]: self.handle_one_response()
  Oct 28 17:30:32 controller1 nova-api[4206]: File "/usr/lib/python2.7/site-packages/eventlet/wsgi.py", line 453, in handle_one_response
  Oct 28 17:30:32 controller1 nova-api[4206]: 'wall_seconds': finish - start,
  Oct 28 17:30:32 controller1 nova-api[4206]: File "/usr/lib/python2.7/site-packages/eventlet/wsgi.py", line 603, in log_message
  Oct 28 17:30:32 controller1 nova-api[4206]: self.log.write(message + '\n')
  Oct 28 17:30:32 controller1 nova-api[4206]: File "/usr/lib/python2.7/site-packages/nova/openstack/common/log.py", line 575, in write
  Oct 28 17:30:32 controller1 nova-api[4206]: self.logger.log(self.level, msg.rstrip())
  Oct 28 17:30:32 controller1 nova-api[4206]: File "/usr/lib64/python2.7/logging/__init__.py", line 1471, in log
  Oct 28 17:30:32 controller1 nova-api[4206]: self.logger.log(level, msg, *args, **kwargs)
  Oct 28 17:30:32 controller1 nova-api[4206]: File "/usr/lib64/python2.7/logging/__init__.py", line 1213, in log
  Oct 28 17:30:32 controller1 nova-api[4206]: self._log(level, msg, args, **kwargs)
  Oct 28 17:30:32 controller1 nova-api[4206]: File "/usr/lib64/python2.7/logging/__init__.py", line 1268, in _log
  Oct 28 17:30:32 controller1 nova-api[4206]: self.handle(record)
  Oct 28 17:30:32 controller1 nova-api[4206]: File "/usr/lib64/python2.7/logging/__init__.py", line 1278, in handle
  Oct 28 17:30:32 controller1 nova-api[4206]: self.callHandlers(record)
  Oct 28 17:30:32 controller1 nova-api[4206]: File "/usr/lib64/python2.7/logging/__init__.py", line 1318, in callHandlers
  Oct 28 17:30:32 controller1 nova-api[4206]: hdlr.handle(record)
  Oct 28 17:30:32 controller1 nova-api[4206]: File "/usr/lib64/python2.7/logging/__init__.py", line 749, in handle
  Oct 28 17:30:32 controller1 nova-api[4206]: self.emit(record)
  Oct 28 17:30:32 controller1 nova-api[4206]: File "/usr/lib64/python2.7/logging/handlers.py", line 425, in emit
  Oct 28 17:30:32 controller1 nova-api[4206]: self.stream.flush()
  Oct 28 17:30:32 controller1 nova-api[4206]: ValueError: I/O operation on closed file

  
  3. Reproduce steps:
  build many instances.

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1513733/+subscriptions

Follow ups

  Thread Previous • Date Previous • • Thread Next