launchpad-dev team mailing list archive

Thread
Date
Re: Appserver death and meliae overruns, oh my!

To: Aaron Bentley <aaron@xxxxxxxxxxxxx>
From: Guilherme Salgado <salgado@xxxxxxxxxxxxx>
Date: Tue, 06 Apr 2010 14:34:07 -0300
Cc: Launchpad Development <launchpad-dev@xxxxxxxxxxxxxxxxxxx>
In-reply-to: <4BBB4518.1050501@canonical.com>
On Tue, 2010-04-06 at 10:28 -0400, Aaron Bentley wrote:
> Since PyGPGME is busted on Lucid, I've been trying to run tests on a 
> Karmic VM.  Unfortunately, that is busted too.  See output below.
> 
> It looks to me like meliae  may not be ready for prime time.  The 
> appserver death (which presumably trigered meliae) is also troubling.

That's weird.  meliae.dump_all_objects() should be triggered only when
the appserver process receives a SIGRTMIN+10 (44) signal.

> 
> The appserver death isn't shown testAppServerIsAvailable is run in 
> isolation, but "bin/test -t test_sigdumpmem -t testAppServerIsAvailable" 
> reproduces the failure.  (And running test_sigdumpmem by itself doesn't 
> reproduce it, either.)
> 
> It doesn't even let me ^C it.  I have to ^\ it.
> 
> 
> $ bin/test -v --layer AppServerLayer
> Running tests at level 1
> Running canonical.testing.layers.AppServerLayer tests:
>    Set up canonical.testing.layers.BaseLayer in 0.012 seconds.
>    Set up canonical.testing.layers.DatabaseLayer in 4.721 seconds.
>    Set up canonical.testing.layers.LibrarianLayer in 11.588 seconds.
>    Set up canonical.testing.layers.MemcachedLayer in 0.196 seconds.
>    Set up canonical.testing.layers.LaunchpadLayer in 0.000 seconds.
>    Set up canonical.testing.layers.FunctionalLayer in 6.327 seconds.
>    Set up canonical.testing.layers.LaunchpadFunctionalLayer in 0.000 
> seconds.
>    Set up canonical.testing.layers.AppServerLayer in 15.839 seconds.
>    Running:
> ...................................................................................................................................
> 
> Error in test testAppServerIsAvailable 
> (canonical.testing.ftests.test_layers.LayerProcessControllerInvariantsTestCase)
> Traceback (most recent call last):
>    File "/usr/lib/python2.5/unittest.py", line 260, in run
>      testMethod()
>    File 
> "/home/abentley/launchpad/recipe-index/lib/canonical/testing/ftests/test_layers.py", 
> line 367, in testAppServerIsAvailable
>      home_page = urlopen(mainsite.rooturl).read()
>    File "/usr/lib/python2.5/urllib.py", line 82, in urlopen
>      return opener.open(url)
>    File "/usr/lib/python2.5/urllib.py", line 190, in open
>      return getattr(self, name)(url)
>    File "/usr/lib/python2.5/urllib.py", line 325, in open_http
>      h.endheaders()
>    File "/usr/lib/python2.5/httplib.py", line 860, in endheaders
>      self._send_output()
>    File "/usr/lib/python2.5/httplib.py", line 732, in _send_output
>      self.send(msg)
>    File "/usr/lib/python2.5/httplib.py", line 699, in send
>      self.connect()
>    File "/usr/lib/python2.5/httplib.py", line 683, in connect
>      raise socket.error, msg
> IOError: [Errno socket error] (111, 'Connection refused')
> 
> Traceback (most recent call last):
>    File "bin/test", line 259, in <module>
>      result = testrunner.run([])
>    File 
> "/home/abentley/launchpad/stable/eggs/zope.testing-3.8.1-py2.5.egg/zope/testing/testrunner/__init__.py", 
> line 32, in run
>      failed = run_internal(defaults, args, script_parts=script_parts)
>    File 
> "/home/abentley/launchpad/stable/eggs/zope.testing-3.8.1-py2.5.egg/zope/testing/testrunner/__init__.py", 
> line 45, in run_internal
>      runner.run()
>    File 
> "/home/abentley/launchpad/stable/eggs/zope.testing-3.8.1-py2.5.egg/zope/testing/testrunner/runner.py", 
> line 136, in run
>      self.run_tests()
>    File 
> "/home/abentley/launchpad/stable/eggs/zope.testing-3.8.1-py2.5.egg/zope/testing/testrunner/runner.py", 
> line 216, in run_tests
>      setup_layers, self.failures, self.errors)
>    File 
> "/home/abentley/launchpad/stable/eggs/zope.testing-3.8.1-py2.5.egg/zope/testing/testrunner/runner.py", 
> line 374, in run_layer
>      return run_tests(options, tests, layer_name, failures, errors)
>    File 
> "/home/abentley/launchpad/stable/eggs/zope.testing-3.8.1-py2.5.egg/zope/testing/testrunner/runner.py", 
> line 306, in run_tests
>      test(result)
>    File "/usr/lib/python2.5/unittest.py", line 281, in __call__
>      return self.run(*args, **kwds)
>    File "/usr/lib/python2.5/unittest.py", line 278, in run
>      result.stopTest(self)
>    File 
> "/home/abentley/launchpad/stable/eggs/zope.testing-3.8.1-py2.5.egg/zope/testing/testrunner/runner.py", 
> line 724, in stopTest
>      self.testTearDown()
>    File 
> "/home/abentley/launchpad/stable/eggs/zope.testing-3.8.1-py2.5.egg/zope/testing/testrunner/runner.py", 
> line 680, in testTearDown
>      layer.testTearDown()
>    File 
> "/home/abentley/launchpad/recipe-index/lib/canonical/testing/profiled.py", 
> line 29, in profiled_func
>      return func(cls, *args, **kw)
>    File 
> "/home/abentley/launchpad/recipe-index/lib/canonical/testing/layers.py", 
> line 1781, in testTearDown
>      LayerProcessController.postTestInvariants()
>    File 
> "/home/abentley/launchpad/recipe-index/lib/canonical/testing/profiled.py", 
> line 29, in profiled_func
>      return func(cls, *args, **kw)
>    File 
> "/home/abentley/launchpad/recipe-index/lib/canonical/testing/layers.py", 
> line 1686, in postTestInvariants
>      cls.appserver.returncode, cls.appserver.stdout.read()))
> canonical.testing.layers.LayerIsolationError: App server died in this 
> test (status=1):
> /home/abentley/launchpad/stable/eggs/python_openid-2.2.1-py2.5.egg/openid/server/server.py:974: 
> DeprecationWarning: The "namespace" attribute of CheckIDRequest objects 
> is deprecated. Use "message.getOpenIDNamespace()" instead
>    self.fields = Message(request.namespace)
> /home/abentley/launchpad/recipe-index/lib/BeautifulSoup.py:1625: 
> UnicodeWarning:
>   Unicode equal comparison failed to convert both arguments to Unicode - 
> interpre
> ting them as being unequal
>    if xml_data[:4] == '\x4c\x6f\xa7\x94':
> /home/abentley/launchpad/recipe-index/lib/BeautifulSoup.py:1632: 
> UnicodeWarning: Unicode equal comparison failed to convert both 
> arguments to Unicode - interpreting them as being unequal
>    elif (len(xml_data) >= 4) and (xml_data[:2] == '\xfe\xff') \
> /home/abentley/launchpad/recipe-index/lib/BeautifulSoup.py:1641: 
> UnicodeWarning: Unicode equal comparison failed to convert both 
> arguments to Unicode - interpreting them as being unequal
>    elif (len(xml_data) >= 4) and (xml_data[:2] == '\xff\xfe') and \
> /home/abentley/launchpad/recipe-index/lib/BeautifulSoup.py:1654: 
> UnicodeWarning: Unicode equal comparison failed to convert both 
> arguments to Unicode - interpreting them as being unequal
>    elif xml_data[:4] == '\x00\x00\xfe\xff':
> /home/abentley/launchpad/recipe-index/lib/BeautifulSoup.py:1658: 
> UnicodeWarning: Unicode equal comparison failed to convert both 
> arguments to Unicode - interpreting them as being unequal
>    elif xml_data[:4] == '\xff\xfe\x00\x00':
> /home/abentley/launchpad/recipe-index/lib/BeautifulSoup.py:1662: 
> UnicodeWarning: Unicode equal comparison failed to convert both 
> arguments to Unicode - interpreting them as being unequal
>    elif xml_data[:3] == '\xef\xbb\xbf':
> error: uncaptured python exception, closing channel 
> <zc.zservertracelog.tracelog.Channel connected 127.0.0.88:38087 at 
> 0xfd66f4c> (<class 'socket.error'>:(32, 'Broken pipe') 
> [/home/abentley/launchpad/stable/eggs/zope.server-3.6.1-py2.5.egg/zope/server/dualmodechannel.py|handle_write|73] 
> [/home/abentley/launchpad/stable/eggs/zope.server-3.6.1-py2.5.egg/zope/server/dualmodechannel.py|_flush_some|187] 
> [/usr/lib/python2.5/asyncore.py|send|331])
> Traceback (most recent call last):
>    File "/home/abentley/launchpad/recipe-index/bin/run", line 254, in 
> <module>
>      canonical.launchpad.scripts.runlaunchpad.start_launchpad()
>    File 
> "/home/abentley/launchpad/recipe-index/lib/canonical/launchpad/scripts/runlaunchpad.py", 
> line 280, in start_launchpad
>      main(argv)
>    File 
> "/home/abentley/launchpad/stable/eggs/zope.app.server-3.4.2-py2.5.egg/zope/app/server/main.py", 
> line 62, in main
>      run()
>    File 
> "/home/abentley/launchpad/stable/eggs/zope.app.server-3.4.2-py2.5.egg/zope/app/server/main.py", 
> line 83, in run
>      asyncore.poll(30.0)
>    File "/usr/lib/python2.5/asyncore.py", line 121, in poll
>      r, w, e = select.select(r, w, e, timeout)
>    File 
> "/home/abentley/launchpad/recipe-index/lib/canonical/launchpad/webapp/sigdumpmem.py", 
> line 14, in sigdumpmem_handler
>      scanner.dump_all_objects(DUMP_FILE)
>    File 
> "/home/abentley/launchpad/recipe-index/eggs/meliae-0.2.0.final.0-py2.5-linux-i686.egg/meliae/scanner.py", 
> line 118, in dump_all_objects
>      dump_all_referenced(outf, all_objs, is_pending=True)
>    File 
> "/home/abentley/launchpad/recipe-index/eggs/meliae-0.2.0.final.0-py2.5-linux-i686.egg/meliae/scanner.py", 
> line 50, in dump_all_referenced
>      if id(ref) not in seen:
>    File "_intset.pyx", line 116, in meliae._intset.IntSet.__contains__
> OverflowError: long int too large to convert to int
> 
> 
> _______________________________________________
> Mailing list: https://launchpad.net/~launchpad-dev
> Post to     : launchpad-dev@xxxxxxxxxxxxxxxxxxx
> Unsubscribe : https://launchpad.net/~launchpad-dev
> More help   : https://help.launchpad.net/ListHelp

-- 
Guilherme Salgado <salgado@xxxxxxxxxxxxx>
Attachment: signature.asc
Description: This is a digitally signed message part
References

Appserver death and meliae overruns, oh my!
From: Aaron Bentley, 2010-04-06