linaro-release team mailing list archive

[James Westby <jw+debian@xxxxxxxxxxxxxxx>]

On Tue, 06 Sep 2011 16:10:12 -0000, Alexander Sack <asac@xxxxxxxxxx> wrote:
> OTOH, LAVA is a high priority service of Linaro and I hope we can assume
> that we don't get long term downtime there ... on build server having a
> queuing mechanism etc. to submit and retry submitting jobs and results feels
> worth investigating to make things more robust though.

I proposed a system that would have this without having to keep ec2
slaves up (costing us money,) but that's not what was
implemented. Fixing that isn't in the pipeline on the Infrastructure
side at this time, I don't know if Android will revisit it.

It's vital that we solve this, as even if LAVA is usually available, we
must not assume that it is 100% available.

Thanks,

James

-- 
You received this bug notification because you are a member of linaro-
infrastructure-drivers, which is the registrant for Linaro Android Build
Tools.
https://bugs.launchpad.net/bugs/842452

Title:
  Failure to submit build to lava results in overall build failure

Status in Linaro Android Build Tools:
  New

Bug description:
  For example in https://android-build.linaro.org/builds/~linaro-
  android/panda/#build=270

  Failure to connect to LAVA is annoying, but shouldn't cause the build
  to be marked as failed.

  Traceback (most recent call last):
    File "/mnt/jenkins/workspace/linaro-android_panda/build-tools/build-scripts/post-build-lava.py", line 121, in <module>
      main()
    File "/mnt/jenkins/workspace/linaro-android_panda/build-tools/build-scripts/post-build-lava.py", line 98, in main
      lava_job_id = server.scheduler.submit_job(config)
    File "/usr/lib/python2.7/xmlrpclib.py", line 1224, in __call__
      return self.__send(self.__name, args)
    File "/usr/lib/python2.7/xmlrpclib.py", line 1575, in __request
      verbose=self.__verbose
    File "/usr/lib/python2.7/xmlrpclib.py", line 1264, in request
      return self.single_request(host, handler, request_body, verbose)
    File "/usr/lib/python2.7/xmlrpclib.py", line 1292, in single_request
      self.send_content(h, request_body)
    File "/usr/lib/python2.7/xmlrpclib.py", line 1439, in send_content
      connection.endheaders(request_body)
    File "/usr/lib/python2.7/httplib.py", line 951, in endheaders
      self._send_output(message_body)
    File "/usr/lib/python2.7/httplib.py", line 811, in _send_output
      self.send(msg)
    File "/usr/lib/python2.7/httplib.py", line 773, in send
      self.connect()
    File "/usr/lib/python2.7/httplib.py", line 1154, in connect
      self.timeout, self.source_address)
    File "/usr/lib/python2.7/socket.py", line 571, in create_connection
      raise err
  socket.error: [Errno 110] Connection timed out
  Build step 'Execute shell' marked build as failure
  Archiving artifacts
  Finished: FAILURE

To manage notifications about this bug go to:
https://bugs.launchpad.net/linaro-android-build-tools/+bug/842452/+subscriptions