maas-builds team mailing list archive

[Jenkins Notification <devnull@xxxxxxxxxxxxx>]

See http://d-jenkins.ubuntu-ci:8080/job/trusty-adt-maas-daily/38/

[...truncated 6775 lines...]
 -------------- .> celery           exchange=celery(direct) key=celery

                .> master           exchange=master(direct) key=master



[tasks]

  . maasserver.tasks.cleanup_old_nonces

  . maasserver.tasks.import_boot_images_on_schedule

  . provisioningserver.tasks.add_new_dhcp_host_map

  . provisioningserver.tasks.add_seamicro15k

  . provisioningserver.tasks.import_boot_images

  . provisioningserver.tasks.periodic_probe_dhcp

  . provisioningserver.tasks.power_off

  . provisioningserver.tasks.power_on

  . provisioningserver.tasks.refresh_secrets

  . provisioningserver.tasks.remove_dhcp_host_map

  . provisioningserver.tasks.report_boot_images

  . provisioningserver.tasks.restart_dhcp_server

  . provisioningserver.tasks.rndc_command

  . provisioningserver.tasks.setup_rndc_configuration

  . provisioningserver.tasks.update_node_tags

  . provisioningserver.tasks.upload_dhcp_leases

  . provisioningserver.tasks.write_dhcp_config

  . provisioningserver.tasks.write_dns_config

  . provisioningserver.tasks.write_dns_zone_config

  . provisioningserver.tasks.write_full_dns_config



Creating user "maas_workers" ...

Error: unable to connect to node rabbit@autopkgtest: nodedown



DIAGNOSTICS

===========



nodes in question: [rabbit@autopkgtest]



hosts, their running nodes and ports:

- autopkgtest: [{rabbitmqctl13753,47532},{rabbitmqctl13846,50520}]



current node details:

- node name: rabbitmqctl13846@autopkgtest

- home dir: /var/lib/rabbitmq

- cookie hash: beihHHHRFeVSU9KSKH6dIw==
}}}

Traceback (most recent call last):
  File "/tmp/adt-run.wvmQZB/ubtree0-build/real-tree/debian/tests/maas-integration.py", line 299, in test_check_initial_services
    '/var/log/upstart/maas-region-celery.log')
  File "/tmp/adt-run.wvmQZB/ubtree0-build/real-tree/debian/tests/utils.py", line 131, in assertStartedUpstartService
    runner.assertThat(output, Contains(expected))
  File "/usr/lib/python2.7/dist-packages/testtools/testcase.py", line 412, in assertThat
    raise MismatchError(matchee, matcher, mismatch, verbose)
MismatchError: 'maas-region-celery start/running' not in 'maas-region-celery stop/waiting\n'


maas-integration.TestMAASIntegration.test_restart_provisioning_server: 0.0669s
maas-integration.TestMAASIntegration.test_create_admin: 0.1132s
maas-integration.TestMAASIntegration.test_restart_dbus_avahi: 0.1505s
maas-integration.TestMAASIntegration.test_update_maas_url: 2.2358s
maas-integration.TestMAASIntegration.test_check_initial_services: 30.0368s
----------------------------------------------------------------------
Ran 5 tests in 32.628s

FAILED (SKIP=1, failures=1)
adt-run1: testbed executing test finished with exit status 1
adt-run: & ubtree0t-maas-package-test: ----------------------------------------]
adt-run: & ubtree0t-maas-package-test:  - - - - - - - - - - results - - - - - - - - - -
ubtree0t-maas-package-test FAIL non-zero exit status 1
adt-run1: ** needs_reset, previously=False
adt-run: @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ tests done.
adt-run1: ** stop
adt-run1: ** close, scratch=/tmp/adt-run.wvmQZB
+ RC=4
+ [ 4 -eq 20 ]
+ [ 0 -eq 1 ]
+ [ -x /home/ubuntu/adt-export-result ]
+ RES=PASS
+ [ 4 -gt 0 ]
+ RES=FAIL
+ /home/ubuntu/adt-export-result -D /root/adt-log maas FAIL
+ chown -R ubuntu /root/adt-log /var/tmp/testresults
+ chmod og+r /var/log/syslog
+ ls /var/crash/
+ [ -n _usr_bin_celeryd.109.crash ]
+ check_installed apport
+ + grepdpkg-query -qw ^install -W
 -f ${Status} apport
+ + cut -d  -f1
+ lsb_release -sc
sha512sum
+ arch
+ echo ubuntu_autopkgtest_trusty_x86_64
+ export CRASH_DB_IDENTIFIER=b4c886fe411527dbf53492f0bcae4d49208b9e756a2b6ed8d0e7028d158dbd66703c7df4605b0ade33b643b1864d741f3160558a9d996b9336b73494dbe7c01c
+ [ -x /usr/share/apport/whoopsie-upload-all ]
+ echo I: Uploading crash files
I: Uploading crash files
+ /usr/share/apport/whoopsie-upload-all -t 300
Collecting info for /var/crash/_usr_bin_celeryd.109.crash...
Marking /var/crash/_usr_bin_celeryd.109.crash for whoopsie upload
Waiting for whoopsie to upload reports (timeout: 300 s)
  missing (remaining: 300 s): /var/crash/_usr_bin_celeryd.109.uploaded 
  missing (remaining: 290 s): /var/crash/_usr_bin_celeryd.109.uploaded 
  missing (remaining: 280 s): /var/crash/_usr_bin_celeryd.109.uploaded 
  missing (remaining: 270 s): /var/crash/_usr_bin_celeryd.109.uploaded 
  missing (remaining: 260 s): /var/crash/_usr_bin_celeryd.109.uploaded 
  missing (remaining: 250 s): /var/crash/_usr_bin_celeryd.109.uploaded 
  missing (remaining: 240 s): /var/crash/_usr_bin_celeryd.109.uploaded 
  missing (remaining: 230 s): /var/crash/_usr_bin_celeryd.109.uploaded 
  missing (remaining: 220 s): /var/crash/_usr_bin_celeryd.109.uploaded 
  missing (remaining: 210 s): /var/crash/_usr_bin_celeryd.109.uploaded 
  missing (remaining: 200 s): /var/crash/_usr_bin_celeryd.109.uploaded 
  missing (remaining: 190 s): /var/crash/_usr_bin_celeryd.109.uploaded 
  missing (remaining: 180 s): /var/crash/_usr_bin_celeryd.109.uploaded 
  missing (remaining: 170 s): /var/crash/_usr_bin_celeryd.109.uploaded 
  missing (remaining: 160 s): /var/crash/_usr_bin_celeryd.109.uploaded 
  missing (remaining: 150 s): /var/crash/_usr_bin_celeryd.109.uploaded 
  missing (remaining: 140 s): /var/crash/_usr_bin_celeryd.109.uploaded 
  missing (remaining: 130 s): /var/crash/_usr_bin_celeryd.109.uploaded 
  missing (remaining: 120 s): /var/crash/_usr_bin_celeryd.109.uploaded 
  missing (remaining: 110 s): /var/crash/_usr_bin_celeryd.109.uploaded 
  missing (remaining: 100 s): /var/crash/_usr_bin_celeryd.109.uploaded 
  missing (remaining: 90 s): /var/crash/_usr_bin_celeryd.109.uploaded 
  missing (remaining: 80 s): /var/crash/_usr_bin_celeryd.109.uploaded 
  missing (remaining: 70 s): /var/crash/_usr_bin_celeryd.109.uploaded 
  missing (remaining: 60 s): /var/crash/_usr_bin_celeryd.109.uploaded 
  missing (remaining: 50 s): /var/crash/_usr_bin_celeryd.109.uploaded 
  missing (remaining: 40 s): /var/crash/_usr_bin_celeryd.109.uploaded 
  missing (remaining: 30 s): /var/crash/_usr_bin_celeryd.109.uploaded 
  missing (remaining: 20 s): /var/crash/_usr_bin_celeryd.109.uploaded 
  missing (remaining: 10 s): /var/crash/_usr_bin_celeryd.109.uploaded 
  missing (remaining: 0 s): /var/crash/_usr_bin_celeryd.109.uploaded 
+ chmod og+r /var/crash/_usr_bin_celeryd.109.crash /var/crash/_usr_bin_celeryd.109.upload
+ exit 4
Connection to localhost closed.
+ RET=4
+ [ 0 -eq 1 ]
+ [ 4 -gt 0 ]
+ log_failure_msg adt-run exited with status 4.
+ log_msg Failure: adt-run exited with status 4.\n
+ date +%F %X
+ printf 2014-01-14 13:47:00: Failure: adt-run exited with status 4.\n
2014-01-14 13:47:00: Failure: adt-run exited with status 4.
+ [ 0 -eq 0 ]
+ mkdir -p /home/ubuntu/jenkins-jobs/workspace/trusty-adt-maas-daily/results
+ ssh -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -o CheckHostIP=no -i /var/tmp/adt/disks/adtkey -p 54323 -tt -o BatchMode=yes -l ubuntu localhost sudo chown -R ubuntu /root/adt-log; find /root/adt-log -type f -empty | xargs rm 2>/dev/null
Warning: Permanently added '[localhost]:54323' (ECDSA) to the list of known hosts.
find: `/root/adt-log': Permission denied
Connection to localhost closed.
+ true
+ scp -r -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -o CheckHostIP=no -i /var/tmp/adt/disks/adtkey -P 54323 ubuntu@localhost:/root/adt-log/* /var/crash/*crash /var/log/syslog /var/tmp/testresults /home/ubuntu/jenkins-jobs/workspace/trusty-adt-maas-daily/results
+ true
+ log_info_msg Test artifacts copied to /home/ubuntu/jenkins-jobs/workspace/trusty-adt-maas-daily/results
+ log_msg Info: Test artifacts copied to /home/ubuntu/jenkins-jobs/workspace/trusty-adt-maas-daily/results\n
+ date +%F %X
+ printf 2014-01-14 13:47:01: Info: Test artifacts copied to /home/ubuntu/jenkins-jobs/workspace/trusty-adt-maas-daily/results\n
2014-01-14 13:47:01: Info: Test artifacts copied to /home/ubuntu/jenkins-jobs/workspace/trusty-adt-maas-daily/results
+ [ -f /home/ubuntu/jenkins-jobs/workspace/trusty-adt-maas-daily/results/summary.log ]
+ [ -n 2014-01-14_18-32-20 ]
+ ls -tr /home/ubuntu/jenkins-jobs/workspace/trusty-adt-maas-daily/results/*.result
+ tail -1
+ resfile=
+ [ -n  ]
+ log_failure_msg Test didn't end normally. Generating error file
+ log_msg Failure: Test didn't end normally. Generating error file\n
+ date +%F %X
+ printf 2014-01-14 13:47:01: Failure: Test didn't end normally. Generating error file\n
2014-01-14 13:47:01: Failure: Test didn't end normally. Generating error file
+ date +%Y%m%d-%H%M%S
+ errfile=/home/ubuntu/jenkins-jobs/workspace/trusty-adt-maas-daily/results/trusty_amd64_maas_20140114-134701.error
+ echo trusty amd64 maas
+ rsync -a /home/ubuntu/jenkins-jobs/workspace/trusty-adt-maas-daily/results/trusty_amd64_maas_20140114-134701.error /trusty/tmp/
rsync: mkdir "/trusty/tmp" failed: No such file or directory (2)
rsync error: error in file IO (code 11) at main.c(674) [Receiver=3.1.0]
+ true
+ [ 0 -eq 0 ]
+ ssh -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -o CheckHostIP=no -i /var/tmp/adt/disks/adtkey -p 54323 -tt -o BatchMode=yes -l ubuntu localhost sudo poweroff
Warning: Permanently added '[localhost]:54323' (ECDSA) to the list of known hosts.


Broadcast message from ubuntu@autopkgtest

	(/dev/pts/0) at 13:47 ...




The system is going down for power off NOW!

Connection to localhost closed.
+ exit 4
+ on_exit
+ log_info_msg Cleaning up
+ log_msg Info: Cleaning up\n
+ date +%F %X
+ printf 2014-01-14 13:47:02: Info: Cleaning up\n
2014-01-14 13:47:02: Info: Cleaning up
+ [ -f /var/tmp/adt/disks/run/trusty-amd64-maas-20140114_133241.SkRUHR.img.pid ]
+ cat /var/tmp/adt/disks/run/trusty-amd64-maas-20140114_133241.SkRUHR.img.pid
+ kill -9 27992
+ rm -f /var/tmp/adt/disks/run/trusty-amd64-maas-20140114_133241.SkRUHR.img.pid
+ rm -f /var/tmp/adt/disks/run/trusty-amd64-maas-20140114_133241.SkRUHR.img
+ rm -f /var/tmp/adt/disks/run/trusty-amd64-maas-20140114_133241.SkRUHR.img.monitor /var/tmp/adt/disks/run/trusty-amd64-maas-20140114_133241.SkRUHR.img.serial
+ rm -f /var/lock/adt/ssh.54323.lock
+ rm -f /var/lock/adt/vnc.5911.lock
+ [ -d /tmp/adt-amd64.jI3Ms4 ]
+ rm -Rf /tmp/adt-amd64.jI3Ms4
+ rm -f /var/tmp/adt/disks/run/trusty-amd64-maas-*.img*
+ find /var/lock/adt -name *.lock -mtime +1
+ exit 4
Build step 'Execute shell' marked build as failure
Archiving artifacts
Email was triggered for: Failure
Sending email for trigger: Failure