← Back to team overview

maas-builds team mailing list archive

Jenkins Still Failing - trusty-adt-maas-daily 67

 

See http://d-jenkins.ubuntu-ci:8080/job/trusty-adt-maas-daily/67/

[...truncated 7087 lines...]
 > metadataserver:0008_rename_lshw_commissioning_output
 > metadataserver:0009_delete_status
 > metadataserver:0010_add_script_result
 > metadataserver:0011_commission_result_binary_data_col
 > metadataserver:0012_commission_result_binary_data_recode
 > metadataserver:0013_commission_result_drop_old_data_col
 > metadataserver:0014_commission_result_rename_data_bin_col
 - Loading initial data for metadataserver.
Installed 1 object(s) from 1 fixture(s)
 * Restarting web server apache2
   ...done.
squid-deb-proxy stop/waiting
squid-deb-proxy start/running, process 18112
maas-txlongpoll start/running, process 18193
maas-region-celery start/running, process 18276
Setting up python-testtools (0.9.33-0ubuntu1) ...
Setting up python-extras (0.0.3-2ubuntu1) ...
Setting up libnss3-nssdb (2:3.15.4-1ubuntu5) ...
Setting up libnss3:amd64 (2:3.15.4-1ubuntu5) ...
Setting up librados2 (0.72.2-1) ...
Setting up librbd1 (0.72.2-1) ...
Setting up tgt (1:1.0.43-0ubuntu2) ...
tgt start/running, process 18347
Processing triggers for ureadahead (0.100.0-16) ...
Setting up maas-cluster-controller (1.4+bzr1853+dfsg+1866+229~ppa0~ubuntu14.04.1) ...
 * Restarting web server apache2
(98)Address already in use: AH00072: make_sock: could not bind to address [::]:80
(98)Address already in use: AH00072: make_sock: could not bind to address 0.0.0.0:80
no listening sockets available, shutting down
AH00015: Unable to open logs
Action 'start' failed.
The Apache error log may have more information.
   ...fail!
 * The apache2 instance did not start within 20 seconds. Please read the log files to discover problems
invoke-rc.d: initscript apache2, action "restart" failed.
maas-pserv start/running, process 18535
maas-cluster-celery start/running, process 18569
Processing triggers for ureadahead (0.100.0-16) ...
Setting up maas (1.4+bzr1853+dfsg+1866+229~ppa0~ubuntu14.04.1) ...
Processing triggers for libc-bin (2.18-0ubuntu6) ...
 -> Finished parsing the build-deps
adt-run: & ubtree0t-maas-package-test: [----------------------------------------
networking stop/waiting
networking start/running
Ignoring indexes: https://pypi.python.org/simple/
Downloading/unpacking nose-timer
  Running setup.py egg_info for package nose-timer
    
Installing collected packages: nose-timer
  Running setup.py install for nose-timer
    
Successfully installed nose-timer
Cleaning up...
maas-integration.TestMAASIntegration.test_create_admin ... ok
maas-integration.TestMAASIntegration.test_restart_dbus_avahi ... SKIP: Avahi/DBUS are not used anymore
maas-integration.TestMAASIntegration.test_update_maas_url ... ok
maas-integration.TestMAASIntegration.test_restart_provisioning_server ... ok
maas-integration.TestMAASIntegration.test_check_initial_services ... ok
maas-integration.TestMAASIntegration.test_update_pxe_config ... ok
maas-integration.TestMAASIntegration.test_import_pxe_files ... ok
maas-integration.TestMAASIntegration.test_update_preseed_arm ... ok
maas-integration.TestMAASIntegration.test_login_api ... ok
maas-integration.TestMAASIntegration.test_set_http_proxy ... SKIP: Not testing proxy.
maas-integration.TestMAASIntegration.test_cluster_connected ... ok
maas-integration.TestMAASIntegration.test_set_up_dhcp_region ... ok
maas-integration.TestMAASIntegration.test_check_dhcp_service ... ok
maas-integration.TestMAASIntegration.test_set_up_dhcp_cluster ... SKIP: Not testing cluster controller
maas-integration.TestMAASIntegration.test_update_dns_config ... ok
maas-integration.TestMAASIntegration.test_boot_nodes_enlist ... ok
maas-integration.TestMAASIntegration.test_check_nodes_declared ... ok
maas-integration.TestMAASIntegration.test_set_nodes_ipmi_config ... ok
maas-integration.TestMAASIntegration.test_commission_nodes ... ok
maas-integration.TestMAASIntegration.test_check_nodes_ready ... ok
maas-integration.TestMAASIntegration.test_apply_tag_to_all_nodes ... ok
maas-integration.TestMAASIntegration.test_check_tag_applied_to_all_nodes ... ok
maas-integration.TestMAASIntegration.test_configure_juju ... ok
maas-integration.TestMAASIntegration.test_juju_bootstrap ... ERROR
SKIP: Not testing Cluster controller

======================================================================
ERROR: maas-integration.TestMAASIntegration.test_juju_bootstrap
----------------------------------------------------------------------
_StringException: juju --debug bootstrap --upload-tools: {{{
2014-01-31 02:06:47 DEBUG juju.environs.configstore disk.go:77 Making /root/.juju/environments
2014-01-31 02:06:47 DEBUG juju.environs.configstore disk.go:67 Making /root/.juju/environments owned by 1000:1000
2014-01-31 02:06:47 DEBUG juju.environs.configstore disk.go:67 Making /root/.juju/environments/maas.jenv owned by 1000:1000
2014-01-31 02:06:47 DEBUG juju.provider.maas environprovider.go:33 opening environment "maas".
2014-01-31 02:06:48 DEBUG juju.environs.configstore disk.go:67 Making /root/.juju/environments/maas.jenv owned by 1000:1000
2014-01-31 02:06:48 DEBUG juju.environs.sync sync.go:205 Uploading tools for [trusty precise]
2014-01-31 02:06:48 DEBUG juju.environs.tools build.go:115 looking for: juju
2014-01-31 02:06:48 DEBUG juju.environs.tools build.go:156 checking: /usr/bin/jujud
2014-01-31 02:06:48 INFO juju.environs.tools build.go:162 found existing jujud
2014-01-31 02:06:48 INFO juju.environs.tools build.go:172 target: /tmp/adt-run.a96AKV/ubtree0t-maas-package-test-testtmp/tmpdir/juju-tools088042482/jujud
2014-01-31 02:06:48 DEBUG juju.environs.tools build.go:223 forcing version to 1.17.1.1
2014-01-31 02:06:48 DEBUG juju.environs.tools build.go:39 adding entry: &tar.Header{Name:"FORCE-VERSION", Mode:420, Uid:0, Gid:0, Size:8, ModTime:time.Time{sec:63526730808, nsec:0x16a9d18c, loc:(*time.Location)(0x185f080)}, Typeflag:0x30, Linkname:"", Uname:"ubuntu", Gname:"ubuntu", Devmajor:0, Devminor:0, AccessTime:time.Time{sec:63526730808, nsec:0x16a9d18c, loc:(*time.Location)(0x185f080)}, ChangeTime:time.Time{sec:63526730808, nsec:0x16a9d18c, loc:(*time.Location)(0x185f080)}}
2014-01-31 02:06:48 DEBUG juju.environs.tools build.go:39 adding entry: &tar.Header{Name:"jujud", Mode:493, Uid:0, Gid:0, Size:35317024, ModTime:time.Time{sec:63526730808, nsec:0x16a9d18c, loc:(*time.Location)(0x185f080)}, Typeflag:0x30, Linkname:"", Uname:"ubuntu", Gname:"ubuntu", Devmajor:0, Devminor:0, AccessTime:time.Time{sec:63526730808, nsec:0x16a9d18c, loc:(*time.Location)(0x185f080)}, ChangeTime:time.Time{sec:63526730808, nsec:0x16a9d18c, loc:(*time.Location)(0x185f080)}}
2014-01-31 02:06:52 INFO juju.environs.sync sync.go:224 built 1.17.1.1-trusty-amd64 (7007kB)
2014-01-31 02:06:52 ERROR juju.cmd supercommand.go:294 file '79f96df5-65c2-4b6b-8ba0-01c71d2d56ec-tools/releases/juju-1.17.1.1-precise-amd64.tgz' not found not found
}}}

juju --debug status: {{{
2014-01-31 02:56:15 DEBUG juju api.go:172 no cached API connection settings found
2014-01-31 02:56:15 DEBUG juju.provider.maas environprovider.go:33 opening environment "maas".
2014-01-31 02:56:16 ERROR juju.cmd supercommand.go:294 Unable to connect to environment "".
Please check your credentials or use 'juju bootstrap' to create a new environment.

Error details:
environment is not bootstrapped
}}}

Traceback (most recent call last):
  File "/tmp/adt-run.a96AKV/ubtree0-build/real-tree/debian/tests/utils.py", line 69, in wrapper
    result = func(*args, **kwargs)
  File "/tmp/adt-run.a96AKV/ubtree0-build/real-tree/debian/tests/maas-integration.py", line 618, in test_juju_bootstrap
    self._wait_machines_running(1)
  File "/tmp/adt-run.a96AKV/ubtree0-build/real-tree/debian/tests/maas-integration.py", line 632, in _wait_machines_running
    sleep(20)
  File "/tmp/adt-run.a96AKV/ubtree0-build/real-tree/debian/tests/utils.py", line 63, in _handle_timeout
    raise TimeoutError(error_message)
TimeoutError: Timer expired


maas-integration.TestMAASIntegration.test_update_pxe_config: 0.0007s
maas-integration.TestMAASIntegration.test_check_dhcp_service: 0.0234s
maas-integration.TestMAASIntegration.test_check_initial_services: 0.0446s
maas-integration.TestMAASIntegration.test_restart_provisioning_server: 0.0752s
maas-integration.TestMAASIntegration.test_create_admin: 0.1166s
maas-integration.TestMAASIntegration.test_update_preseed_arm: 0.1225s
maas-integration.TestMAASIntegration.test_cluster_connected: 0.2267s
maas-integration.TestMAASIntegration.test_apply_tag_to_all_nodes: 0.2352s
maas-integration.TestMAASIntegration.test_commission_nodes: 0.4073s
maas-integration.TestMAASIntegration.test_boot_nodes_enlist: 0.5546s
maas-integration.TestMAASIntegration.test_update_maas_url: 1.1199s
maas-integration.TestMAASIntegration.test_update_dns_config: 1.6021s
maas-integration.TestMAASIntegration.test_login_api: 1.8883s
maas-integration.TestMAASIntegration.test_set_nodes_ipmi_config: 2.7398s
maas-integration.TestMAASIntegration.test_set_up_dhcp_region: 4.6337s
maas-integration.TestMAASIntegration.test_check_tag_applied_to_all_nodes: 5.4768s
maas-integration.TestMAASIntegration.test_configure_juju: 6.0758s
maas-integration.TestMAASIntegration.test_check_nodes_declared: 136.6619s
maas-integration.TestMAASIntegration.test_check_nodes_ready: 173.4078s
maas-integration.TestMAASIntegration.test_import_pxe_files: 947.3457s
maas-integration.TestMAASIntegration.test_juju_bootstrap: 3000.0365s
----------------------------------------------------------------------
Ran 24 tests in 4282.978s

FAILED (SKIP=4, errors=1)
adt-run1: testbed executing test finished with exit status 1
adt-run: & ubtree0t-maas-package-test: ----------------------------------------]
adt-run: & ubtree0t-maas-package-test:  - - - - - - - - - - results - - - - - - - - - -
ubtree0t-maas-package-test FAIL non-zero exit status 1
adt-run1: ** needs_reset, previously=False, requested by run_tests() line 1114
adt-run1: ** needs_reset, previously=True, requested by process_actions() line 2068
adt-run: @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ tests done.
adt-run1: ** stop
adt-run1: ** close, scratch=/tmp/adt-run.a96AKV
+ RC=4
+ [ 4 -eq 20 ]
+ [ 0 -eq 1 ]
+ [ -x /home/ubuntu/adt-export-result ]
+ RES=PASS
+ [ 4 -gt 0 ]
+ RES=FAIL
+ /home/ubuntu/adt-export-result -D /root/adt-log maas FAIL
+ chown -R ubuntu /root/adt-log /var/tmp/testresults
+ chmod og+r /var/log/syslog
+ ls /var/crash/
+ [ -n  ]
+ exit 4
Connection to localhost closed.
+ RET=4
+ [ 0 -eq 1 ]
+ [ 4 -gt 0 ]
+ log_failure_msg adt-run exited with status 4.
+ log_msg Failure: adt-run exited with status 4.\n
+ date +%F %X
+ printf 2014-01-30 21:56:21: Failure: adt-run exited with status 4.\n
2014-01-30 21:56:21: Failure: adt-run exited with status 4.
+ [ 0 -eq 0 ]
+ mkdir -p /home/ubuntu/jenkins-jobs/workspace/trusty-adt-maas-daily/results
+ ssh -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -o CheckHostIP=no -i /var/tmp/adt/disks/adtkey -p 54323 -tt -o BatchMode=yes -l ubuntu localhost sudo chown -R ubuntu /root/adt-log; find /root/adt-log -type f -empty | xargs rm 2>/dev/null
Warning: Permanently added '[localhost]:54323' (ECDSA) to the list of known hosts.
find: `/root/adt-log': Permission denied
Connection to localhost closed.
+ true
+ scp -r -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -o CheckHostIP=no -i /var/tmp/adt/disks/adtkey -P 54323 ubuntu@localhost:/root/adt-log/* /var/crash/*crash /var/log/syslog /var/tmp/testresults /home/ubuntu/jenkins-jobs/workspace/trusty-adt-maas-daily/results
+ true
+ log_info_msg Test artifacts copied to /home/ubuntu/jenkins-jobs/workspace/trusty-adt-maas-daily/results
+ log_msg Info: Test artifacts copied to /home/ubuntu/jenkins-jobs/workspace/trusty-adt-maas-daily/results\n
+ date +%F %X
+ printf 2014-01-30 21:56:23: Info: Test artifacts copied to /home/ubuntu/jenkins-jobs/workspace/trusty-adt-maas-daily/results\n
2014-01-30 21:56:23: Info: Test artifacts copied to /home/ubuntu/jenkins-jobs/workspace/trusty-adt-maas-daily/results
+ [ -f /home/ubuntu/jenkins-jobs/workspace/trusty-adt-maas-daily/results/summary.log ]
+ [ -n 2014-01-31_01-35-57 ]
+ ls -tr /home/ubuntu/jenkins-jobs/workspace/trusty-adt-maas-daily/results/*.result
+ tail -1
+ resfile=
+ [ -n  ]
+ log_failure_msg Test didn't end normally. Generating error file
+ log_msg Failure: Test didn't end normally. Generating error file\n
+ date +%F %X
+ printf 2014-01-30 21:56:23: Failure: Test didn't end normally. Generating error file\n
2014-01-30 21:56:23: Failure: Test didn't end normally. Generating error file
+ date +%Y%m%d-%H%M%S
+ errfile=/home/ubuntu/jenkins-jobs/workspace/trusty-adt-maas-daily/results/trusty_amd64_maas_20140130-215623.error
+ echo trusty amd64 maas
+ rsync -a /home/ubuntu/jenkins-jobs/workspace/trusty-adt-maas-daily/results/trusty_amd64_maas_20140130-215623.error /trusty/tmp/
rsync: mkdir "/trusty/tmp" failed: No such file or directory (2)
rsync error: error in file IO (code 11) at main.c(674) [Receiver=3.1.0]
+ true
+ [ 0 -eq 0 ]
+ ssh -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -o CheckHostIP=no -i /var/tmp/adt/disks/adtkey -p 54323 -tt -o BatchMode=yes -l ubuntu localhost sudo poweroff
Warning: Permanently added '[localhost]:54323' (ECDSA) to the list of known hosts.


Broadcast message from ubuntu@autopkgtest

	(/dev/pts/0) at 21:56 ...




The system is going down for power off NOW!

Connection to localhost closed.
+ exit 4
+ on_exit
+ log_info_msg Cleaning up
+ log_msg Info: Cleaning up\n
+ date +%F %X
+ printf 2014-01-30 21:56:24: Info: Cleaning up\n
2014-01-30 21:56:24: Info: Cleaning up
+ [ -f /var/tmp/adt/disks/run/trusty-amd64-maas-20140130_203631.Z8b8Rd.img.pid ]
+ cat /var/tmp/adt/disks/run/trusty-amd64-maas-20140130_203631.Z8b8Rd.img.pid
+ kill -9 23738
+ rm -f /var/tmp/adt/disks/run/trusty-amd64-maas-20140130_203631.Z8b8Rd.img.pid
+ rm -f /var/tmp/adt/disks/run/trusty-amd64-maas-20140130_203631.Z8b8Rd.img
+ rm -f /var/tmp/adt/disks/run/trusty-amd64-maas-20140130_203631.Z8b8Rd.img.monitor /var/tmp/adt/disks/run/trusty-amd64-maas-20140130_203631.Z8b8Rd.img.serial
+ rm -f /var/lock/adt/ssh.54323.lock
+ rm -f /var/lock/adt/vnc.5911.lock
+ [ -d /tmp/adt-amd64.2VDGKJ ]
+ rm -Rf /tmp/adt-amd64.2VDGKJ
+ rm -f /var/tmp/adt/disks/run/trusty-amd64-maas-*.img*
+ find /var/lock/adt -name *.lock -mtime +1
+ exit 4
Build step 'Execute shell' marked build as failure
Archiving artifacts
Email was triggered for: Failure
Sending email for trigger: Failure


Follow ups

References