maas-builds team mailing list archive
-
maas-builds team
-
Mailing list archive
-
Message #00378
Jenkins Still Failing - trusty-adt-maas-daily 114
See http://d-jenkins.ubuntu-ci:8080/job/trusty-adt-maas-daily/114/
[...truncated 3130 lines...]
> maasserver:0037_nodegroup_cluster_name_unique
> maasserver:0038_nodegroupinterface_ip_range_fix
> maasserver:0039_add_filestorage_content
> maasserver:0039_add_nodegroup_to_bootimage
> maasserver:0040_make_filestorage_data_not_null
> maasserver:0041_remove_filestorage_data
> maasserver:0042_fix_039_conflict
> maasserver:0043_unique_hostname_preparation
> maasserver:0044_node_hostname_unique
> maasserver:0045_add_tag_kernel_opts
> maasserver:0046_add_nodegroup_maas_url
> maasserver:0047_add_owner_to_filestorage
> maasserver:0048_add_key_to_filestorage
> maasserver:0049_filestorage_key_unique
> maasserver:0050_shared_to_per_tenant_storage
> maasserver:0051_bigger_distro_series_name
> maasserver:0052_add_node_storage
> maasserver:0053_node_routers
> maasserver:0054_download_progress
> maasserver:0055_nullable_bytes_downloaded
> maasserver:0056_netboot_off_for_allocated_nodes
> maasserver:0057_remove_hardware_details
> maasserver:0058_add_agent_name_to_node
> maasserver:0059_dhcp_detection_model
> maasserver:0060_add_zone_object
> maasserver:0061_add_ref_from_node_to_zone
> maasserver:0062_add_vlan_model
> maasserver:0063_create_default_zone
> maasserver:0064_set_default_zone
> maasserver:0065_set_default_zone_as_model_default
> maasserver:0066_rename_vlan_add_link_node_network
> maasserver:0067_default_commissioning_trusty
> maasserver:0068_network_description_textfield
> maasserver:0069_add_mac_network_relation
> maasserver:0070_drop_network_node_relation
> maasserver:0071_drop_after_commissioning_action
- Loading initial data for maasserver.
Installed 1 object(s) from 1 fixture(s)
Running migrations for metadataserver:
- Migrating forwards to 0014_commission_result_rename_data_bin_col.
> metadataserver:0001_initial
> metadataserver:0002_add_nodecommissionresult
> metadataserver:0003_populate_hardware_details
> metadataserver:0004_add_commissioningscript
> metadataserver:0005_nodecommissionresult_add_timestamp
> metadataserver:0006_nodecommissionresult_add_status
> metadataserver:0007_nodecommissionresult_change_name_size
> metadataserver:0008_rename_lshw_commissioning_output
> metadataserver:0009_delete_status
> metadataserver:0010_add_script_result
> metadataserver:0011_commission_result_binary_data_col
> metadataserver:0012_commission_result_binary_data_recode
> metadataserver:0013_commission_result_drop_old_data_col
> metadataserver:0014_commission_result_rename_data_bin_col
- Loading initial data for metadataserver.
Installed 1 object(s) from 1 fixture(s)
* Restarting web server apache2
(98)Address already in use: AH00072: make_sock: could not bind to address [::]:80
(98)Address already in use: AH00072: make_sock: could not bind to address 0.0.0.0:80
no listening sockets available, shutting down
AH00015: Unable to open logs
Action 'start' failed.
The Apache error log may have more information.
...fail!
* The apache2 instance did not start within 20 seconds. Please read the log files to discover problems
invoke-rc.d: initscript apache2, action "restart" failed.
squid-deb-proxy stop/waiting
squid-deb-proxy start/running, process 30845
maas-txlongpoll start/running, process 30926
maas-region-celery start/running, process 31002
Setting up python-testtools (0.9.35-0ubuntu1) ...
Setting up python-extras (0.0.3-2ubuntu1) ...
Setting up libnss3-nssdb (2:3.15.4-1ubuntu6) ...
Setting up libnss3:amd64 (2:3.15.4-1ubuntu6) ...
Setting up librados2 (0.72.2-1) ...
Setting up librbd1 (0.72.2-1) ...
Setting up tgt (1:1.0.43-0ubuntu2) ...
tgt start/running, process 31081
Processing triggers for ureadahead (0.100.0-16) ...
Setting up maas-cluster-controller (1.5+bzr1977+2024+245~ppa0~ubuntu14.04.1) ...
* Restarting web server apache2
...done.
maas-pserv start/running, process 31261
maas-cluster-celery start/running, process 31295
Processing triggers for ureadahead (0.100.0-16) ...
Setting up maas (1.5+bzr1977+2024+245~ppa0~ubuntu14.04.1) ...
Processing triggers for libc-bin (2.19-0ubuntu2) ...
-> Finished parsing the build-deps
adt-run: & ubtree0t-maas-package-test: [----------------------------------------
networking stop/waiting
networking start/running
Ignoring indexes: https://pypi.python.org/simple/
Downloading/unpacking nose-timer
Running setup.py egg_info for package nose-timer
Installing collected packages: nose-timer
Running setup.py install for nose-timer
Successfully installed nose-timer
Cleaning up...
maas-integration.TestMAASIntegration.test_create_admin ... ok
maas-integration.TestMAASIntegration.test_restart_dbus_avahi ... SKIP: Avahi/DBUS are not used anymore
maas-integration.TestMAASIntegration.test_update_maas_url ... ok
maas-integration.TestMAASIntegration.test_restart_provisioning_server ... ok
maas-integration.TestMAASIntegration.test_check_initial_services ... ok
maas-integration.TestMAASIntegration.test_update_pxe_config ... ok
maas-integration.TestMAASIntegration.test_import_pxe_files ... ok
maas-integration.TestMAASIntegration.test_update_preseed_arm ... ok
maas-integration.TestMAASIntegration.test_login_api ... ok
maas-integration.TestMAASIntegration.test_set_http_proxy ... SKIP: Not testing proxy.
maas-integration.TestMAASIntegration.test_cluster_connected ... ok
maas-integration.TestMAASIntegration.test_set_up_dhcp_region ... ok
maas-integration.TestMAASIntegration.test_check_dhcp_service ... ok
maas-integration.TestMAASIntegration.test_set_up_dhcp_cluster ... SKIP: Not testing cluster controller
maas-integration.TestMAASIntegration.test_update_dns_config ... ok
maas-integration.TestMAASIntegration.test_boot_nodes_enlist ... ok
maas-integration.TestMAASIntegration.test_check_nodes_declared ... ERROR
SKIP: Not testing Cluster controller
======================================================================
ERROR: maas-integration.TestMAASIntegration.test_check_nodes_declared
----------------------------------------------------------------------
_StringException: Empty attachments:
stderr for maas maas ['nodes', 'list']
retcode for maas maas ['nodes', 'list']: {{{0}}}
stdout for maas maas ['nodes', 'list']: {{{[]}}}
Traceback (most recent call last):
File "/tmp/adt-run.FvSqlH/ubtree0-build/real-tree/debian/tests/utils.py", line 69, in wrapper
result = func(*args, **kwargs)
File "/tmp/adt-run.FvSqlH/ubtree0-build/real-tree/debian/tests/maas-integration.py", line 552, in test_check_nodes_declared
self._wait_nodes(0)
File "/tmp/adt-run.FvSqlH/ubtree0-build/real-tree/debian/tests/maas-integration.py", line 544, in _wait_nodes
sleep(5)
File "/tmp/adt-run.FvSqlH/ubtree0-build/real-tree/debian/tests/utils.py", line 63, in _handle_timeout
raise TimeoutError(error_message)
TimeoutError: Timer expired
maas-integration.TestMAASIntegration.test_update_pxe_config: 0.0005s
maas-integration.TestMAASIntegration.test_update_preseed_arm: 0.0012s
maas-integration.TestMAASIntegration.test_check_initial_services: 0.0472s
maas-integration.TestMAASIntegration.test_restart_provisioning_server: 0.0869s
maas-integration.TestMAASIntegration.test_create_admin: 0.1233s
maas-integration.TestMAASIntegration.test_cluster_connected: 0.2305s
maas-integration.TestMAASIntegration.test_boot_nodes_enlist: 0.4987s
maas-integration.TestMAASIntegration.test_set_up_dhcp_region: 0.7387s
maas-integration.TestMAASIntegration.test_update_maas_url: 1.2455s
maas-integration.TestMAASIntegration.test_update_dns_config: 1.7981s
maas-integration.TestMAASIntegration.test_login_api: 2.9216s
maas-integration.TestMAASIntegration.test_check_dhcp_service: 5.1012s
maas-integration.TestMAASIntegration.test_import_pxe_files: 339.1451s
maas-integration.TestMAASIntegration.test_check_nodes_declared: 420.0048s
----------------------------------------------------------------------
Ran 17 tests in 772.013s
FAILED (SKIP=4, errors=1)
adt-run1: testbed executing test finished with exit status 1
adt-run: & ubtree0t-maas-package-test: ----------------------------------------]
adt-run: & ubtree0t-maas-package-test: - - - - - - - - - - results - - - - - - - - - -
ubtree0t-maas-package-test FAIL non-zero exit status 1
adt-run1: ** needs_reset, previously=False, requested by run_tests() line 1144
adt-run1: ** needs_reset, previously=True, requested by process_actions() line 2084
adt-run: @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ tests done.
adt-run1: ** stop
adt-run1: ** close, scratch=/tmp/adt-run.FvSqlH
+ RC=4
+ [ 4 -eq 20 ]
+ [ 0 -eq 1 ]
+ [ -x /home/ubuntu/adt-export-result ]
+ RES=PASS
+ [ 4 -gt 0 ]
+ RES=FAIL
+ /home/ubuntu/adt-export-result -D /root/adt-log maas FAIL
+ chown -R ubuntu /root/adt-log /var/tmp/testresults
+ chmod og+r /var/log/syslog
+ ls /var/crash/
+ [ -n ]
+ exit 4
Connection to localhost closed.
+ RET=4
+ [ 0 -eq 1 ]
+ [ 4 -gt 0 ]
+ log_failure_msg adt-run exited with status 4.
+ log_msg Failure: adt-run exited with status 4.\n
+ date +%F %X
+ printf 2014-02-26 20:20:20: Failure: adt-run exited with status 4.\n
2014-02-26 20:20:20: Failure: adt-run exited with status 4.
+ [ 0 -eq 0 ]
+ mkdir -p /home/ubuntu/jenkins-jobs/workspace/trusty-adt-maas-daily/results
+ ssh -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -o CheckHostIP=no -i /var/tmp/adt/disks/adtkey -p 54323 -tt -o BatchMode=yes -l ubuntu localhost sudo chown -R ubuntu /root/adt-log; find /root/adt-log -type f -empty | xargs rm 2>/dev/null
Warning: Permanently added '[localhost]:54323' (ECDSA) to the list of known hosts.
find: `/root/adt-log': Permission denied
Connection to localhost closed.
+ true
+ scp -r -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -o CheckHostIP=no -i /var/tmp/adt/disks/adtkey -P 54323 ubuntu@localhost:/root/adt-log/* /var/crash/*crash /var/log/syslog /var/tmp/testresults /home/ubuntu/jenkins-jobs/workspace/trusty-adt-maas-daily/results
+ true
+ log_info_msg Test artifacts copied to /home/ubuntu/jenkins-jobs/workspace/trusty-adt-maas-daily/results
+ log_msg Info: Test artifacts copied to /home/ubuntu/jenkins-jobs/workspace/trusty-adt-maas-daily/results\n
+ date +%F %X
+ printf 2014-02-26 20:20:21: Info: Test artifacts copied to /home/ubuntu/jenkins-jobs/workspace/trusty-adt-maas-daily/results\n
2014-02-26 20:20:21: Info: Test artifacts copied to /home/ubuntu/jenkins-jobs/workspace/trusty-adt-maas-daily/results
+ [ -f /home/ubuntu/jenkins-jobs/workspace/trusty-adt-maas-daily/results/summary.log ]
+ [ -n 2014-02-27_01-02-07 ]
+ + taills -tr -1
/home/ubuntu/jenkins-jobs/workspace/trusty-adt-maas-daily/results/*.result
+ resfile=
+ [ -n ]
+ log_failure_msg Test didn't end normally. Generating error file
+ log_msg Failure: Test didn't end normally. Generating error file\n
+ date +%F %X
+ printf 2014-02-26 20:20:21: Failure: Test didn't end normally. Generating error file\n
2014-02-26 20:20:21: Failure: Test didn't end normally. Generating error file
+ date +%Y%m%d-%H%M%S
+ errfile=/home/ubuntu/jenkins-jobs/workspace/trusty-adt-maas-daily/results/trusty_amd64_maas_20140226-202021.error
+ echo trusty amd64 maas
+ rsync -a /home/ubuntu/jenkins-jobs/workspace/trusty-adt-maas-daily/results/trusty_amd64_maas_20140226-202021.error /trusty/tmp/
rsync: mkdir "/trusty/tmp" failed: No such file or directory (2)
rsync error: error in file IO (code 11) at main.c(674) [Receiver=3.1.0]
+ true
+ [ 0 -eq 0 ]
+ ssh -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -o CheckHostIP=no -i /var/tmp/adt/disks/adtkey -p 54323 -tt -o BatchMode=yes -l ubuntu localhost sudo poweroff
Warning: Permanently added '[localhost]:54323' (ECDSA) to the list of known hosts.
Connection to localhost closed.
+ exit 4
+ on_exit
+ log_info_msg Cleaning up
+ log_msg Info: Cleaning up\n
+ date +%F %X
+ printf 2014-02-26 20:20:22: Info: Cleaning up\n
2014-02-26 20:20:22: Info: Cleaning up
+ [ -f /var/tmp/adt/disks/run/trusty-amd64-maas-20140226_200245.zS38wy.img.pid ]
+ cat /var/tmp/adt/disks/run/trusty-amd64-maas-20140226_200245.zS38wy.img.pid
+ kill -9 19338
+ rm -f /var/tmp/adt/disks/run/trusty-amd64-maas-20140226_200245.zS38wy.img.pid
+ rm -f /var/tmp/adt/disks/run/trusty-amd64-maas-20140226_200245.zS38wy.img
+ rm -f /var/lock/adt/ssh.54323.lock
+ rm -f /var/lock/adt/vnc.5911.lock
+ [ -d /tmp/adt-amd64.bDAAuu ]
+ rm -Rf /tmp/adt-amd64.bDAAuu
+ rm -f /var/tmp/adt/disks/run/trusty-amd64-maas-*.img*
+ find /var/lock/adt -name *.lock -mtime +1
+ exit 4
Build step 'Execute shell' marked build as failure
Archiving artifacts
Email was triggered for: Failure
Sending email for trigger: Failure
Follow ups
References