maas-builds team mailing list archive

Thread
Date
Jenkins Still Failing - trusty-adt-maas-daily 69

To: maas-builds@xxxxxxxxxxxxxxxxxxx
From: Jenkins Notification <devnull@xxxxxxxxxxxxx>
Date: Sun, 2 Feb 2014 02:01:05 +0000 (UTC)
In-reply-to: <157270395.616.1391219163749.JavaMail.jenkins@tachash>
See http://d-jenkins.ubuntu-ci:8080/job/trusty-adt-maas-daily/69/

[...truncated 7018 lines...]
 > maasserver:0030_ip_address_to_generic_ip_address
 > maasserver:0031_node_architecture_field_size
 > maasserver:0032_node_subarch
 > maasserver:0033_component_error
 > maasserver:0034_timestamp_component_error
 > maasserver:0035_add_nodegroup_cluster_name
 > maasserver:0036_populate_nodegroup_cluster_name
 > maasserver:0037_nodegroup_cluster_name_unique
 > maasserver:0038_nodegroupinterface_ip_range_fix
 > maasserver:0039_add_filestorage_content
 > maasserver:0039_add_nodegroup_to_bootimage
 > maasserver:0040_make_filestorage_data_not_null
 > maasserver:0041_remove_filestorage_data
 > maasserver:0042_fix_039_conflict
 > maasserver:0043_unique_hostname_preparation
 > maasserver:0044_node_hostname_unique
 > maasserver:0045_add_tag_kernel_opts
 > maasserver:0046_add_nodegroup_maas_url
 > maasserver:0047_add_owner_to_filestorage
 > maasserver:0048_add_key_to_filestorage
 > maasserver:0049_filestorage_key_unique
 > maasserver:0050_shared_to_per_tenant_storage
 > maasserver:0051_bigger_distro_series_name
 > maasserver:0052_add_node_storage
 > maasserver:0053_node_routers
 > maasserver:0054_download_progress
 > maasserver:0055_nullable_bytes_downloaded
 > maasserver:0056_netboot_off_for_allocated_nodes
 > maasserver:0057_remove_hardware_details
 > maasserver:0058_add_agent_name_to_node
 > maasserver:0059_dhcp_detection_model
 > maasserver:0060_add_zone_object
 > maasserver:0061_add_ref_from_node_to_zone
 > maasserver:0062_add_vlan_model
 > maasserver:0063_create_default_zone
 > maasserver:0064_set_default_zone
 > maasserver:0065_set_default_zone_as_model_default
 - Loading initial data for maasserver.
Installed 1 object(s) from 1 fixture(s)
Running migrations for metadataserver:
 - Migrating forwards to 0014_commission_result_rename_data_bin_col.
 > metadataserver:0001_initial
 > metadataserver:0002_add_nodecommissionresult
 > metadataserver:0003_populate_hardware_details
 > metadataserver:0004_add_commissioningscript
 > metadataserver:0005_nodecommissionresult_add_timestamp
 > metadataserver:0006_nodecommissionresult_add_status
 > metadataserver:0007_nodecommissionresult_change_name_size
 > metadataserver:0008_rename_lshw_commissioning_output
 > metadataserver:0009_delete_status
 > metadataserver:0010_add_script_result
 > metadataserver:0011_commission_result_binary_data_col
 > metadataserver:0012_commission_result_binary_data_recode
 > metadataserver:0013_commission_result_drop_old_data_col
 > metadataserver:0014_commission_result_rename_data_bin_col
 - Loading initial data for metadataserver.
Installed 1 object(s) from 1 fixture(s)
 * Restarting web server apache2
   ...done.
squid-deb-proxy stop/waiting
squid-deb-proxy start/running, process 18151
maas-txlongpoll start/running, process 18232
maas-region-celery start/running, process 18314
Setting up python-testtools (0.9.35-0ubuntu1) ...
Setting up python-extras (0.0.3-2ubuntu1) ...
Setting up libnss3-nssdb (2:3.15.4-1ubuntu5) ...
Setting up libnss3:amd64 (2:3.15.4-1ubuntu5) ...
Setting up librados2 (0.72.2-1) ...
Setting up librbd1 (0.72.2-1) ...
Setting up tgt (1:1.0.43-0ubuntu2) ...
tgt start/running, process 18389
Processing triggers for ureadahead (0.100.0-16) ...
Setting up maas-cluster-controller (1.4+bzr1853+dfsg+1875+230~ppa0~ubuntu14.04.1) ...
 * Restarting web server apache2
   ...done.
maas-pserv start/running, process 18613
maas-cluster-celery start/running, process 18647
Processing triggers for ureadahead (0.100.0-16) ...
Setting up maas (1.4+bzr1853+dfsg+1875+230~ppa0~ubuntu14.04.1) ...
Processing triggers for libc-bin (2.18-0ubuntu6) ...
 -> Finished parsing the build-deps
adt-run: & ubtree0t-maas-package-test: [----------------------------------------
networking stop/waiting
networking start/running
Ignoring indexes: https://pypi.python.org/simple/
Downloading/unpacking nose-timer
  Running setup.py egg_info for package nose-timer
    
Installing collected packages: nose-timer
  Running setup.py install for nose-timer
    
Successfully installed nose-timer
Cleaning up...
maas-integration.TestMAASIntegration.test_create_admin ... ok
maas-integration.TestMAASIntegration.test_restart_dbus_avahi ... SKIP: Avahi/DBUS are not used anymore
maas-integration.TestMAASIntegration.test_update_maas_url ... ok
maas-integration.TestMAASIntegration.test_restart_provisioning_server ... ok
maas-integration.TestMAASIntegration.test_check_initial_services ... ok
maas-integration.TestMAASIntegration.test_update_pxe_config ... ok
maas-integration.TestMAASIntegration.test_import_pxe_files ... ok
maas-integration.TestMAASIntegration.test_update_preseed_arm ... ok
maas-integration.TestMAASIntegration.test_login_api ... ok
maas-integration.TestMAASIntegration.test_set_http_proxy ... SKIP: Not testing proxy.
maas-integration.TestMAASIntegration.test_cluster_connected ... ok
maas-integration.TestMAASIntegration.test_set_up_dhcp_region ... ERROR
SKIP: Not testing Cluster controller

======================================================================
ERROR: maas-integration.TestMAASIntegration.test_set_up_dhcp_region
----------------------------------------------------------------------
_StringException: Empty attachments:
  stderr for maas-cli maas ['node-group-interface', 'update', '80f33eb2-b72a-44e6-8aac-320f20365a39', 'eth1', 'subnet_mask=255.255.255.0', 'ip_range_low=192.168.21.10', 'broadcast_ip=192.168.21.255', 'router_ip=192.168.21.1', 'ip_range_high=192.168.21.200', 'interface=eth1', 'ip=192.168.21.5', 'management=2']
  stderr for maas-cli maas ['node-groups', 'list']

retcode for maas-cli maas ['node-group-interface', 'update', '80f33eb2-b72a-44e6-8aac-320f20365a39', 'eth1', 'subnet_mask=255.255.255.0', 'ip_range_low=192.168.21.10', 'broadcast_ip=192.168.21.255', 'router_ip=192.168.21.1', 'ip_range_high=192.168.21.200', 'interface=eth1', 'ip=192.168.21.5', 'management=2']: {{{2}}}
retcode for maas-cli maas ['node-groups', 'list']: {{{0}}}
stdout for maas-cli maas ['node-group-interface', 'update', '80f33eb2-b72a-44e6-8aac-320f20365a39', 'eth1', 'subnet_mask=255.255.255.0', 'ip_range_low=192.168.21.10', 'broadcast_ip=192.168.21.255', 'router_ip=192.168.21.1', 'ip_range_high=192.168.21.200', 'interface=eth1', 'ip=192.168.21.5', 'management=2']: {{{Not Found}}}
stdout for maas-cli maas ['node-groups', 'list']: {{{
[
    {
        "cluster_name": "Cluster master", 
        "status": 1, 
        "name": "master", 
        "uuid": "80f33eb2-b72a-44e6-8aac-320f20365a39"
    }
]
}}}

Traceback (most recent call last):
  File "/tmp/adt-run.Y3AyAH/ubtree0-build/real-tree/debian/tests/utils.py", line 69, in wrapper
    result = func(*args, **kwargs)
  File "/tmp/adt-run.Y3AyAH/ubtree0-build/real-tree/debian/tests/maas-integration.py", line 418, in test_set_up_dhcp_region
    self._set_up_dhcp(region_uuid, region_dhcp_config)
  File "/tmp/adt-run.Y3AyAH/ubtree0-build/real-tree/debian/tests/maas-integration.py", line 388, in _set_up_dhcp
    node_group = loads(output)
  File "/usr/lib/python2.7/dist-packages/simplejson/__init__.py", line 488, in loads
    return _default_decoder.decode(s)
  File "/usr/lib/python2.7/dist-packages/simplejson/decoder.py", line 370, in decode
    obj, end = self.raw_decode(s)
  File "/usr/lib/python2.7/dist-packages/simplejson/decoder.py", line 389, in raw_decode
    return self.scan_once(s, idx=_w(s, idx).end())
JSONDecodeError: Expecting value: line 1 column 1 (char 0)


maas-integration.TestMAASIntegration.test_update_pxe_config: 0.0006s
maas-integration.TestMAASIntegration.test_check_initial_services: 0.0434s
maas-integration.TestMAASIntegration.test_update_preseed_arm: 0.0645s
maas-integration.TestMAASIntegration.test_restart_provisioning_server: 0.0740s
maas-integration.TestMAASIntegration.test_create_admin: 0.1146s
maas-integration.TestMAASIntegration.test_cluster_connected: 0.2131s
maas-integration.TestMAASIntegration.test_set_up_dhcp_region: 0.5108s
maas-integration.TestMAASIntegration.test_login_api: 1.3725s
maas-integration.TestMAASIntegration.test_update_maas_url: 2.2357s
maas-integration.TestMAASIntegration.test_import_pxe_files: 938.1843s
----------------------------------------------------------------------
Ran 12 tests in 943.032s

FAILED (SKIP=3, errors=1)
adt-run1: testbed executing test finished with exit status 1
adt-run: & ubtree0t-maas-package-test: ----------------------------------------]
adt-run: & ubtree0t-maas-package-test:  - - - - - - - - - - results - - - - - - - - - -
ubtree0t-maas-package-test FAIL non-zero exit status 1
adt-run1: ** needs_reset, previously=False, requested by run_tests() line 1115
adt-run1: ** needs_reset, previously=True, requested by process_actions() line 2070
adt-run: @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ tests done.
adt-run1: ** stop
adt-run1: ** close, scratch=/tmp/adt-run.Y3AyAH
+ RC=4
+ [ 4 -eq 20 ]
+ [ 0 -eq 1 ]
+ [ -x /home/ubuntu/adt-export-result ]
+ RES=PASS
+ [ 4 -gt 0 ]
+ RES=FAIL
+ /home/ubuntu/adt-export-result -D /root/adt-log maas FAIL
+ chown -R ubuntu /root/adt-log /var/tmp/testresults
+ chmod og+r /var/log/syslog
+ ls /var/crash/
+ [ -n  ]
+ exit 4
Connection to localhost closed.
+ RET=4
+ [ 0 -eq 1 ]
+ [ 4 -gt 0 ]
+ log_failure_msg adt-run exited with status 4.
+ log_msg Failure: adt-run exited with status 4.\n
+ date +%F %X
+ printf 2014-02-01 21:01:00: Failure: adt-run exited with status 4.\n
2014-02-01 21:01:00: Failure: adt-run exited with status 4.
+ [ 0 -eq 0 ]
+ mkdir -p /home/ubuntu/jenkins-jobs/workspace/trusty-adt-maas-daily/results
+ ssh -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -o CheckHostIP=no -i /var/tmp/adt/disks/adtkey -p 54323 -tt -o BatchMode=yes -l ubuntu localhost sudo chown -R ubuntu /root/adt-log; find /root/adt-log -type f -empty | xargs rm 2>/dev/null
Warning: Permanently added '[localhost]:54323' (ECDSA) to the list of known hosts.
find: `/root/adt-log': Permission denied
Connection to localhost closed.
+ true
+ scp -r -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -o CheckHostIP=no -i /var/tmp/adt/disks/adtkey -P 54323 ubuntu@localhost:/root/adt-log/* /var/crash/*crash /var/log/syslog /var/tmp/testresults /home/ubuntu/jenkins-jobs/workspace/trusty-adt-maas-daily/results
+ true
+ log_info_msg Test artifacts copied to /home/ubuntu/jenkins-jobs/workspace/trusty-adt-maas-daily/results
+ log_msg Info: Test artifacts copied to /home/ubuntu/jenkins-jobs/workspace/trusty-adt-maas-daily/results\n
+ date +%F %X
+ printf 2014-02-01 21:01:04: Info: Test artifacts copied to /home/ubuntu/jenkins-jobs/workspace/trusty-adt-maas-daily/results\n
2014-02-01 21:01:04: Info: Test artifacts copied to /home/ubuntu/jenkins-jobs/workspace/trusty-adt-maas-daily/results
+ [ -f /home/ubuntu/jenkins-jobs/workspace/trusty-adt-maas-daily/results/summary.log ]
+ [ -n 2014-02-02_01-36-19 ]
+ ls -tr /home/ubuntu/jenkins-jobs/workspace/trusty-adt-maas-daily/results/*.result
+ tail -1
+ resfile=
+ [ -n  ]
+ log_failure_msg Test didn't end normally. Generating error file
+ log_msg Failure: Test didn't end normally. Generating error file\n
+ date +%F %X
+ printf 2014-02-01 21:01:04: Failure: Test didn't end normally. Generating error file\n
2014-02-01 21:01:04: Failure: Test didn't end normally. Generating error file
+ date +%Y%m%d-%H%M%S
+ errfile=/home/ubuntu/jenkins-jobs/workspace/trusty-adt-maas-daily/results/trusty_amd64_maas_20140201-210104.error
+ echo trusty amd64 maas
+ rsync -a /home/ubuntu/jenkins-jobs/workspace/trusty-adt-maas-daily/results/trusty_amd64_maas_20140201-210104.error /trusty/tmp/
rsync: mkdir "/trusty/tmp" failed: No such file or directory (2)
rsync error: error in file IO (code 11) at main.c(674) [Receiver=3.1.0]
+ true
+ [ 0 -eq 0 ]
+ ssh -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -o CheckHostIP=no -i /var/tmp/adt/disks/adtkey -p 54323 -tt -o BatchMode=yes -l ubuntu localhost sudo poweroff
Warning: Permanently added '[localhost]:54323' (ECDSA) to the list of known hosts.
Connection to localhost closed.
+ exit 4
+ on_exit
+ log_info_msg Cleaning up
+ log_msg Info: Cleaning up\n
+ date +%F %X
+ printf 2014-02-01 21:01:05: Info: Cleaning up\n
2014-02-01 21:01:05: Info: Cleaning up
+ [ -f /var/tmp/adt/disks/run/trusty-amd64-maas-20140201_203653.hv193b.img.pid ]
+ cat /var/tmp/adt/disks/run/trusty-amd64-maas-20140201_203653.hv193b.img.pid
+ kill -9 15454
+ rm -f /var/tmp/adt/disks/run/trusty-amd64-maas-20140201_203653.hv193b.img.pid
+ rm -f /var/tmp/adt/disks/run/trusty-amd64-maas-20140201_203653.hv193b.img
+ rm -f /var/tmp/adt/disks/run/trusty-amd64-maas-20140201_203653.hv193b.img.monitor /var/tmp/adt/disks/run/trusty-amd64-maas-20140201_203653.hv193b.img.serial
+ rm -f /var/lock/adt/ssh.54323.lock
+ rm -f /var/lock/adt/vnc.5911.lock
+ [ -d /tmp/adt-amd64.eUyq3z ]
+ rm -Rf /tmp/adt-amd64.eUyq3z
+ rm -f /var/tmp/adt/disks/run/trusty-amd64-maas-*.img*
+ find /var/lock/adt -name *.lock -mtime +1
+ exit 4
Build step 'Execute shell' marked build as failure
Archiving artifacts
Email was triggered for: Failure
Sending email for trigger: Failure
Follow ups

Jenkins Still Failing - trusty-adt-maas-daily 70
From: Jenkins Notification, 2014-02-03
References

Jenkins Still Failing - trusty-adt-maas-daily 68
From: Jenkins Notification, 2014-02-01