maas-builds team mailing list archive

Thread
Date
Jenkins Still Failing - precise-backport-adt-maas-daily 11

To: maas-builds@xxxxxxxxxxxxxxxxxxx
From: Jenkins Notification <devnull@xxxxxxxxxxxxx>
Date: Sun, 12 Jan 2014 00:39:40 +0000 (UTC)
In-reply-to: <636676188.319.1389403770381.JavaMail.jenkins@tachash>
See http://d-jenkins.ubuntu-ci:8080/job/precise-backport-adt-maas-daily/11/

[...truncated 4484 lines...]
Installing collected packages: nose-timer
  Running setup.py install for nose-timer
    
Successfully installed nose-timer
Cleaning up...
maas-integration.TestMAASIntegration.test_create_admin ... ok
maas-integration.TestMAASIntegration.test_restart_dbus_avahi ... ok
maas-integration.TestMAASIntegration.test_update_maas_url ... ok
maas-integration.TestMAASIntegration.test_restart_provisioning_server ... ok
maas-integration.TestMAASIntegration.test_check_initial_services ... ok
maas-integration.TestMAASIntegration.test_update_pxe_config ... ok
maas-integration.TestMAASIntegration.test_import_pxe_files ... ok
maas-integration.TestMAASIntegration.test_update_preseed_arm ... ok
maas-integration.TestMAASIntegration.test_login_api ... ok
maas-integration.TestMAASIntegration.test_set_http_proxy ... SKIP: Not testing proxy.
maas-integration.TestMAASIntegration.test_cluster_connected ... ok
maas-integration.TestMAASIntegration.test_set_up_dhcp_region ... ok
maas-integration.TestMAASIntegration.test_check_dhcp_service ... ok
maas-integration.TestMAASIntegration.test_set_up_dhcp_cluster ... SKIP: Not testing cluster controller
maas-integration.TestMAASIntegration.test_update_dns_config ... ok
maas-integration.TestMAASIntegration.test_boot_nodes_enlist ... ok
maas-integration.TestMAASIntegration.test_check_nodes_declared ... ERROR
SKIP: Not testing Cluster controller

======================================================================
ERROR: maas-integration.TestMAASIntegration.test_check_nodes_declared
----------------------------------------------------------------------
_StringException: Empty attachments:
  stderr for maas-cli maas ['nodes', 'list']

retcode for maas-cli maas ['nodes', 'list']: {{{0}}}
stdout for maas-cli maas ['nodes', 'list']: {{{
[
    {
        "status": 0, 
        "macaddress_set": [
            {
                "resource_uri": "/MAAS/api/1.0/nodes/node-49f014b2-7b21-11e3-a427-525400123456/macs/00:e0:81:d1:b1:47/", 
                "mac_address": "00:e0:81:d1:b1:47"
            }, 
            {
                "resource_uri": "/MAAS/api/1.0/nodes/node-49f014b2-7b21-11e3-a427-525400123456/macs/00:e0:81:d1:b1:48/", 
                "mac_address": "00:e0:81:d1:b1:48"
            }
        ], 
        "hostname": "kpem3.master", 
        "power_type": "ipmi", 
        "routers": null, 
        "netboot": true, 
        "cpu_count": 0, 
        "storage": 0, 
        "system_id": "node-49f014b2-7b21-11e3-a427-525400123456", 
        "architecture": "amd64/generic", 
        "memory": 0, 
        "owner": null, 
        "tag_names": [], 
        "ip_addresses": [
            "192.168.21.17"
        ], 
        "resource_uri": "/MAAS/api/1.0/nodes/node-49f014b2-7b21-11e3-a427-525400123456/"
    }, 
    {
        "status": 0, 
        "macaddress_set": [
            {
                "resource_uri": "/MAAS/api/1.0/nodes/node-4a129a32-7b21-11e3-8379-525400123456/macs/00:e0:81:dd:d5:99/", 
                "mac_address": "00:e0:81:dd:d5:99"
            }, 
            {
                "resource_uri": "/MAAS/api/1.0/nodes/node-4a129a32-7b21-11e3-8379-525400123456/macs/00:e0:81:dd:d5:9a/", 
                "mac_address": "00:e0:81:dd:d5:9a"
            }
        ], 
        "hostname": "edgjf.master", 
        "power_type": "ipmi", 
        "routers": null, 
        "netboot": true, 
        "cpu_count": 0, 
        "storage": 0, 
        "system_id": "node-4a129a32-7b21-11e3-8379-525400123456", 
        "architecture": "amd64/generic", 
        "memory": 0, 
        "owner": null, 
        "tag_names": [], 
        "ip_addresses": [
            "192.168.21.16"
        ], 
        "resource_uri": "/MAAS/api/1.0/nodes/node-4a129a32-7b21-11e3-8379-525400123456/"
    }, 
    {
        "status": 0, 
        "macaddress_set": [
            {
                "resource_uri": "/MAAS/api/1.0/nodes/node-52686c2a-7b21-11e3-8379-525400123456/macs/00:e0:81:dd:d1:0b/", 
                "mac_address": "00:e0:81:dd:d1:0b"
            }, 
            {
                "resource_uri": "/MAAS/api/1.0/nodes/node-52686c2a-7b21-11e3-8379-525400123456/macs/00:e0:81:dd:d1:0c/", 
                "mac_address": "00:e0:81:dd:d1:0c"
            }
        ], 
        "hostname": "d9aq9.master", 
        "power_type": "ipmi", 
        "routers": null, 
        "netboot": true, 
        "cpu_count": 0, 
        "storage": 0, 
        "system_id": "node-52686c2a-7b21-11e3-8379-525400123456", 
        "architecture": "amd64/generic", 
        "memory": 0, 
        "owner": null, 
        "tag_names": [], 
        "ip_addresses": [
            "192.168.21.18"
        ], 
        "resource_uri": "/MAAS/api/1.0/nodes/node-52686c2a-7b21-11e3-8379-525400123456/"
    }
]
}}}

Traceback (most recent call last):
  File "/tmp/tmp.qoAlvQaA5s/ubtree0-ubtree/debian/tests/utils.py", line 67, in wrapper
    result = func(*args, **kwargs)
  File "/tmp/tmp.qoAlvQaA5s/ubtree0-ubtree/debian/tests/maas-integration.py", line 529, in test_check_nodes_declared
    self._wait_nodes(0)
  File "/tmp/tmp.qoAlvQaA5s/ubtree0-ubtree/debian/tests/maas-integration.py", line 521, in _wait_nodes
    sleep(5)
  File "/tmp/tmp.qoAlvQaA5s/ubtree0-ubtree/debian/tests/utils.py", line 61, in _handle_timeout
    raise TimeoutError(error_message)
TimeoutError: Timer expired


maas-integration.TestMAASIntegration.test_update_pxe_config: 0.0003s
maas-integration.TestMAASIntegration.test_update_preseed_arm: 0.0222s
maas-integration.TestMAASIntegration.test_check_initial_services: 0.0366s
maas-integration.TestMAASIntegration.test_restart_provisioning_server: 0.0481s
maas-integration.TestMAASIntegration.test_create_admin: 0.1484s
maas-integration.TestMAASIntegration.test_restart_dbus_avahi: 0.1789s
maas-integration.TestMAASIntegration.test_cluster_connected: 0.2174s
maas-integration.TestMAASIntegration.test_boot_nodes_enlist: 0.4250s
maas-integration.TestMAASIntegration.test_update_maas_url: 1.1418s
maas-integration.TestMAASIntegration.test_login_api: 1.3598s
maas-integration.TestMAASIntegration.test_update_dns_config: 1.4213s
maas-integration.TestMAASIntegration.test_set_up_dhcp_region: 2.6107s
maas-integration.TestMAASIntegration.test_check_dhcp_service: 5.1619s
maas-integration.TestMAASIntegration.test_check_nodes_declared: 420.0372s
maas-integration.TestMAASIntegration.test_import_pxe_files: 939.8884s
----------------------------------------------------------------------
Ran 17 tests in 1374.110s

FAILED (SKIP=3, errors=1)
adt-run: trace: & ubtree0t-maas-package-test: ----------------------------------------]
adt-run: trace1: ** needs_reset, previously=False
adt-run: trace: @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ tests done.
adt-run: trace: ** stop
adt-run: trace: ** close, scratch=tb-scratch~/tmp/tmp.qoAlvQaA5s:-/|/tmp/tmp.qoAlvQaA5s/!
+ RC=4
+ [ 4 -eq 20 ]
+ [ 0 -eq 1 ]
+ [ -x /home/ubuntu/adt-export-result ]
+ RES=PASS
+ [ 4 -gt 0 ]
+ RES=FAIL
+ /home/ubuntu/adt-export-result -D /root/adt-log maas FAIL
+ chown -R ubuntu /root/adt-log /var/tmp/testresults
+ chmod og+r /var/log/syslog
+ ls /var/crash/
+ [ -n  ]
+ exit 4
Connection to localhost closed.
+ RET=4
+ [ 0 -eq 1 ]
+ [ 4 -gt 0 ]
+ log_failure_msg adt-run exited with status 4.
+ log_msg Failure: adt-run exited with status 4.\n
+ date +%F %X
+ printf 2014-01-11 19:39:26: Failure: adt-run exited with status 4.\n
2014-01-11 19:39:26: Failure: adt-run exited with status 4.
+ [ 0 -eq 0 ]
+ mkdir -p /home/ubuntu/jenkins-jobs/workspace/precise-backport-adt-maas-daily/results
+ ssh -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -o CheckHostIP=no -i /var/tmp/adt/disks/adtkey -p 54323 -tt -o BatchMode=yes -l ubuntu localhost sudo chown -R ubuntu /root/adt-log; find /root/adt-log -type f -empty | xargs rm 2>/dev/null
Warning: Permanently added '[localhost]:54323' (ECDSA) to the list of known hosts.
find: `/root/adt-log': Permission denied
Connection to localhost closed.
+ true
+ scp -r -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -o CheckHostIP=no -i /var/tmp/adt/disks/adtkey -P 54323 ubuntu@localhost:/root/adt-log/* /var/crash/*crash /var/log/syslog /var/tmp/testresults /home/ubuntu/jenkins-jobs/workspace/precise-backport-adt-maas-daily/results
+ true
+ log_info_msg Test artifacts copied to /home/ubuntu/jenkins-jobs/workspace/precise-backport-adt-maas-daily/results
+ log_msg Info: Test artifacts copied to /home/ubuntu/jenkins-jobs/workspace/precise-backport-adt-maas-daily/results\n
+ date +%F %X
+ printf 2014-01-11 19:39:31: Info: Test artifacts copied to /home/ubuntu/jenkins-jobs/workspace/precise-backport-adt-maas-daily/results\n
2014-01-11 19:39:31: Info: Test artifacts copied to /home/ubuntu/jenkins-jobs/workspace/precise-backport-adt-maas-daily/results
+ [ -f /home/ubuntu/jenkins-jobs/workspace/precise-backport-adt-maas-daily/results/summary.log ]
+ [ -n 2014-01-12_00-11-02 ]
+ ls -tr /home/ubuntu/jenkins-jobs/workspace/precise-backport-adt-maas-daily/results/*.result
+ tail -1
+ resfile=
+ [ -n  ]
+ log_failure_msg Test didn't end normally. Generating error file
+ log_msg Failure: Test didn't end normally. Generating error file\n
+ date +%F %X
+ printf 2014-01-11 19:39:31: Failure: Test didn't end normally. Generating error file\n
2014-01-11 19:39:31: Failure: Test didn't end normally. Generating error file
+ date +%Y%m%d-%H%M%S
+ errfile=/home/ubuntu/jenkins-jobs/workspace/precise-backport-adt-maas-daily/results/precise_amd64_maas_20140111-193931.error
+ echo precise amd64 maas
+ rsync -a /home/ubuntu/jenkins-jobs/workspace/precise-backport-adt-maas-daily/results/precise_amd64_maas_20140111-193931.error /precise/tmp/
rsync: mkdir "/precise/tmp" failed: No such file or directory (2)
rsync error: error in file IO (code 11) at main.c(674) [Receiver=3.1.0]
+ true
+ [ 0 -eq 0 ]
+ ssh -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -o CheckHostIP=no -i /var/tmp/adt/disks/adtkey -p 54323 -tt -o BatchMode=yes -l ubuntu localhost sudo poweroff
Warning: Permanently added '[localhost]:54323' (ECDSA) to the list of known hosts.


Broadcast message from ubuntu@autopkgtest

	(/dev/pts/0) at 19:39 ...




The system is going down for power off NOW!

Connection to localhost closed.
+ exit 4
+ on_exit
+ log_info_msg Cleaning up
+ log_msg Info: Cleaning up\n
+ date +%F %X
+ printf 2014-01-11 19:39:31: Info: Cleaning up\n
2014-01-11 19:39:31: Info: Cleaning up
+ [ -f /var/tmp/adt/disks/run/precise-amd64-maas-20140111_191135.DFU1hn.img.pid ]
+ cat /var/tmp/adt/disks/run/precise-amd64-maas-20140111_191135.DFU1hn.img.pid
+ kill -9 16813
+ rm -f /var/tmp/adt/disks/run/precise-amd64-maas-20140111_191135.DFU1hn.img.pid
+ rm -f /var/tmp/adt/disks/run/precise-amd64-maas-20140111_191135.DFU1hn.img
+ rm -f /var/tmp/adt/disks/run/precise-amd64-maas-20140111_191135.DFU1hn.img.monitor /var/tmp/adt/disks/run/precise-amd64-maas-20140111_191135.DFU1hn.img.serial
+ rm -f /var/lock/adt/ssh.54323.lock
+ rm -f /var/lock/adt/vnc.5911.lock
+ [ -d /tmp/adt-amd64.f7ELyN ]
+ rm -Rf /tmp/adt-amd64.f7ELyN
+ rm -f /var/tmp/adt/disks/run/precise-amd64-maas-*.img*
+ find /var/lock/adt -name *.lock -mtime +1
+ exit 4
Build step 'Execute shell' marked build as failure
Archiving artifacts
Email was triggered for: Failure
Sending email for trigger: Failure
Follow ups

Jenkins Still Failing - precise-backport-adt-maas-daily 12
From: Jenkins Notification, 2014-01-13
References

Jenkins Still Failing - precise-backport-adt-maas-daily 10
From: Jenkins Notification, 2014-01-11