openstack team mailing list archive

[Vishvananda Ishaya <vishvananda@xxxxxxxxx>]

Not sure.  Is it possible that the user you are running nova as doesn't have access to tmp? Or that you don't have enough space to untar the image properly?  You would think that the untar command would fail in this case, but I can't see how else it would fail to find the file.  Maybe make sure that the img is actually in the tar.  The image is being downloaded from objectstore, decrypted, untarred, and then uploaded to glance.

Vish

On Aug 15, 2011, at 5:32 PM, Joshua Harlow wrote:

> Ok so what I’m seeing so far after this is:
> 
> 2011-08-15 17:27:06,571 ERROR nova.image.s3 [-] Failed to upload bbb43/ttylinux-uec-i386-11.2_2.6.35-16_1.img.manifest.xml to /tmp/tmp8Y5q5T
> (nova.image.s3): TRACE: Traceback (most recent call last):
> (nova.image.s3): TRACE:   File "/home/ctoteam/nova/nova/image/s3.py", line 263, in delayed_create
> (nova.image.s3): TRACE:     with open(unz_filename) as image_file:
> (nova.image.s3): TRACE: IOError: [Errno 2] No such file or directory: '/tmp/tmp8Y5q5T/ttylinux-uec-i386-11.2_2.6.35-16_1.img'
> (nova.image.s3): TRACE: 
> 
> (Afterwards)
> $ dpkg -l | grep cloud
> ii  cloud-utils                          0.21ubuntu1                      cloud image management utilities
> $ sudo ls -lah /tmp/tmp8Y5q5T/ttylinux-uec-i386-11.2_2.6.35-16_1.img
> lrwxrwxrwx 1 ctoteam ctoteam 70 Aug 15 17:27 /tmp/tmp8Y5q5T/ttylinux-uec-i386-11.2_2.6.35-16_1.img -> /tmp/uec-publish-tarball.IziQIP/ttylinux-uec-i386-11.2_2.6.35-16_1.img
> $ sudo ls -lah /tmp/uec-publish-tarball.IziQIP/ttylinux-uec-i386-11.2_2.6.35-16_1.img
> ls: cannot access /tmp/uec-publish-tarball.IziQIP/ttylinux-uec-i386-11.2_2.6.35-16_1.img: No such file or directory
> 
> Would this be a uec-publish-tarball bug? Or would it be nova deleting it to early?
> It seems like the ramdisk and the kernel get uploaded fine, but not the machine image?
> 
> ---
> IMAGE    ami-0000000c    bbb43/ttylinux-uec-i386-11.2_2.6.35-16_1.img.manifest.xml        failed_upload    private        i386    machine    ari-0000000b    aki-0000000a
> IMAGE    ari-0000000b    bbb43/ttylinux-uec-i386-11.2_2.6.35-16_1-initrd.manifest.xml        available    private        i386    ramdisk        
> IMAGE    aki-0000000a    bbb43/ttylinux-uec-i386-11.2_2.6.35-16_1-vmlinuz.manifest.xml        available    private        i386    kernel
> 
> On 8/15/11 4:45 PM, "Joshua Harlow" <harlowja@xxxxxxxxxxxxx> wrote:
> 
> Ok,
> 
> Took that modified s3.py file and used it. This is what I get:
> 
> 2011-08-15 16:43:30,086 ERROR nova.image.s3 [-] Failed to upload ttbb2/ttylinux-uec-i386-11.2_2.6.35-16_1.img.manifest.xml to /tmp/tmp7jXqlf
> Traceback (most recent call last):
>   File "/usr/lib/python2.6/dist-packages/eventlet/hubs/poll.py", line 97, in wait
>     readers.get(fileno, noop).cb(fileno)
>   File "/home/ctoteam/nova/nova/image/s3.py", line 271, in delayed_create
>     raise
> TypeError: exceptions must be old-style classes or derived from BaseException, not NoneType
> 
> Still not very helpful :-/
> Any ideas?
> 
> On 8/15/11 4:31 PM, "Vishvananda Ishaya" <vishvananda@xxxxxxxxx> wrote:
> 
> The underlying exception is getting eaten, so it is hard to say what the underlying exception was.  I just pushed a branch here which should allow you to see the underlying exception that caused the failed upload:
> 
> https://code.launchpad.net/~vishvananda/nova/lp827024
> 
>  <https://code.launchpad.net/~vishvananda/nova/lp827024> If you run that branch you should get a useful exception in your logs.
> 
> Vish
> 
> On Aug 15, 2011, at 2:41 PM, Joshua Harlow wrote:
> 
> Hi all,
> 
> I am using debian 6 (wheezy)  + nova-diablo-3 + glance (from git) and have installed the needed python pkgs and have the correct servers and such running.
> 
> I am seeing the following error when running the following:
> 
> #uec-publish-tarball  ttylinux-uec-i386-11.2_2.6.35-16_1.tar.gz  ttbb i386
> 
> 2011-08-15 14:36:10,385 DEBUG nova.utils [-] Running cmd (subprocess): openssl enc -d -aes-128-cbc -in /tmp/tmpIHkMkG/image.encrypted -K 57fbea5c3e106e0e6aec2d89ef5171ea -iv 77f27e730c319a341782b091b97216a5 -out /tmp/tmpIHkMkG/image.tar.gz from (pid=16720) execute /home/ctoteam/nova/nova/utils.py:143Traceback (most recent call last):  File "/usr/lib/python2.6/logging/__init__.py", line 776, in emit    msg = self.format(record)  File "/usr/lib/python2.6/logging/__init__.py", line 654, in format
>     return fmt.format(record)  File "/home/ctoteam/nova/nova/log.py", line 214, in format
>     return logging.Formatter.format(self, record)
>   File "/usr/lib/python2.6/logging/__init__.py", line 436, in format
>     record.message = record.getMessage()
>   File "/usr/lib/python2.6/logging/__init__.py", line 306, in getMessage
>     msg = msg % self.args
> KeyError: u'image_location'
> Traceback (most recent call last):
>   File "/usr/lib/python2.6/dist-packages/eventlet/hubs/poll.py", line 97, in wait
>     readers.get(fileno, noop).cb(fileno)
>   File "/home/ctoteam/nova/nova/image/s3.py", line 267, in delayed_create
>     raise
> TypeError: exceptions must be old-style classes or derived from BaseException, not NoneType
> Removing descriptor: 6
> 
> This then causes the following ( failed_upload  ):
> 
> #euca-describe-images
> IMAGE    ami-00000003    ttbb/ttylinux-uec-i386-11.2_2.6.35-16_1.img.manifest.xml        failed_upload    private        i386    machine    ari-00000002    aki-00000001
> IMAGE    ari-00000002    ttbb/ttylinux-uec-i386-11.2_2.6.35-16_1-initrd.manifest.xml        available    private        i386    ramdisk        
> IMAGE    aki-00000001    ttbb/ttylinux-uec-i386-11.2_2.6.35-16_1-vmlinuz.manifest.xml        available    private        i386    kernel    
> 
> Has anyone else seen this?
> Is this due to the eventlet version?
> 
> $ dpkg -l | grep eventlet
> ii  python-eventlet                      0.9.16-1                         concurrent networking library for Python
> 
> Not sure why the poll method would be dying or why there would be a keyerror also?
> 
> $ python --version
> Python 2.6.7
> 
> _______________________________________________
> Mailing list: https://launchpad.net/~openstack
> Post to     : openstack@xxxxxxxxxxxxxxxxxxx
> Unsubscribe : https://launchpad.net/~openstack
> More help   : https://help.launchpad.net/ListHelp
> 
>