openstack team mailing list archive
-
openstack team
-
Mailing list archive
-
Message #11328
problems mounting volumes - crashes compute node
Hi all,
I’ve run into some unpredictable behavior attaching volumes to instances,
I can mount volumes sometimes, whilst other times status remains
“attaching” and my compute node dies. Anyone run into this issue?
Environment:
nova01 – cloud controller (compute disabled)
- Ubuntu 12.04 (latest packages) 64bit
· - All-in-one OpenStack installation
· - tgt ISCSI
· - nova-volume – 3.6TB free
· - nova.conf can be found: http://paste.openstack.org/show/16022/
nova03 - compute node
· - Ubuntu 12.04 (latest packages) 64bit
· - nova-api, nova-network, nova-compute
· - tgt ISCSI
· nova.conf can be found here http://paste.openstack.org/show/16021/
Steps:
nova volume-list
+----+--------+--------------+------+-------------+-------------+
| ID | Status | Display Name | Size | Volume Type | Attached to |
+----+--------+--------------+------+-------------+-------------+
+----+--------+--------------+------+-------------+-------------+
nova volume-create --display_name "ext_vol01" 1
nova volume-list
+----+-----------+--------------+------+-------------+-------------+
| ID | Status | Display Name | Size | Volume Type | Attached to |
+----+-----------+--------------+------+-------------+-------------+
| 37 | available | ext_vol01 | 1 | None | |
+----+-----------+--------------+------+-------------+-------------+
nova volume-attach 5d91ed13-f88f-4ff0-aca4-f1cd3910256f 37 /dev/vdf
nova volume-list
+----+-----------+--------------+------+-------------+-------------+
| ID | Status | Display Name | Size | Volume Type | Attached to |
+----+-----------+--------------+------+-------------+-------------+
| 37 | attaching | ext_vol01 | 1 | None | |
+----+-----------+--------------+------+-------------+-------------+
At this point the volume status remains “attaching” and the nova03 compute
node has crashed.
nova-compute nova03 nova
enabled XXX 2012-05-07 19:53:30
nova01 nova-volume.log http://paste.openstack.org/show/16016/
nova03 nova-compute.log attached here http://paste.openstack.org/show/16023/
iscsi log:
May 7 16:53:32 nova03 kernel: [174620.293534] scsi14 : iSCSI Initiator
over TCP/IP
May 7 16:53:32 nova03 kernel: [174620.550104] scsi 14:0:0:0: RAID
IET Controller 0001 PQ: 0 ANSI: 5
May 7 16:53:32 nova03 kernel: [174620.550404] scsi 14:0:0:0: Attached scsi
generic sg3 type 12
May 7 16:53:32 nova03 kernel: [174620.551557] scsi 14:0:0:1: Direct-Access
IET VIRTUAL-DISK 0001 PQ: 0 ANSI: 5
May 7 16:53:32 nova03 kernel: [174620.551838] sd 14:0:0:1: Attached scsi
generic sg4 type 0
May 7 16:53:32 nova03 kernel: [174620.552938] sd 14:0:0:1: [sdc] 2097152
512-byte logical blocks: (1.07 GB/1.00 GiB)
May 7 16:53:32 nova03 kernel: [174620.553670] sd 14:0:0:1: [sdc] Write
Protect is off
May 7 16:53:32 nova03 kernel: [174620.553674] sd 14:0:0:1: [sdc] Mode
Sense: 49 00 00 08
May 7 16:53:32 nova03 kernel: [174620.554226] sd 14:0:0:1: [sdc] Write
cache: enabled, read cache: enabled, doesn't support DPO or FUA
May 7 16:53:32 nova03 kernel: [174620.573890] sdc: unknown partition table
May 7 16:53:32 nova03 kernel: [174620.576741] sd 14:0:0:1: [sdc] Attached
SCSI disk
May 7 16:53:33 nova03 iscsid: connection6:0 is operational now
iscsiadm -m session -P 1
Target: iqn.2010-10.org.openstack:volume-00000025
Current Portal: XXX.XXX.XXX.XXX:3260,1
Persistent Portal: XXX.XXX.XXX.XX:3260,1
**********
Interface:
**********
Iface Name: default
Iface Transport: tcp
Iface Initiatorname:
iqn.1993-08.org.debian:01:60b3be5e19c
Iface IPaddress: 200.143.189.12
Iface HWaddress: (null)
Iface Netdev: (null)
SID: 6
iSCSI Connection State: LOGGED IN
iSCSI Session State: LOGGED_IN
Internal iscsid Session State: NO CHANGE
Cheers,
--
_rob
Follow ups
