openstack team mailing list archive

[Benoit ML <ben42ml@xxxxxxxxx>]

Hello,

(plz ignore my previous mail)

I'm sorry because I probabably misunderstand something.
I have :
- configured cinder like the file you show (thank you again)  (apport
the nfs_mount_point_base = /etc/cinder/volumes and volumes_dir =
/etc/cinder/volumes )
- mounted the nfs share in /etc/cinder/volumes
- echo '/etc/cinder/volumes' > /var/lib/cinder/nfsshare && chown
cinder /var/lib/cinder/nfsshare

And when I try to create a volume, it doesn't work. The volume is in
"error" state and in the log  (with debug/verbose activated) :
- cinder try to create a lv  : why create a lv ? not create a file on the nfs ?
- cinder try to "stat" a directory inside the nfs_share but failed
because it doesn't existe (of course does not create it before)

==============================================================
2013-01-15 11:32:08 29896 DEBUG cinder.openstack.common.rpc.amqp [-]
received {u'_context_roles': [u'KeystoneAdmin', u'admin',
u'KeystoneServiceAdmin'], u'_context_request_id':
u'req-0ed3bc1e-d5a1-43c6-8b88-3401734695ca', u'_context_quota_class':
None, u'args': {u'image_id': None, u'snapshot_id': None, u'volume_id':
u'014cd61e-14a2-4aa5-b9f6-a3d80c44f302'}, u'_context_auth_token':
'<SANITIZED>', u'_context_is_admin': True, u'_context_project_id':
u'295b7cf015664e02ab54eb56eb95ee0c', u'_context_timestamp':
u'2013-01-15T10:32:08.523949', u'_context_read_deleted': u'no',
u'_context_user_id': u'108305fe03e24aa98626344b0f47e3a3', u'method':
u'create_volume', u'_context_remote_address': u'192.168.11.101'}
_safe_log /usr/lib/python2.6/site-packages/cinder/openstack/common/rpc/common.py:195
2013-01-15 11:32:08 29896 DEBUG cinder.openstack.common.rpc.amqp [-]
unpacked context: {'user_id': u'108305fe03e24aa98626344b0f47e3a3',
'roles': [u'KeystoneAdmin', u'admin', u'KeystoneServiceAdmin'],
'timestamp': u'2013-01-15T10:32:08.523949', 'auth_token':
'<SANITIZED>', 'remote_address': u'192.168.11.101', 'quota_class':
None, 'is_admin': True, 'request_id':
u'req-0ed3bc1e-d5a1-43c6-8b88-3401734695ca', 'project_id':
u'295b7cf015664e02ab54eb56eb95ee0c', 'read_deleted': u'no'} _safe_log
/usr/lib/python2.6/site-packages/cinder/openstack/common/rpc/common.py:195
2013-01-15 11:32:08 INFO cinder.volume.manager
[req-0ed3bc1e-d5a1-43c6-8b88-3401734695ca
108305fe03e24aa98626344b0f47e3a3 295b7cf015664e02ab54eb56eb95ee0c]
volume volume-014cd61e-14a2-4aa5-b9f6-a3d80c44f302: creating
2013-01-15 11:32:08 DEBUG cinder.volume.manager
[req-0ed3bc1e-d5a1-43c6-8b88-3401734695ca
108305fe03e24aa98626344b0f47e3a3 295b7cf015664e02ab54eb56eb95ee0c]
volume volume-014cd61e-14a2-4aa5-b9f6-a3d80c44f302: creating lv of
size 10G create_volume
/usr/lib/python2.6/site-packages/cinder/volume/manager.py:133
2013-01-15 11:32:08 DEBUG cinder.utils
[req-0ed3bc1e-d5a1-43c6-8b88-3401734695ca
108305fe03e24aa98626344b0f47e3a3 295b7cf015664e02ab54eb56eb95ee0c]
Running cmd (subprocess): sudo cinder-rootwrap
/etc/cinder/rootwrap.conf stat /etc/cinder/volumes/6614325979630346338
execute /usr/lib/python2.6/site-packages/cinder/utils.py:163
2013-01-15 11:32:08 DEBUG cinder.utils
[req-0ed3bc1e-d5a1-43c6-8b88-3401734695ca
108305fe03e24aa98626344b0f47e3a3 295b7cf015664e02ab54eb56eb95ee0c]
Result was 1 execute
/usr/lib/python2.6/site-packages/cinder/utils.py:180
2013-01-15 11:32:08 WARNING cinder.volume.driver
[req-0ed3bc1e-d5a1-43c6-8b88-3401734695ca
108305fe03e24aa98626344b0f47e3a3 295b7cf015664e02ab54eb56eb95ee0c]
Exception during mounting Unexpected error while running command.
Command: sudo cinder-rootwrap /etc/cinder/rootwrap.conf stat
/etc/cinder/volumes/6614325979630346338
Exit code: 1
Stdout: ''
Stderr: "/usr/bin/stat: impossible d'\xc3\xa9valuer
\xc2\xab\xc2\xa0/etc/cinder/volumes/6614325979630346338\xc2\xa0\xc2\xbb:
Aucun fichier ou dossier de ce type\n"
2013-01-15 11:32:08 DEBUG cinder.volume.driver
[req-0ed3bc1e-d5a1-43c6-8b88-3401734695ca
108305fe03e24aa98626344b0f47e3a3 295b7cf015664e02ab54eb56eb95ee0c]
Available shares [] _ensure_shares_mounted
/usr/lib/python2.6/site-packages/cinder/volume/nfs.py:200
2013-01-15 11:32:09 29896 ERROR cinder.openstack.common.rpc.amqp [-]
Exception during message handling
2013-01-15 11:32:09 29896 TRACE cinder.openstack.common.rpc.amqp
Traceback (most recent call last):
2013-01-15 11:32:09 29896 TRACE cinder.openstack.common.rpc.amqp
File "/usr/lib/python2.6/site-packages/cinder/openstack/common/rpc/amqp.py",
line 276, in _process_data
2013-01-15 11:32:09 29896 TRACE cinder.openstack.common.rpc.amqp
rval = self.proxy.dispatch(ctxt, version, method, **args)
2013-01-15 11:32:09 29896 TRACE cinder.openstack.common.rpc.amqp
File "/usr/lib/python2.6/site-packages/cinder/openstack/common/rpc/dispatcher.py",
line 145, in dispatch
2013-01-15 11:32:09 29896 TRACE cinder.openstack.common.rpc.amqp
return getattr(proxyobj, method)(ctxt, **kwargs)
2013-01-15 11:32:09 29896 TRACE cinder.openstack.common.rpc.amqp
File "/usr/lib/python2.6/site-packages/cinder/volume/manager.py", line
163, in create_volume
2013-01-15 11:32:09 29896 TRACE cinder.openstack.common.rpc.amqp
volume_ref['id'], {'status': 'error'})
2013-01-15 11:32:09 29896 TRACE cinder.openstack.common.rpc.amqp
File "/usr/lib64/python2.6/contextlib.py", line 23, in __exit__
2013-01-15 11:32:09 29896 TRACE cinder.openstack.common.rpc.amqp
self.gen.next()
2013-01-15 11:32:09 29896 TRACE cinder.openstack.common.rpc.amqp
File "/usr/lib/python2.6/site-packages/cinder/volume/manager.py", line
135, in create_volume
2013-01-15 11:32:09 29896 TRACE cinder.openstack.common.rpc.amqp
model_update = self.driver.create_volume(volume_ref)
2013-01-15 11:32:09 29896 TRACE cinder.openstack.common.rpc.amqp
File "/usr/lib/python2.6/site-packages/cinder/volume/nfs.py", line 84,
in create_volume
2013-01-15 11:32:09 29896 TRACE cinder.openstack.common.rpc.amqp
volume['provider_location'] = self._find_share(volume['size'])
2013-01-15 11:32:09 29896 TRACE cinder.openstack.common.rpc.amqp
File "/usr/lib/python2.6/site-packages/cinder/volume/nfs.py", line
220, in _find_share
2013-01-15 11:32:09 29896 TRACE cinder.openstack.common.rpc.amqp
raise exception.NfsNoSharesMounted()
2013-01-15 11:32:09 29896 TRACE cinder.openstack.common.rpc.amqp
NfsNoSharesMounted: No mounted NFS shares found
2013-01-15 11:32:09 29896 TRACE cinder.openstack.common.rpc.amqp
2013-01-15 11:32:40 29896 DEBUG cinder.manager [-] Running periodic
task VolumeManager._publish_service_capabilities periodic_tasks
/usr/lib/python2.6/site-packages/cinder/manager.py:164
2013-01-15 11:32:40 29896 DEBUG cinder.manager [-] Running periodic
task VolumeManager._report_driver_status periodic_tasks
/usr/lib/python2.6/site-packages/cinder/manager.py:164
2013-01-15 11:33:40 29896 DEBUG cinder.manager [-] Running periodic
task VolumeManager._publish_service_capabilities periodic_tasks
/usr/lib/python2.6/site-packages/cinder/manager.py:164
2013-01-15 11:33:40 29896 DEBUG cinder.manager [-] Running periodic
task VolumeManager._report_driver_status periodic_tasks
/usr/lib/python2.6/site-packages/cinder/manager.py:164
2013-01-15 11:34:40 29896 DEBUG cinder.manager [-] Running periodic
task VolumeManager._publish_service_capabilities periodic_tasks
/usr/lib/python2.6/site-packages/cinder/manager.py:164
2013-01-15 11:34:40 29896 DEBUG cinder.manager [-] Running periodic
task VolumeManager._report_driver_status periodic_tasks
/usr/lib/python2.6/site-packages/cinder/manager.py:164
2013-01-15 11:35:40 29896 DEBUG cinder.manager [-] Running periodic
task VolumeManager._publish_service_capabilities periodic_tasks
/usr/lib/python2.6/site-packages/cinder/manager.py:164
2013-01-15 11:35:40 29896 DEBUG cinder.manager [-] Running periodic
task VolumeManager._report_driver_status periodic_tasks
/usr/lib/python2.6/site-packages/cinder/manager.py:164
2013-01-15 11:36:40 29896 DEBUG cinder.manager [-] Running periodic
task VolumeManager._publish_service_capabilities periodic_tasks
/usr/lib/python2.6/site-packages/cinder/manager.py:164
2013-01-15 11:36:40 29896 DEBUG cinder.manager [-] Running periodic
task VolumeManager._report_driver_status periodic_tasks
/usr/lib/python2.6/site-packages/cinder/manager.py:164
==============================================================

Any  help will be greatly appreciate !

2013/1/14 Benoit ML <ben42ml@xxxxxxxxx>:
> Hello,
>
> Thank you for your configuration, it will help me a lot.
>
> One last question : what is the data in the file of
> "nfs_shares_config" : /var/lib/cinder/nfsshare  plz ?
>
> Thx in advance
>
> 2013/1/14 Ray Sun <qsun01185@xxxxxxxxxxxxx>:
>> Here's my configuration for cinder using NFS, also I submit bug for creating
>> volume snapshot and volume from snapshot here, I already fixed it in my
>> local, not submit yet:
>> https://bugs.launchpad.net/cinder/+bug/1097266
>>
>> /etc/cinder/cinder.conf
>> [DEFAULT]
>> rootwrap_config=/etc/cinder/rootwrap.conf
>> sql_connection =
>> mysql://cinder:cinder-administrator@xxxxxxxxxxxxxxxxxxxxxxxx/cinder
>> api_paste_confg = /etc/cinder/api-paste.ini
>> iscsi_helper=ietadm
>> volume_name_template = volume-%s
>> volume_group = vg_cinder
>> #volume_group = cinder-volumes
>> verbose = True
>> auth_strategy = keystone
>> #osapi_volume_listen_port=5900
>> volumes_dir=/var/lib/cinder/volumes/
>> rabbit_host=controller.cienet.com.cn
>> volume_driver=cinder.volume.nfs.NfsDriver
>> ######## defined in cinder.volume.drivers.nfs ########
>> nfs_shares_config=/var/lib/cinder/nfsshare
>> nfs_mount_point_base=/var/lib/cinder/volumes
>> nfs_disk_util=df
>> nfs_sparsed_volumes=true
>>
>> /etc/cinder/rootwrap.d/volume.filters add
>> # cinder/volume/nfs.py
>> stat: CommandFilter, /usr/bin/stat, root
>> mount: CommandFilter, /bin/mount, root
>> df: CommandFilter, /bin/df, root
>> truncate: CommandFilter, /usr/bin/truncate, root
>> chmod: CommandFilter, /bin/chmod, root
>> rm: CommandFilter, /bin/rm, root
>>
>> /etc/nova/nova.conf add
>> # for cinder use volume as nfs
>> libvirt_volume_drivers="iscsi=nova.virt.libvirt.volume.LibvirtISCSIVolumeDriver,local=nova.virt.libvirt.volume.LibvirtVolumeDriver,fake=nova.virt.libvirt.volume.LibvirtFakeVolumeDriver,rbd=nova.virt.libvirt.volume.LibvirtNetVolumeDriver,sheepdog=nova.virt.libvirt.volume.LibvirtNetVolumeDriver,nfs=nova.virt.libvirt.volume_nfs.NfsVolumeDriver"
>>
>> - Ray
>> Yours faithfully, Kind regards.
>>
>> CIeNET Technologies (Beijing) Co., Ltd
>> Email: qsun01185@xxxxxxxxxxxxx
>> Office Phone: +86-01081470088-7079
>> Mobile Phone: +86-13581988291
>>
>>
>> On Mon, Jan 14, 2013 at 10:22 PM, Benoit ML <ben42ml@xxxxxxxxx> wrote:
>>>
>>> Hello,
>>>
>>> I've installed openstack Folsom on centos with the epel repo.
>>> Basically the all things works on 4 nodes configuration(controller,
>>> network and 2 compute). Quantum is configured with GRE and L3
>>> services.
>>>
>>> At my point, i'd like to go futher on the storage part.
>>>
>>> I'm trying to use the cinder NFS driver to manage volume.  From what I
>>> read, the driver is basic : créate/delete volume on an NFS share.
>>> Well but I didn't manage to get it work ...  can you help me please ?
>>> what I must do ?
>>>
>>> When I look into the cinder/volume.log, I see that cinder first create
>>> a LV, and  try to stat </nfsPath/><bigUUID>  and fail. Why cinder try
>>> to créate a LV ? and try to access a directory on the nfs share thaht
>>> is not create before ?
>>>
>>>
>>> Moreover if you have any advice for a "good" basic shared storage
>>> architecture with Openstack, plz shared the information ;)
>>>
>>> In cinder.conf :
>>> -----------------------------------------------------------------
>>> volume_driver=cinder.volume.nfs.NfsDriver
>>> state_path = /var/lib/cinder
>>> nfs_shares_config=/etc/cinder/shares.conf
>>> nfs_mount_point_base = /mnt/exports/volumes/
>>> #nfs_sparsed_volumes = True
>>> #nfs_disk_util = df
>>> lock_path = /var/lib/cinder/tmp
>>> -----------------------------------------------------------------
>>>
>>>
>>> Thank you in advance.
>>>
>>> Regards,
>>>
>>> --
>>> --
>>> Benoit
>>>
>>> _______________________________________________
>>> Mailing list: https://launchpad.net/~openstack
>>> Post to     : openstack@xxxxxxxxxxxxxxxxxxx
>>> Unsubscribe : https://launchpad.net/~openstack
>>> More help   : https://help.launchpad.net/ListHelp
>>
>>
>
>
>
> --
> --
> Benoit



-- 
--
Benoit