nova team mailing list archive
-
nova team
-
Mailing list archive
-
Message #00083
Re: Twisted or Eventlet?
All,
I propose that we go ahead and decide to use Eventlet. We've all had a
chance to talk, the decision isn't going to make itself, and it seems like
we're coalescing around Eventlet:
- In a long discussion about how to keep our code loosely coupled and
easy to maintain (see Architecture For Shared Components on the openstack
list), we concluded that WSGI would be a great solution, and eday has
prototyped an Eventlet-powered WSGI app talking AMQP to Rabbit. The Twisted
WSGI approach apparently isn't stable or standard, but WSGI works just as
you'd expect in Eventlet.
- As hazmat points out in the "twisted v. eventlet" thread, you can't use
pdb with Twisted, while pdb works just as you'd hope in Eventlet.
- hazmat's experience during his lightning talk (see the same thread) is
a good datapoint verifying that people unfamiliar with either project will
probably prefer to work with Eventlet over Twisted: good for recruiting.
- It's a weaker argument, but it's really hard to find any comparisons
between Twisted and Eventlet on the web that say Twisted is preferable (has
anyone found any?)
And as always, there's the argument that Eventlet code is easier to read and
understand, and therefore to maintain.
I'm going to be working on adding the RS API to Nova, and I'm going to
proceed in Eventlet. If anyone feels strongly that we must use Twisted
instead, speak up; otherwise, shall we call this decision made?
trying-to-build-consensus-ly yrs,
Michael
On Tue, Aug 3, 2010 at 8:13 AM, Soren Hansen <soren.hansen@xxxxxxxxxxxxx>wrote:
> On Mon, Aug 02, 2010 at 05:21:23PM -0500, Eric Day wrote:
> > I took a closer look at the inner workings of how Twisted is currently
> > being used, and I think there is still a good chunk of work to be done
> > to make things work properly. For example, both Redis and AMQP modules
> > are not using the Twisted I/O event loop. Both are still issuing sync
> > socket calls in their own libs which could block the entire
> > application.
>
> Yup, this definitely needs fixing.
>
> > These things are very doable in Twisted, it will just require using
> > the txRedis and txAMQP modules. It will also introduce more deferreds
> > into the mix since we'll have non-blocking connections dependent on
> > each other. From this perspective, Eventlet may be easier since we
> > could still use the current libraries by patching
> > (http://eventlet.net/doc/patching.html).
>
> Yes, both python-redis and python-amqplib use Python's standard socket
> module, so they can be patched.
>
> Does anyone know how eventlet would deal with libvirt calls?
> python-libvirt just calls into libvirt obviously doesn't use Python's
> socket module.
>
> --
> Soren Hansen
> Systems Architect
> The Rackspace Cloud
>
> _______________________________________________
> Mailing list: https://launchpad.net/~nova
> Post to : nova@xxxxxxxxxxxxxxxxxxx
> Unsubscribe : https://launchpad.net/~nova
> More help : https://help.launchpad.net/ListHelp
>
Confidentiality Notice: This e-mail message (including any attached or
embedded documents) is intended for the exclusive and confidential use of the
individual or entity to which this message is addressed, and unless otherwise
expressly indicated, is confidential and privileged information of Rackspace.
Any dissemination, distribution or copying of the enclosed material is prohibited.
If you receive this transmission in error, please notify us immediately by e-mail
at abuse@xxxxxxxxxxxxx, and delete the original message.
Your cooperation is appreciated.
Follow ups
References
-
Twisted or Eventlet?
From: Eric Day, 2010-07-29
-
Re: Twisted or Eventlet?
From: Ed Leafe, 2010-07-29
-
Re: Twisted or Eventlet?
From: Michael Gundlach, 2010-07-29
-
Re: Twisted or Eventlet?
From: Soren Hansen, 2010-07-29
-
Re: Twisted or Eventlet?
From: Michael Gundlach, 2010-07-30
-
Re: Twisted or Eventlet?
From: Jay Pipes, 2010-07-30
-
Re: Twisted or Eventlet?
From: Eric Day, 2010-07-30
-
Re: Twisted or Eventlet?
From: Vishvananda Ishaya, 2010-07-30
-
Re: Twisted or Eventlet?
From: Eric Day, 2010-08-02
-
Re: Twisted or Eventlet?
From: Soren Hansen, 2010-08-03