← Back to team overview

c2c-oerpscenario team mailing list archive

Re: [Bug 617905] Re: Product Import fails

 

Kyle, Peter,

I believe those are essentially Magento API issues: indeed, Magento API is
quite stupid, there is nothing like an OpenERP "search" that answer you only
a list of matching ids, upon which you could eventually do a "read" to get
the detail, hence doing things by bits. Instead of "search", Magento does a
kind of "read" and already answer all the "flat" details of a collection you
are searching matching records. If lots of records matches, then you are
fucked cause it will indeed kill your memory indeed. And this is often
stupid, cause for things like importing sale orders, flat details of order
isn't enough, you need of course the order lines, so while you already
killed your server getting the flat details of all new orders, you then then
need to do a read upon each of them...

We could eventually work around every Magento API corner, but that would be
time consuming, make our own code crappy. I feel it's better you bother
Magento guys to put real software architects on their API and re-do/extend
it properly. I think it's important for Magento, if they continue to neglect
software quality, they will just be killed by clean softwares such as
Spreecommerce in the future.
If you have news for Magento to this respect, please use the mailing list
and let us know.

Regards.

Raphaël Valyi


On Tue, Nov 9, 2010 at 8:18 AM, Peter Glock
<617905@xxxxxxxxxxxxxxxxxx>wrote:

> I agree with Kyle's comments. I'm running magento on Apache 2 which has
> KeepAlives enabled. Changing KeepAliveTimeout to 500 (default is 15) in
> httpd.conf allows import of products but is a potential performance risk so
> it would be better to adjust the module in some way.
> I realize we are asking for workarounds for shortcomings in magento
> performance, but this would be useful for all users of the module with
> significant numbers of products to import (2000+ in my case).
>
> --
> Product Import fails
> https://bugs.launchpad.net/bugs/617905
> You received this bug notification because you are subscribed to Magento
> Open ERP Connector.
>
> Status in Magento Open ERP Connector: Invalid
>
> Bug description:
> I'm using current stable (5.0.12) on an Amazon EC2 ubuntu 10.4 instance. I
> have installed and configured the openerpconnect module ok and the
> corresponding magento module.
>
> In OpenERP, clicking on the referential actions in turn (1 - Import
> Customer Groups through to 5 - Import Product Attributes) works fine but
> when I click on 6 - Import products I get the following error. We have
> approx 2000 products, is this a timeout problem, or something else?
>
> Traceback (most recent call last):
>  File "/usr/local/lib/python2.6/dist-packages/openerp-server/netsvc.py",
> line 247, in dispatch
>    result = LocalService(service_name)(method, *params)
>  File "/usr/local/lib/python2.6/dist-packages/openerp-server/netsvc.py",
> line 76, in __call__
>    return getattr(self, method)(*params)
>  File
> "/usr/local/lib/python2.6/dist-packages/openerp-server/service/web_services.py",
> line 577, in execute
>    res = service.execute(db, uid, object, method, *args)
>  File "/usr/local/lib/python2.6/dist-packages/openerp-server/osv/osv.py",
> line 58, in wrapper
>    return f(self, dbname, *args, **kwargs)
>  File "/usr/local/lib/python2.6/dist-packages/openerp-server/osv/osv.py",
> line 119, in execute
>    res = pool.execute_cr(cr, uid, obj, method, *args, **kw)
>  File "/usr/local/lib/python2.6/dist-packages/openerp-server/osv/osv.py",
> line 111, in execute_cr
>    return getattr(object, method)(cr, uid, *args, **kw)
>  File
> "/usr/local/lib/python2.6/dist-packages/openerp-server/addons/magentoerpconnect/magerp_core.py",
> line 137, in sync_products
>    list_prods = attr_conn.call('catalog_product.list')
>  File
> "/usr/local/lib/python2.6/dist-packages/openerp-server/addons/magentoerpconnect/magerp_osv.py",
> line 53, in call
>    res = self.ser.call(self.session, method, arguments)
>  File "/usr/lib/python2.6/xmlrpclib.py", line 1199, in __call__
>    return self.__send(self.__name, args)
>  File "/usr/lib/python2.6/xmlrpclib.py", line 1489, in __request
>    verbose=self.__verbose
>  File "/usr/lib/python2.6/xmlrpclib.py", line 1253, in request
>    return self._parse_response(h.getfile(), sock)
>  File "/usr/lib/python2.6/xmlrpclib.py", line 1392, in _parse_response
>    return u.close()
>  File "/usr/lib/python2.6/xmlrpclib.py", line 836, in close
>    raise ResponseError()
> ResponseError: ResponseError()
>
>
>

-- 
Product Import fails
https://bugs.launchpad.net/bugs/617905
You received this bug notification because you are a member of C2C
OERPScenario, which is subscribed to the OpenERP Project Group.

Status in Magento Open ERP Connector: Invalid

Bug description:
I'm using current stable (5.0.12) on an Amazon EC2 ubuntu 10.4 instance. I have installed and configured the openerpconnect module ok and the corresponding magento module.

In OpenERP, clicking on the referential actions in turn (1 - Import Customer Groups through to 5 - Import Product Attributes) works fine but when I click on 6 - Import products I get the following error. We have approx 2000 products, is this a timeout problem, or something else?

Traceback (most recent call last):
  File "/usr/local/lib/python2.6/dist-packages/openerp-server/netsvc.py", line 247, in dispatch
    result = LocalService(service_name)(method, *params)
  File "/usr/local/lib/python2.6/dist-packages/openerp-server/netsvc.py", line 76, in __call__
    return getattr(self, method)(*params)
  File "/usr/local/lib/python2.6/dist-packages/openerp-server/service/web_services.py", line 577, in execute
    res = service.execute(db, uid, object, method, *args)
  File "/usr/local/lib/python2.6/dist-packages/openerp-server/osv/osv.py", line 58, in wrapper
    return f(self, dbname, *args, **kwargs)
  File "/usr/local/lib/python2.6/dist-packages/openerp-server/osv/osv.py", line 119, in execute
    res = pool.execute_cr(cr, uid, obj, method, *args, **kw)
  File "/usr/local/lib/python2.6/dist-packages/openerp-server/osv/osv.py", line 111, in execute_cr
    return getattr(object, method)(cr, uid, *args, **kw)
  File "/usr/local/lib/python2.6/dist-packages/openerp-server/addons/magentoerpconnect/magerp_core.py", line 137, in sync_products
    list_prods = attr_conn.call('catalog_product.list')
  File "/usr/local/lib/python2.6/dist-packages/openerp-server/addons/magentoerpconnect/magerp_osv.py", line 53, in call
    res = self.ser.call(self.session, method, arguments)
  File "/usr/lib/python2.6/xmlrpclib.py", line 1199, in __call__
    return self.__send(self.__name, args)
  File "/usr/lib/python2.6/xmlrpclib.py", line 1489, in __request
    verbose=self.__verbose
  File "/usr/lib/python2.6/xmlrpclib.py", line 1253, in request
    return self._parse_response(h.getfile(), sock)
  File "/usr/lib/python2.6/xmlrpclib.py", line 1392, in _parse_response
    return u.close()
  File "/usr/lib/python2.6/xmlrpclib.py", line 836, in close
    raise ResponseError()
ResponseError: ResponseError()





References