#23 Import speed optimization tip

[Sergio]

Hi,

Just wanted to post an optimization tip.
Importing into Magento (1.9.1.0) via magmi (0.7.19) using Magmi_DataPumpFactory::getDataPumpInstance("productimport")

At first imports run fast at about 0.17 sec/sku, but after 300.000 products things really slow down and I get 5 sec/sku.
Found out the issue was at Magmi_DefaultAttributeItemProcessor::handleUrl_keyAttribute.
Query:
SELECT entity_id FROM catalog_product_entity_varchar
WHERE attribute_id='481'
AND store_id='0'
AND VALUE='some text...'
ORDER BY entity_id;

Solution was to add an index which speeds it up:
ALTER TABLE magento.catalog_product_entity_varchar ADD INDEX magmi_search1 (attribute_id, store_id, value);

[Sebastien Bracquemont]

indeed, in fact i'm currently refactoring the "url key" conflict checking
code to avoid slowdown.

2015-03-26 16:58 GMT+01:00 Sergio scvikic@users.sf.net:

---

• [patches:#23] http://sourceforge.net/p/magmi/patches/23 Import speed
  optimization tip*

Status: open
Group: Unstable_(example)
Created: Thu Mar 26, 2015 03:58 PM UTC by Sergio
Last Updated: Thu Mar 26, 2015 03:58 PM UTC
Owner: nobody

Hi,

Just wanted to post an optimization tip.
Importing into Magento (1.9.1.0) via magmi (0.7.19) using
Magmi_DataPumpFactory::getDataPumpInstance("productimport")

At first imports run fast at about 0.17 sec/sku, but after 300.000
products things really slow down and I get 5 sec/sku.
Found out the issue was at
Magmi_DefaultAttributeItemProcessor::handleUrl_keyAttribute.
Query:
SELECT entity_id FROM catalog_product_entity_varchar
WHERE attribute_id='481'
AND store_id='0'
AND VALUE='some text...'
ORDER BY entity_id;

Solution was to add an index which speeds it up:
ALTER TABLE magento.catalog_product_entity_varchar ADD INDEX magmi_search1
(attribute_id, store_id, value);

---

Sent from sourceforge.net because you indicated interest in
https://sourceforge.net/p/magmi/patches/23/

To unsubscribe from further messages, please visit
https://sourceforge.net/auth/subscriptions/