’Fatal error: Allowed memory size of 67108864 bytes exhausted (tried to allocate 32 bytes) in /magento_home_directory/lib/Zend/Db/Statement/Pdo.php on line 284’
I get this error whenever i attempt to manage my categories or products.
and so on…
I have about ~11,000 categories and about ~2,500 items… Looking at the categories tables, it seems magento quadrupled the number of entries thus causing the error (i think.) im not too familiar with magento’s database structure yet.. any input will be appreciated greatly.
Please refer to:
http://www.mjmautohaus.com/images/1/OSC_db.jpg
http://www.mjmautohaus.com/images/1/magento_db.jpg
I’ve seen the PHP processes get pretty big during my import, I think as much as 90Mb, but we’re using FastCGI so I’m not sure if that makes a difference on the error you are seeing and if that is more specific to running in the apache process using mod_php or not.
The way the data is stored in the Magneto tables is completely different then the method used in osCommerce. A really nice diagram of the tables is in the wiki here http://www.magentocommerce.com/wiki/magento_database_diagram put up about a week ago.
The counts you are seeing for catalog_category_entity_varchar look normal for the data coming from osCommerce it’s not duplicated, just represented a lot differently.
The catalog_category_entity table should give you a count of the categories in your Magento database. The on you were referencing was the associated table which contains all the varchar parameters associated with one of the category entities. Bascially instead of having one table with say 30 columns to describe all the information about a category in one record like osCommerce does the Magento database has several narrow tables that when combined make up all the information for a category, so instead one category might have 30 records amongst the 6 different category_entity tables, and another category may only have 10 records in 4 of the category_entity tables.
I should note that this error does not occur during importing. It happens when I go into admin and try and manage my categories and/or products. Importing of categories gets to 99.6% and stops, products haults around 70%
I have about ~11,000 categories and about ~2,500 items…
That is a lot of categories, and oddly enough more categories then items. I wonder if the problem isn’t necessarily with the import, but the fact that admin page doesn’t know what to do with 11,000 categories that it tries to display on the left hand side of the admin page, and it ends up using up a ton of RAM just trying to build the list of 11,000 categories.
I have about ~11,000 categories and about ~2,500 items…
That is a lot of categories, and oddly enough more categories then items. I wonder if the problem isn’t necessarily with the import, but the fact that admin page doesn’t know what to do with 11,000 categories that it tries to display on the left hand side of the admin page, and it ends up using up a ton of RAM just trying to build the list of 11,000 categories.
Well, It’s an automotive website. That being said, 1 part can go into ~150 different categories.
The category tree is essentially:
Make
--Model
----Generation
------Brakes/Engine/Exhaust/Interior/Etc..
--------Pads/Rotors/Hoses/Electrical/SteeringWheels/etc..
Do that for 50 or 60 different vehicles and apparently you end up with about 11,000 categories
I should note that this error does not occur during importing. It happens when I go into admin and try and manage my categories and/or products. Importing of categories gets to 99.6% and stops, products haults around 70%
The problem you experience means low memory for PHP on the server. This is a configuration issue on your server and you have to resolve this with your hosting provider.
The second issue is the percentage of products imported. Please note that this percentage does not show exactly progress but number of products successfully imported. If it is not 100%, some of your products or categories were not imported due to for example missing information. Look for errors reported while running the import tool and at the summary that should show up after the tool finishes importing.
I should note that this error does not occur during importing. It happens when I go into admin and try and manage my categories and/or products. Importing of categories gets to 99.6% and stops, products haults around 70%
The problem you experience means low memory for PHP on the server. This is a configuration issue on your server and you have to resolve this with your hosting provider.
The second issue is the percentage of products imported. Please note that this percentage does not show exactly progress but number of products successfully imported. If it is not 100%, some of your products or categories were not imported due to for example missing information. Look for errors reported while running the import tool and at the summary that should show up after the tool finishes importing.
As it turns out the memory setting for PHP is located in the .htaccess file in Magento’s root directory… So, that being said I got all that figured out but now it looks like I have 6 different stores and some other mess I have to clean up from importing
Which version are you using? Do you get any errors for your catalog data? The progress indicator will not reach 100% if there are products that cannot be imported.
