SonicImaging wrote:Any thoughts on how to get some quick speed increase's from 1.7
My trouble is on the customer / order side of things. I have about 400 products with 700 variants and the product side of things runs smooth with a small number of products.
In 1.6 I could import 50,000 customers and 100,000 orders in a bit over a hour from my old classic asp site. 1.7 takes over 8 hours to import the same number. Entity framework slows depending on the number of records. so the first customer take a 1/4 of second while the last customer takes 5 minutes. I rewrote the entire import to use direct SQL so im back to about a hour. This is on a fast local machine with the source pre-compiled directly running IIS 7 with sql server 2008 with a quad core processor running 4.6 mhz and 8 gigs of ram.
Then with that number of customers the registration / checkout crawls to a snails pace. it takes minutes to complete the checkout.
My worry is this site averages 100 to 150 orders a day with about a 50/50 split between returning and new customers.
Ive tried it with both caching on and off. I'm ready to go live with this new site, but i cant possibly with the current performance.
Thoughts?
-Keith
Ive sorted out my issues, well code issues. I believe it was a few things working against me. I had some un-synchronized mapping tables from my custom import so that was throwing a lot of errors. Plus my SQL server log file was over a gig from all the import testing (it should have cleared itself) So clearing, regenerating the nop database and re-importing from scratch helped big time.
With those resolved, I have 57,345 customers. 106,890 orders imported and its now running very fast. new registrations, check out are running great.
Also i think entity framework isn't adapted well for importing a large number of records in one shot. There still is the issue with each imported object taking a longer amount of time. You can almost half the import time by importing a smaller number of records for each transaction. so for 50,000 customers I imported about 1000 at a time using the nop object context. still took 3 hours more then 1.6 but its a improvement. Ill enter a feature request for the importer
Thanks
-Keith