Popularity ScoreReferrals to Site/Downloads
0 1+ 250+ 1000+ 10000+
If you have our Magento Page Cache (or a 3rd party solution), then you need the Magento Cache Warmer / Crawler. The Magento Cache Warmer crawls your Web site to ensure that pages are always at their fastest. It crawls your Web site with concurrent requests for the fastest crawls possible. Your old cached pages will automatically refreshed by the crawler to ensure visitors see the most recent version of your site as possible. Crawls use special techniques to reduce bandwidth and reduce CPU usage. If you want to ensure as much as your site is cached as possible, then this is the extension for you.
What type of stores are benefited from the Magento cache warmer?
Any store that wants to improve its cache hit rate. Cache hit rate is the number of requests to your site that are uncached versus cached. The higher the hit rate the faster your site. You may have the fastest cache solution in the world, but if your cache hit rate is low, then your store will still be slow. Stores with a high number of unique pages compared to their traffic will tend to have a low hit rate and as a result caching solutions are not effective. The Magento Cache Crawler solves this by crawling and pre-caching the pages on your site, which will increase the cache hit rate. The end result is an overall faster site.
Private Demo: Create a private demo!
The crawler will only access each page one time during a crawl session to ensure there is no duplicate effort. In addition, pages your users cannot access (disabled products, children of configurable products) will not be crawled.Crawl all your important pages
Crawl CMS pages, catalog pages, and product pages. When used with the Full Page Cache, all your layered navigation filter options, deep catalog pages, searches, and 3rd party extensions will be crawled without any further configuration.Ensure that server load on the server does not become high
A crawler increases server load in exchange for faster page speed. If there is lots of things happening on the server, then it can create high server load. The crawler can detect this and automatically pause itself and automatically restart when the server load reduces. This ensures that the crawler does not compete with user traffic for server resources!Crawl as quickly as possible using multiple crawler threads
Multiple threads will be used which can reduce the total crawl time by 10 times or more.Crawl as logged as logged in users (customer group)
Do you show different content to logged in users? If so, it might make sense to crawl as a logged in user so their cache can be warmed. You can now easily select which customer group you want to crawl.Crawl out-of-schedule jobs by manually adding it
Did you flush the cache and need to run a job real quick even though it is not scheduled yet? No problem, you can easily add a manual job that will run immediately.Don't crawl disabled / hidden / out-of-stock products
Ensure you don't waste resources crawling products that would be infrequently viewed or not viewable at all!Filter out generated urls by url type
Easily filter out certain pages such as category pages or cms pages or product pages from being added to the queue. This is useful if you only want to crawl category pages or certain page types.Always view the status of crawls and manage crawls using an easy interface
Easily view past crawls, currently running crawls, and queued crawls. Pause or disable crawls. Change the number of threads used. View the number of crawled URLs, the source of the URLs, and view performance metrics such as the number of crawled URLs per minute.Filter out any URL by regular expression
Easily ensure that urls that match a regular expression will not be crawled. This is useful if you do not want certain pages to be crawled.Fully support crawling of HTTPS secure urls
Is your site running in secure mode on the frontend? The crawler will crawl your secure pages too.Reduces bandwidth and CPU usage during crawls
When combined with our Full Page Cache there will be reduced bandwidth and processing done when loading uncached pages loaded by the crawler process.Flush caches prior to crawling
Flushing Magento caches prior to crawling is important to ensure that the crawler crawled pages are the most up-to-date.Note: features may vary based on options selected during checkout
There are no uploaded releases.
This extension was developed by and is supported by Extendware
The best place to start if you need help with a specific extension is to contact the developer. All Magento developers have both a contact email and a support email listed.
If you need support for a Magento platform, there are different options for support depending on which Magento platform you are using. Below are links for specific platforms.
We built Magento Connect using the latest techniques and technologies.
This makes Magento Connect faster and easier to use.
Unfortunately, your browser doesn't support those technologies.
Use the links below to download a new browser or upgrade your existing browser.