Cache Crawler - Cache Warmer

  • Popularity Score 513 Popularity Score

    Popularity ScoreReferrals to Site/Downloads

    0 0 1+ 1+ 250+ 250+ 1000+ 1000+ 10000+ 10000+

  • Magento Connect Silver Industry Partner
Ensure your cache solution is ready to serve your pages as fast as possible
Compatible with:
This extension is currently unavailable on Magento Connect. Please contact the developer.

You will be re-directed to the developer's website to complete your purchase.

You must be registered and logged in to get extension key.
In order to get this extension, you must be logged in to the Magento Community. Click here to login or register.

Magento Connect

Previous Next

Cache Crawler - Cache Warmer

Magento Extensions by Extendware

Mageneto Extensions


If you have our Magento Page Cache (or a 3rd party solution), then you need the Magento Cache Warmer / Crawler. The Magento Cache Warmer crawls your Web site to ensure that pages are always at their fastest. It crawls your Web site with concurrent requests for the fastest crawls possible. Your old cached pages will automatically refreshed by the crawler to ensure visitors see the most recent version of your site as possible. Crawls use special techniques to reduce bandwidth and reduce CPU usage. If you want to ensure as much as your site is cached as possible, then this is the extension for you.

What type of stores are benefited from the Magento cache warmer?
Any store that wants to improve its cache hit rate. Cache hit rate is the number of requests to your site that are uncached versus cached. The higher the hit rate the faster your site. You may have the fastest cache solution in the world, but if your cache hit rate is low, then your store will still be slow. Stores with a high number of unique pages compared to their traffic will tend to have a low hit rate and as a result caching solutions are not effective. The Magento Cache Crawler solves this by crawling and pre-caching the pages on your site, which will increase the cache hit rate. The end result is an overall faster site.

View demo on product page or request a trial!

Features / Benefits (depends on checkout options)

Efficiently crawl your Magento store to warm your caches

The crawler will only access each page one time during a crawl session to ensure there is no duplicate effort. In addition, pages your users cannot access (disabled products, children of configurable products) will not be crawled.

Crawl all your important pages

Crawl CMS pages, catalog pages, and product pages. When used with the Full Page Cache, all your layered navigation filter options, deep catalog pages, searches, and 3rd party extensions will be crawled without any further configuration.

Ensure that server load on the server does not become high

A crawler increases server load in exchange for faster page speed. If there is lots of things happening on the server, then it can create high server load. The crawler can detect this and automatically pause itself and automatically restart when the server load reduces. This ensures that the crawler does not compete with user traffic for server resources!

Crawl as quickly as possible using multiple crawler threads

Multiple threads will be used which can reduce the total crawl time by 10 times or more.

Crawl as logged as logged in users (customer group)

Do you show different content to logged in users? If so, it might make sense to crawl as a logged in user so their cache can be warmed. You can now easily select which customer group you want to crawl.

Crawl out-of-schedule jobs by manually adding it

Did you flush the cache and need to run a job real quick even though it is not scheduled yet? No problem, you can easily add a manual job that will run immediately.

Don't crawl disabled / hidden / out-of-stock products

Ensure you don't waste resources crawling products that would be infrequently viewed or not viewable at all!

Filter out generated urls by url type

Easily filter out certain pages such as category pages or cms pages or product pages from being added to the queue. This is useful if you only want to crawl category pages or certain page types.

Always view the status of crawls and manage crawls using an easy interface

Easily view past crawls, currently running crawls, and queued crawls. Pause or disable crawls. Change the number of threads used. View the number of crawled URLs, the source of the URLs, and view performance metrics such as the number of crawled URLs per minute.

Filter out any URL by regular expression

Easily ensure that urls that match a regular expression will not be crawled. This is useful if you do not want certain pages to be crawled.

Fully support crawling of HTTPS secure urls

Is your site running in secure mode on the frontend? The crawler will crawl your secure pages too.

Reduces bandwidth and CPU usage during crawls

When combined with our Full Page Cache there will be reduced bandwidth and processing done when loading uncached pages loaded by the crawler process.

Flush caches prior to crawling

Flushing Magento caches prior to crawling is important to ensure that the crawler crawled pages are the most up-to-date.

Note: features may vary based on options selected during checkout

Other Important Considerations and Resource

  • 30-day money back guarantee - no risk to you!
  • Responsive, helpful support
  • Frequent new releases - we do not abandon our Magento Extensions
  • Detailed installation and related documentation provided
  • Enterprise level product backed by a professional company
  • Extension trials are available
  • More Magento Extensions by Extendware

    Magento Abandoned Cart Reminder  Magento Sphinx Search  Magento Custom Order Status Email Templates  Magento Maintenance Mode  Magento Image Optimization  Magento Cache Backends / Faster Checkout

    Also: Magento Bulk Product Updating | Magento Bot Blocker | Magento Google Analytics Dashboard | Magento Full Page Cache | Magento Lucene Search

    Magento Extensions

    M1 Extension Versions

    There are no uploaded releases.


    About the Developer

    This extension was developed by and is supported by Extendware

    Rated 5 out of 5 by 15 reviewers.
    Rated 5 out of 5 by Good extension to speed up Magento store We use this extension together with Turpentine + Varnish cache. Works as described, it really improves our cache hit rate. We are going to try also Full Page Cache extension from this developer. October 29, 2015
    Rated 5 out of 5 by Muy buena recomendación Nuestra página web tiene más de 4000 productos y instalamos esta extensión juntamente con Full Page Caché. El rendimento de la velocidad de carga mejoró muchissimo y ahora tenemos una web ràpida y agil. Sín duda que lo recomendamos. October 28, 2015
    Rated 5 out of 5 by Must have extension for any Magento store with FPC Cache warmer it's true must have for any merchant. Without it even best Full Page Cache system not can help you. With this extension visitors same as Google always get light fast pages on your store and you will get more sales! Works perfect together with Extendware Full Page Cache - this tandem is true best solution for Magento performance. Lot of settings allow you configure crawler per your requirements! October 13, 2015
    Rated 5 out of 5 by A must have This works perfectly with the Full page cache. A must have to reach a fast website. July 9, 2015
    Rated 5 out of 5 by Very good extension This extension is fifth one i bought from Extendware, it absolutely me me comfort. This extension should be must have for magento. February 22, 2015
    Rated 5 out of 5 by Website is flying! I purchased this along with Extendwares full page cache and now my website is crazy fast. The support was great and I learnt a little something about Ajax at the same time. Many thanks. February 5, 2015
    Rated 5 out of 5 by Great Product and Outstanding Support I have had a number of extensions from Extendware and have they have bent over backwards to help us. Any Questions or issues that we had were answered or fixed within a few hours. Anyone looking for a full page caching extension should definitely look at their full page cache extension, it has speeded up our site so much. June 30, 2014
    Rated 5 out of 5 by Get the most out of the Full Page Cache I’m using the Full Page Cache extension from Extendware. This extension is loading pages much quicker (when pages are cached). The Webshop is on shared magento hosting and benefits a lot from the cached pages. There are around 3000 products in the catalog, but not all of these are viewed often. Therefore it’s important to have these pages cached to keep user experience OK also for these pages. Installation of the crawler went fine. The installation guide indicates how the cron job for the scheduled crawling needs to be setup. Not difficult, but I made a small mistake. After sending a support ticket, john guided me quickly into the right direction. It’s working fine, pages are crawled now two times per day, as configured. The full page cache crawler is good additional extension to benefit most from the Full Page Cache ! June 25, 2014
    Rated 5 out of 5 by My 3rd extension... This is my 3rd extension I have purchase from Extendware and they extensions quality is problem free. With Extendware you can be confident with your investment. Now I'm one loyal customer. June 1, 2014
    Rated 5 out of 5 by A good solution This is a good solution if your having issues with the Magento native cache invalidating with custom updates. Extendware did a great job installing the extension to meet our needs. John and his team were responsive to on-boarding issues and questions after the install was done. October 31, 2013
    • 2015-11-27 T09:33:49.883-06:00
    • bvseo_lps, prod_bvrr, vn_prr_5.6
    • cp-1, bvpage1
    • co_hasreviews, tv_15, tr_15
    • loc_en_US, sid_12634, prod, sort_default
    2 next>>
    (3 Questions : 0 Answers)

    Product Q&A

    Ask your questions. Share your answers.

    « Back
    Sort by
    Avatar Image Url:: http://www.magentocommerce.com/images/avatars/uploads/avatar_23955
    Customer avatar
    I use amasty's improved navigation for my layered navigation. Will this cache warmer works with it? Or does it only work with default layered navigation.
    2 years, 7 months ago
    0out of 0found this question helpful.
    Was this helpful?Yes0No0
    Avatar Image Url:: http://www.magentocommerce.com/images/avatars/uploads/avatar_286670
    Customer avatar
    Hi. We are using a hardware solution for caching (varnish). This is really fast (<100 ms) as long as the caches are warm. The thing is, that we deliver slightly modified output depending on the USER AGENT. So if a Google Bot is coming around we ha a different output of our product pages with special meta information. Our Cache is configured to save a separate cache for each USER AGENT. The question now is, if your crawler can spoof the user USER AGENT to warm each cache?

    Thanks for your attention.
    1 year ago
    0out of 0found this question helpful.
    Was this helpful?Yes0No0
    Avatar Image Url:: http://www.magentocommerce.com/magento-connect/media/avatars/avatar_16196.jpg
    Customer avatar

    One of our client purchased your Cache Crawler - Cache Warmer Extension. So we want to know about, how we can remove product page URL not to get crawled when your crawler was running or your Filters option will allow to do that.

    Looking forward to your reply.

    6 months ago
    0out of 0found this question helpful.
    Was this helpful?Yes0No0
    • 2015-11-27 T09:34:06.575-06:00
    • bvseo_lps, prod_bvqa, vn_prr_5.6
    • cp-1, bvpage1
    • co_hasquestions
    • loc_en_US, sid_12634, prod, sort_default
    1 of 1
    • 2015-11-27 T09:34:06.577-06:00
    • bvseo_lps, prod_bvqa, vn_prr_5.6
    • cp-1, bvpage1
    • co_hasquestions
    • loc_en_US, sid_12634, prod, sort_default
    1 of 1
    Get Help

    Support for This Extension

    The best place to start if you need help with a specific extension is to contact the developer. All Magento developers have both a contact email and a support email listed.

    Magento Platform Support

    If you need support for a Magento platform, there are different options for support depending on which Magento platform you are using. Below are links for specific platforms.

    In order to upload extension, you must be logged in to the Magento Community. Click here to login or register.



    * Required Fields

    Close window

    Forgot Your Password?

    Please enter your email below and we'll send you a new password.

    * Required Fields

    Close window


    To upload extension you must be logged in.

    * Required Fields

    Close window

    You are using an outdated browser

    We built Magento Connect using the latest techniques and technologies.
    This makes Magento Connect faster and easier to use.
    Unfortunately, your browser doesn't support those technologies.
    Use the links below to download a new browser or upgrade your existing browser.