DeepCrawl

“The key lesson is to always set up multiple crawls. One weekly, one post-release, one during maintenance. I couldn’t have identified this issue without access to DeepCrawl’s historical data.”

“I have been using DeepCrawl since it first launched as an early adopter and haven’t looked back. The sheer level of engineering that has gone into this product makes it one of if not the best enterprise level crawl solution on the market.”

“With every large structure, there is always a risk of small issues scaling up quickly. To give you an idea, this is one of the crawls for dacodoc.fr, where we found an issue with rel-canonicals. The pace of the process and changes was so fast, the URL structure was changed but the rel-canonicals were forgotten.”