We've Updated the Detailed Website Crawler to Version 2.1

If you haven't yet given the Detailed website crawler a spin, now might be the time to do exactly that.


We've just released an update which fixes the tool getting suck on certain URLs, and added an even easier way for you to find pages with trailing slash issues.

This page has all of the details.

Note that on future updates we aim to be able to update the software via the app, which we are now working on.

How to Detect Trailing Slash Issues on Large Sites

One of our commenters, Michael, asked for a way to 'hide' one version of URLs when doing a check for trailing slash issues.

I've just uploaded a video in our on-site SEO section - here - on how we do this for large websites.

If a website tends to load URLs with a trailing slash, we look at the opposite, and vice versa.

The approach we share is especially useful on large websites.

Thanks for the suggestion Michael, and I hope you all find this useful!

You Can Now See Your Progress on Individual Blueprint Pages

Two of our members, Paul and Lewis, both asked us for a way to see which lessons they had completed from the individual Blueprint pages, rather than having to click on each individual video.

This has now been added to the Link Building Blueprint, and will be rolling out to all modules over the next 48 hours.

Thanks for the suggestion!

Closed Captioning Rolling Out

A few members of the training let us know that they are hard of hearing, so we've started to roll out close captioning on our videos.

It will take a little time to get all videos transcribed, but we've added Closed Captioning to 10 videos so far.

On-Site Video on URL Structures

Inside the on-site blueprint, we've added a new video on ideal URL structures. Including examples in the world of blogging, eCommerce and affiliate sites.

We've also updated the on-site checklist to account for this as well.

Microsoft Approve Detailed Crawler

When developer a Windows application, Microsoft require you submit the application in order to get a certification.

This means that you can provide ongoing updates to the software - and that people can install it.

Happily, this has just been approved. We updated the links on /dashboard/ to link directly to the download URL.