Search Results for:
*
Screaming Frog SEO Spider Update – Version 9.0
I’m delighted to announce the release of Screaming Frog SEO Spider 9.0, codenamed internally as ‘8-year Monkey’. Our team have been busy in development working on exciting new features. In our last update, we released a new user interface, in...
Google Search Console robots.txt Tester Inconsistencies
We’ve had a few customers notice that our robots.txt tester tool, in version 8.1 of the SEO Spider, gives different results than the robots.txt tester in Google Search Console . This variation in behaviour is around the handling of non-ASCII...
Screaming Frog Drinking Bottles Giveaway
It’s time for another giveaway. This time, you can win some very cool Screaming Frog aluminium drinking bottles. You’ve probably been told you should drink more (water), so why not keep hydrated in SEOtyle? Sorry. The large capacity (770ml) and...
How Accurate Are Website Traffic Estimators?
If you’ve worked at an agency for any significant amount of time, and particularly if you’ve been involved in forecasting, proposals or client pitches, you’ve likely been asked at least one of (or a combination or amalgamation of) the following...
How do I extract multiple matches of a regex?
If you want all the H1s from the following HTML: <html> <head> <title>2 h1s</title> </head> <body> <h1>h1-1</h1> <h1>h1-2</h1> </body> </html> Then we can use: <h1>(.*?)</h1>
Why is my regex extracting more than expected?
If you are using a regex like .* that contains a greedy quantifier you may end up matching more than you want. The solution to this is to use a regex like .*?. For example if you are trying to...
How does the Spider treat robots.txt?
The SEO Spider is robots.txt compliant. It checks robots.txt in the same way as Google. It will check robots.txt of the (sub) domain and follow directives specifically any for Googlebot, or for all user-agents. You are able to adjust the...
Why isn’t my Include/Exclude function working?
The Include and Exclude are case sensitive, so any functions need to match the URL exactly as it appears. Please read both guides for more information. Functions will be applied to URLs that have not yet been discovered by the...
Screaming Frog SEO Spider Update – Version 4.0
I’m really pleased to announce version 4.0 of the Screaming Frog SEO Spider, codenamed internally as ‘Ella’. We have been busy in development working on some significant improvements to the SEO Spider due for release later this year, which include...
Screaming Frog Changes For VAT In 2015
I’m writing this post on the eve of 2015, as I prepare to update 28 VAT rates for each country in the EU as they enter the New Year. We first found out about the EU VAT changes on the...
