Screaming Frog SEO Spider vs. Similarweb

Screaming Frog tracks the crawl level, internal links, outbound links, title tags, and meta descriptions of the pages it crawls. It also adds HTTP status codes, title tag length, meta description length, H1, H2 tags and lengths, and canonical tags. Many of these elements are also broken into their own tabs at the top so that you can easily focus in on problem areas. You can right-click on any URL for many more options. The program is definitely valuable to anyone who is looking to gauge factors regarding SEO. However, if you are not a web designer/admin, you're going to lack an understanding of the information it provides.

Incentivized

Similarweb is our go-to tool for SEO research. We can identify high-value keywords, track our rankings, and monitor changes in our website's traffic. This data is invaluable for optimizing our content and ensuring we rank high on search engine results pages.

Incentivized

• Collects all indexed HTML pages of the site. This helps for when we are redirecting old URLs to the URLs of a clients new site.
• Finds all page titles that are too long or too short and allows us to address them more quickly than waiting for a program such as Moz. It's more immediate.
• If we have duplicate meta data on pages, this program allows us to find them, sort them, export them and take care of them in a timely manner. In our business (as for many) time is money.

Incentivized

• Competitive Analysis: Similarweb has provided us with a comprehensive toolkit for analyzing web traffic and audience behavior for various sports teams, leagues, and players. We can compare and contrast their online presence, helping us gain a competitive edge by understanding their digital strategies.
• Sponsorship Decisions: Making informed sponsorship decisions is vital in sports. Similarweb assists us in evaluating potential sponsorships by providing insights into the online presence and reach of potential partners.
• Audience Demographics: One of the standout features of Similarweb is its ability to provide detailed audience demographics. We can pinpoint the age groups, locations, and interests of online visitors, which is crucial for tailoring content, promotions, and sponsorship deals effectively.

Incentivized

• Customizing the crawler - It takes a little bit of playing around with the settings to understand what each of them controls and what options need to be checked or unchecked to get the right amount of information.
• Cannot Crawl a large site - Screaming Frog runs out of memory when asked to crawl a large site, even after playing around with memory settings and allocating additional memory.

Incentivized

• Top Pages Data: In the past, Similarweb PRO provided extensive data on a website's top pages, allowing for a deeper understanding of competitors' content strategies. However, the platform has reduced the extent of this information in recent years, limiting the insights users can glean. Restoring more comprehensive top pages data would be a valuable addition to the platform.
• Data Accuracy: While Similarweb PRO generally provides accurate data, there have been instances where the reported numbers deviate from the actual figures, particularly for smaller or niche websites. Improving the platform's data accuracy, especially for less prominent sites, would enhance the overall reliability of the tool.

Incentivized

The tool has become integrated into our teams daily workings and I have yet to find a tool other than scremaing frog to replicate all of our use cases for it. It's a great tool and we're sticking with it

Incentivized

I use it every single day and its essential to succeeding in my role

Incentivized

The main problem of Screaming Frog SEO Spider is it being an offline software which limits itself to a single pc and that creates problem when multi user agents want to get involved or even work on it, it’s a difficult task to collaborate on it and do research for keywords at one place

Incentivized

Similarweb is a very easy to use tool and gives us data on the go. It takes only a few clicks to get the relevant data. However, I have deducted 2 points as it only allows us to add 5 websites at a time on the platform, and data availability is only for the last 37 months.

Incentivized

Screaming Frog is a relatively primitive system, and doesn't need to be supported by devs or other software. Screaming Frog does interface directly with some programs that are most needed (Google Analytics, Search Console, Page Speed Insights), so that's convenient. It isn't widely supported by other programs, but it also doesn't need to be.

Incentivized

Support is just helpful and effective when you need them; we have only needed to contact them once about a misunderstanding while setting up our Market Analysis. Since we don't really contact them too often, it's hard to offer anything but a positive rating from the single positive experience we had with tech support.

Incentivized

If the software was a little easier to use for beginners, there really wouldn't be an issue

Incentivized

We liked it, things can always be better

Incentivized

The biggest difference between DeepCrawl and Screaming Frog is cost. Screaming Frog is significantly cheaper, and fits within a budget much easier. For most websites that aren't huge it crawls quicker to. DeepCrawl is the better tool for analysing larger websites and is easier to use in some ways, with a very friendly interface and some extras features that are useful. Ultimately price was the deciding factor though.

Whilst data.ai has strong app competitor intelligence data, Similarweb do a better job of showing the upstream and downstair behaviour across desktop and mobile web. Additionally, Similarweb's channel marketing mix goes deeper and allows us to understand a wider set of channels and be able to get a holistic understanding of our overall marketing strategy performance

Incentivized

• It has allowed me to make impactful and intelligent recommendations to clients. This has in turned deepened the client relationships and led to steady ongoing ROI.
• It has also allowed me to diagnose interesting technical issues for non-client sites (like Forbes) which formed the basis for very cool company blog posts.
• The investment is very low - this tool does 99% of what I need for a fraction of what other industry crawlers costs. Kudos to the Screaming Frog team!

Incentivized

• Similarweb PRO has helped us gain conviction in industries or companies we're interested in early on and, conversely has helped us kill deals where see many negative indicators
• Helped us give our portfolio companies insights into their own website performance vs. competitors

Incentivized