SEOs across the industry were understandably excited about the launch of Screaming Frog 10.0. The website crawler space had been getting more crowded of late, with many industry folks I know taking a look at DeepCrawl and Sitebulb amongst others.
Often this interest was piqued by the features touted by these competitors to the venerable frog – examples like the scheduling of Deepcrawl or the actually comprehendible visualisations of Sitebulb (many have tried before, many have failed).
With this in mind, it was great to see that ScreamingFrog’s new version was coming with a brand new set of features aimed at improving their own offering in the face of this stiffer competition.
ScreamingFrog 10.0 introduced (deep breath) scheduling, a new indexability status column, improving XML sitemap handling, an internal link score metric, post-crawl analysis options, nifty visualisations, improved AMP validation and – the main topic of this article – a full command line interface and headless mode.
— Mark Porter (@markcporter) September 19, 2018
CLI means that the SEO spider can now be operated entirely by command line – this includes launching, configuration, saving, exporting and the other common tasks we’re used to doing. “Headless” refers to the fact that you no longer need to see the tool’s GUI to do any of this.
There’s a full list of command line options here, conveniently.
The reaction on Twitter to this announcement is best summed up as a collective “Ooooh!” and, on paper, it looks like a powerful expansion to how SEOs can use ScreamingFrog. Below you’ll find some tiny seeds of ideas for how we might make use of this new feature: