SuperSEOPlus

Website Management Tools

Crawl Export Comparator

Paste or open two CSV exports from a crawler, such as a crawl taken before and after a site migration or template change, and see what differs. The tool matches pages by address, lists URLs that appear only in one file, and shows every changed value in the columns you choose, with the numeric difference where both values are numbers. It reads the CSV text only. It never visits any page, so it cannot tell you whether a change is good or bad, and it makes no claim about rankings. Both files stay in your browser.

How to use it

  1. Paste each CSV, or open the files. Each needs a header row, and both should come from the same crawler settings.
  2. Check the column that identifies each page (usually Address), tick the columns to compare, and set the URL matching options.
  3. Press Compare, browse changed values, added URLs and removed URLs, then download the CSVs.

Example

If the first file has https://example.com/a,200,Old title and the second has https://example.com/a,301,Old title, the tool reports one changed value: Status Code 200 to 301, difference +101. A URL that is only in the second file is listed as added.

What it compares

  • Added and removed URLs: addresses present in only one of the two files.
  • Changed values: for pages in both files, each chosen column whose value differs, shown before and after.
  • Numeric differences: when both values are numbers (status code, word count, response time), the change is shown with a plus or minus sign.

Limits to keep in mind

The comparison is only as good as the two crawls. If they used different settings, depth limits or user agents, differences may come from the crawl rather than the site. The tool reads text you supply and does not check pages itself.

Questions

Which crawlers does it work with?

Any tool that exports a CSV with a header row and one page per row, including Screaming Frog, Sitebulb and your own scripts. Columns are matched by their header names, so both files should use the same names. Commas, semicolons, tabs and pipes are detected automatically.

How are pages matched between the two files?

By the column you choose, normally Address or URL. By default capitals in the host name, a trailing slash and a #fragment are ignored so that the same page is not reported as removed and added. You can switch each option off. The path itself is compared exactly, because paths are case-sensitive on many servers.

Does it tell me whether a change is a problem?

No. It shows what differs and, for numbers, by how much. Whether a status code, title or word count change matters depends on your site and what you intended. Treat the output as a list of things to look at, not a verdict.

Are my files uploaded?

No. The CSV is read by your browser, and nothing is sent anywhere or stored. Closing the page clears it.

How large a file can it handle?

Up to about 300,000 rows and 40 MB of text per file, with a limit of 300 columns. Very large files may be slow on older devices. Remove columns you do not need in your crawler's export to make it faster. The page shows the first 300 results and the CSV downloads contain all of them.

Why are some columns not compared?

Only columns present in both files, with the same header name, can be compared. Columns found in just one file are listed in the notes. Rows with an empty address are skipped, and when an address appears twice in a file only its first row is used. The tool says so when this happens.

Get practical SEO tips by email

Occasional emails with new guides and tools. Confirm by email first; unsubscribe in one click.