Has anyone automated indexing checks for third-party sites with an API?
-
I’ve run into this issue: we’re planning to purchase a large portfolio of domains for a private network of websites, and we’re currently analyzing which pages from the old donor sites are still showing up in search results and which ones have long since dropped out. Manually checking thousands of links is simply unrealistic, and obviously you can’t add third-party websites to Search Console because you don’t have access to verify ownership.
Comments (2) -
How do you handle a mass audit of third-party sites and dropped domains before purchasing to avoid ending up with dead links? And are there any decent ways to automate this process via API or scripts so that we can export ready-made reports based on URL lists directly into our CRM?
-
The grid idea is great, but you can really mess up if you pick domains that Google has already banned or removed from search results. The Search Console is completely useless here because it only works with verified sites and, on top of that, returns outdated data. We’ve personally been using the SpeedyIndex index checker for a long time now, because you can upload an entire .txt file with thousands of URLs or even integrate their REST API v2 directly into your software and parse the results on the fly at a rate of about 1,000 links per minute. The service pulls data directly from Live SERP, so the report provides a 99.9% accurate snapshot of the current status. By the way, are you planning to parse the URLs yourself, or do you already have ready-made exports from Ahrefs?