Oct 21, 2024 - Mixing Things Up - Curious Data
Day 42, Year 4 of Indexation System Research
Welcome to Crawl or No Crawl report.
Did you know that you don’t have to wait for me to send out emails to know what’s going on? There is a website attached to this work and you can find it here:
Supporting members receive the freshest information and status of what is going on. Most entires have an intro to all and then a section for paid supporters and some are special reports named “For Your Eyes Only” which not emailed to everyone.
Testing has increased 3 fold
Since last month - due to an apparent delay in processing content based on what I’m going to describe as site characteristics, in order to get timely results 3 tests are run every day to confirm and measure the first crawl (html) and the second pass (rendering crawl).
Tests on low value test site
API requests on low value and production sites
Test on production sites
Historically SEO test sites, not production sites where its more like experiments, we have intended them to have zero traffic and no backlinks.
In order to have a chance to interprete clear signals from tests, things like traffic and backlinks are examples of undesired factors.
How can we conclude a test result is clearly the result of what we intended to test instead of some contaminating factor such as the CTR value of traffic?
Never being one to take no for an answer, the workload of testing to get timely results has increased and I’m successful in daily getting clear signals of the two passes to discern the state of the system.