@willcritchlowi
iAccount based inUnited Kingdom
About this account
- Account based in
- United Kingdom
- Connected via
- United Kingdom App Store
Account-level information from X, not a live location or the device used for a specific post.
Founder and CEO @SearchPilot, founded @distilled (acquired by @Brainlabs) Interest in basketball, whisky, cooking, auction theory Views may not be orgs'
Somewhere rainy
Joined March 2007
- Tweets40.9K
- Following2.4K
- Followers40.6K
- Likes12.2K
Pinned Tweet
I am very interested in @randfish's recent research into the growth of LLMs, their impact on people's search habits, and their impact on Google.
My summary:
1. Google is still growing, not shrinking as some would have you believe
2. Not everything people do on LLM-based chat platforms are "searches"
3. Even if you are fixated on AI-powered discovery, Google is the biggest for *that* too
This is not to say we should ignore the growth of the others, or get complacent, and in fact I think there's a lot of scope to test the impact of our activities on other LLM recommendations, but we should keep things in perspective.
It reminds me a lot of the growth of social media circa 2007. It was clearly a coming revolution, and there was noise about it being catastrophic for search because people were making the argument that users would prefer to ask their friends where to eat rather than searching for restaurants. It turned out, of course, that they did both.
NEW Research: sparktoro.com/blog/new-resea…
If we include ChatGPT, what is Google's *REAL* market share of search?
After years of speculation, we finally have enough reliable data to build high quality numbers for both.
PSA claude can drive google docs in suggest mode to finally have an AI make suggestions and leave comments all over your work.
You know, if that kind of thing is your bag.
Pulling out one of the threads of thought from my post this week, I’ve long thought we are heading quickly to a world where every search is “search volume 1”.
👀
What do you think? Do you agree? 🤔
What are you doing about it?
Will Critchlow retweeted
Stuff is happening quite fast.
When asked in September 2025, the best superforecasters put the chance of AI resolving a Millennium Problem by September 2026 at 1.7% and (the more optimistic) industry expert put the chance at 4.6%
They also greatly underestimated AI Lab revenue.
I've been in the lab.
I wanted to see if I could model the impact of combining randomness in LLM outputs with the branching chaos of conversational paths.
I wondered how stable the recommended product and brand would be.
The answer? Extremely unstable.
Given a static persona and buying objective, one of my experiments "bought" 9 different products in 12 runs. The one pictured below "bought" 5 different products from 4 different brands from 4 different retailers.One-shot prompt tracking isn't anywhere near capturing this complexity.
I have more questions than answers, but I'm excited to do more testing.
Full write up and methodology: searchpilot.com/resources/bl…
Did you know the Google quality graders consider (among other things) "content effort" to differentiate things that somehow deserve to rank?
Ever since speaking to @CyrusShepard about it, I've been thinking about what that might mean these days. I actually DON'T think it necessarily or only means "written by a human" - it may include consideration of the effort and organisation needed to gather the data, insights or information underpinning the content for example.
Whatever it flows towards meaning, you'll be well-served to have a listen to Cyrus on the subject. Remember, if it were easy, everyone would be doing it, and then it by definition couldn't work in a competitive space!
I'm always reminded, in these conversations of the old name for what we do: competitive webmastering. Get your competition on.
(and if you want to hear more from Cyrus and me, register here for the full content: searchpilot.com/winning-ai-c… )
You know who is the GOAT at introducing other people and their work?
@CyrusShepard.
(anyone who has seen him MC an event can attest). It is too rare that he is the beneficiary of the same generosity of spirit, which is a shame because he does his own EXCELLENT research.
Who else do you know who's actually worked as a Google quality rater to improve their game?
Join us next week as I turn the tables and ask HIM what he's been learning and discovering recently:
Register here:
searchpilot.com/winning-ai-c…
Will Critchlow retweeted
🚨 Upcoming Webinar Alert 🚨
Winning AI Citations Isn't the Same as Winning in Search
I've posted a lot about winning AI citations, but sometimes those same actions can cost you visibility in traditional search. And @SearchPilot has the data to back this up.
Thrilled to join @willcritchlow to discuss this phenomenon:
"It points at a bigger problem with AI discovery. We can measure more things than we actually understand.
Cyrus reviewed hundreds of AI citation studies, experiments and patents to work out what appears to influence citations. What he found is that getting cited and getting recommended are not the same thing.
Citations can be easier to win. They are also easier to put on a dashboard. That does not make them the thing that matters most.
If your team is being pushed to show progress in GEO, this hour is about not optimising a metric while missing the outcome."
Bought new scales. Part of the setup involves entering your weight.
Someone hasn’t thought this through
The role of guardrail metrics in SEO testing - via @SearchPilot & @willcritchlow #seo searchpilot.com/resources/bl…
Will Critchlow retweeted
AIs cracking short-term superforecasting is such an important (and, still, under-discussed) trend.
Via a new piece from @nikostro economist.com/science-and-te…
I have become very interested in the developing AI capabilities for forecasting. My favourite tool at the moment is @FUTURESEARCHAI which takes a simple forecasting question, builds a panel of researchers and emulates the best human forecasters' approaches to quantitative forecasting.
I recently set it the task of forecasting:
- Change in Google search *traffic* to large retailers over the next 3 years (-15% central estimate)
- Change in total online revenue for the same retailers over the same time period (+31% central estimate)
How can these both be true when organic is such a large channel? Well one key is that the clicks become higher-intent on average:
"while session volume may compress overall, nominal price increases (AOV) and higher-intent surviving clicks will likely keep SEO-attributed dollar revenue roughly flat"
The other is obviously the growth of GEO:
- Change in revenue attributed to combined organic search + AI discovery over the same time period (+20% central estimate)
What do you think?
See more here: futuresearch.ai/app/conversa…
Guardrail metrics have long been a staple of many forms of testing, but they have been less common in SEO testing.
I wrote up three uses for guardrails:
searchpilot.com/resources/bl…
Shower thought: if / when AI gets good at writing, its guardrails will in theory mean it won't talk about certain things still, so there's a long-run niche for human novelists writing about crime and dystopia.