SEO Testing and R&D Split Experiments | James Dooley Interviews Panel
Listen on your favourite platform
| Platform | Link |
|---|---|
| YouTube | Listen on YouTube → |
What Does “SEO Testing and R&D Split Experiments | James Dooley Interviews Panel” Talk About?
This episode of the Fatrank Podcast features host James Dooley in conversation with SEO practitioners Mike Lovatt, Paul Truscott, and Luke Bastin about the critical role of SEO testing, split testing, and research and development in modern search marketing. The group discusses why private testing communities tend to surface more actionable and timely ranking insights than public SEO conferences, which often share information that is already years old. Topics covered include Google algorithm behavior, the value of patience when waiting for ranking changes to play out, subdomain experiments for country-specific testing, and why most SEO ideas fail before a genuinely useful one is found.
The conversation also explores how data-backed SEO experiments serve a dual purpose: advancing technical knowledge and building trust with clients and stakeholders. Luke Bastin highlights how split testing creates compelling narratives for enterprise clients who require budget approval across multiple teams. Paul Truscott emphasizes that reading patents and grounding ideas in established theory is a starting point, but real validation only comes through controlled testing. The group collectively argues that the vast majority of ideas circulating in the SEO space are either outdated or outright ineffective, and that rigorous testing is the only reliable way to separate signal from noise.
Additional themes touched on throughout the episode include schema testing, transactional page optimization, user intent, LLM visibility, Google Business Profile ranking factors, and localisation strategies. The panelists share their philosophy on group size, stressing that a small, trusted cohort of active testers is far more valuable than a large community prone to leaks and passive participation. The episode paints a clear picture of how serious SEO professionals operate behind the scenes to stay ahead of Google updates and AI-driven changes in search.
“Most of what I encounter in the SEO space is nonsense. Once you start testing and analysing data, most of what you see gets exposed for the garbage that it is.”
— Paul Truscott
Who Are the Guests on “SEO Testing and R&D Split Experiments | James Dooley Interviews Panel”?
James Dooley is the host of the Fatrank Podcast and an experienced SEO professional and entrepreneur. He organises and leads the private WhatsApp testing group discussed in this episode, bringing together practitioners to share and validate SEO experiments. Dooley is known for his hands-on approach to search marketing and his emphasis on testing over theory.
Mike Lovatt is an SEO practitioner who uses subdomain experiments with different country focuses to isolate and test individual ranking variables. He brings a disciplined, methodical approach to testing and contributes insights on Google's algorithm behavior, including the deliberate ranking fluctuations designed to catch reactive SEOs off guard. Paul Truscott is an SEO professional who joined the private group approximately a year and a half before this recording. He draws on patent research and data analysis to generate testing hypotheses and is candid about the high failure rate of new ideas, likening successful SEO discovery to mining for gold. Luke Bastin rounds out the panel with expertise in enterprise SEO and stakeholder management, explaining how split testing data can be used to secure internal buy-in, justify budget allocation, and strengthen client relationships.
What Are the Key Takeaways From “SEO Testing and R&D Split Experiments | James Dooley Interviews Panel”?
Here are the key points discussed in this episode:
- Private SEO testing groups consistently surface more current and actionable ranking insights than public conferences, which typically share discoveries that are already years old.
- Testing SEO variables in isolation is essential for drawing valid conclusions, and small, trusted groups allow practitioners to multiply the number of experiments they can run simultaneously.
- Patience is a critical component of SEO testing because Google deliberately introduces temporary ranking drops to identify and discourage reactive changes by SEOs.
- The overwhelming majority of SEO ideas, perhaps 90 percent or more, will not produce meaningful results, so continuous experimentation is necessary to find the rare insights that do work.
- Data-backed split test results are a powerful tool for gaining stakeholder buy-in in enterprise environments, making it easier to secure budget approval and build lasting client trust.
“Here is the data going back to 2024. Here are the graphs. Here is what we did. Here is how we know it works. Here is the financial impact.”
— Luke Bastin
Is “SEO Testing and R&D Split Experiments | James Dooley Interviews Panel” Worth Listening To?
This episode is worth listening to because it offers a rare, candid look at how serious SEO professionals actually develop and validate their strategies, away from the noise of public conferences and recycled online content. The panelists speak openly about failure rates, the dangers of acting on unverified SEO advice, and the specific mechanics of how they design and run controlled experiments. The conversation around Google's deliberate ranking fluctuations and why patience matters is particularly insightful and not often discussed so directly in public forums.
What makes this episode especially valuable is the breadth of perspectives it brings together. Mike Lovatt's subdomain testing methodology, Paul Truscott's patent-informed hypothesis generation, and Luke Bastin's focus on using test data for enterprise stakeholder management each add a distinct and practical layer to the discussion. Whether you are an independent SEO consultant trying to sharpen your edge or an agency professional looking to improve client retention through demonstrable results, this conversation provides a genuinely useful framework for thinking about research, experimentation, and the discipline required to stay competitive in a rapidly changing search landscape.
Who Should Listen to “SEO Testing and R&D Split Experiments | James Dooley Interviews Panel”?
This episode is ideal for:
- SEO professionals who want to move beyond conference-circuit knowledge and develop proprietary ranking insights through structured experimentation
- Agency owners and consultants looking to use split test data to improve client trust, secure budget approval, and demonstrate measurable results
- Enterprise marketing teams navigating internal stakeholder management and needing data-backed narratives to justify SEO investments
- Independent digital marketers and entrepreneurs who manage their own sites and want a rigorous, methodical approach to testing Google ranking factors
Where Can You Listen to Fatrank Podcast?
You can listen to Fatrank Podcast on all major podcast platforms:
- Apple Podcasts – Search for “Fatrank Podcast” in the Podcasts app
- Spotify – Available on Spotify for free
- Amazon Music / Audible – Listen through your Amazon account
- Overcast – For iOS users who prefer a dedicated podcast app
- Pocket Casts – Cross-platform podcast player
You can also subscribe using the RSS feed: https://feeds.transistor.fm/fatrank-podcast
What Are Listeners Saying About This Episode?
“The discussion around Google deliberately dropping rankings to catch SEOs who panic and revert changes was eye-opening. It reframed how I think about volatility in my own campaigns. Really honest and practical conversation throughout.”
“Luke's point about using split test data to get buy-in from enterprise stakeholders is something I wish I had heard two years ago. It perfectly captures the challenge of getting things approved in large organisations and offers a clear solution.”
“Paul's gold mining analogy stuck with me. Accepting that 90 percent of your ideas won't work and building a testing culture around that reality is genuinely useful advice. This is the kind of SEO content that actually moves the needle.”
James Dooley: SEO testing. The importance of doing R&D, split tests and experiments, in my opinion, is one of the most important ways to stay ahead of the curve in the SEO community.
Today I'm joined by Mike Lovatt, Paul Truscott and Luke Bastin, and we're all part of a private WhatsApp group where we're continuously arguing, debating, playing devil's advocate with each other, and working out what actually works in today's algorithms. In my opinion, I think it is one of the most important things to do. But Mike, why do you think SEO testing and being part of a group where you can share results is important for SEO?
Mike Lovatt: You always need to have an edge. You always want to be top of Google.
If you're just sitting there doing nothing, then you're going nowhere. If you go to a conference or something like that, they're not going to tell you something that is absolutely breaking news. It is going to be something they figured out a couple of years ago, and only now are they sharing it with the wider community. Whereas, if you're in a small testing group, you're more likely to get secrets because you're probably not in the same niches. You know what is working. There are only so many things you can test at once yourself because you need to test things in isolation. By being part of a small group, it is hugely important that if you want to get some secrets from other people, you have to test things for yourself. One thing I was doing was testing on small subdomains with different country focuses. People work with clients and their own big brands, and they do not want to go and make a huge change to a site all at once. I have some small subdomains with different country focuses where I test one thing at a time and see if it results in a positive increase. You also need the patience to wait and see those changes play out because Google baked it into the algorithm years ago to catch SEOs out. Sometimes they drop a page for no reason just to see if we panic and change it back straight away.
James Dooley: The whole random ranking factors and the Google Dance that people talk about.
I completely agree with what you're saying, Mike. It is difficult for one person to test everything, and having that corroboration where you can bounce ideas off each other is important. I also think it is really important that every person in the group is actively doing split tests. Sometimes you can end up with leeches within a group who sit back, take all the information and do not push boundaries or provide value for others. Paul, what about yourself? Why is SEO split testing important? Why do you not get the real knowledge at SEO conferences, and why does it feel like outdated information compared to what is working in today's algorithms? You are part of our group. Do you enjoy bouncing ideas off each other?
Paul Truscott: I'm not just saying this because we're recording, but joining that group has probably been the most important thing for me over the last year and a half.
It is a group of great people doing great work. When you share openly like that, because you trust one another and know the information stays within the group, you discover things you otherwise would not discover on your own unless you had a very large team. Even with a large team, you are limited by the ideas you can come up with yourself. In a group, you do not want it too big because then you inevitably get leaks. I think what you've created is a really good size because there is a core group of people with strong ideas who actively test and share what they are finding. It is really important because when you go to conferences, buy courses or consume online content, you are usually getting outdated ideas. At worst, you are getting complete nonsense that never worked in the first place. Most of what I encounter in the SEO space is nonsense. Once you start testing and analysing data, most of what you see gets exposed for the garbage that it is. There is no substitute for testing and sharing ideas because it is the only way you can properly validate things. Reading patents and information grounded in some truth is important because it gives you ideas, but then you have to go away and test whether it actually works. I would say 90% or more of the ideas I come up with do not work. They have no utility or value. You have to keep testing to find those nuggets that do work. It is like mining for gold. If you just listen to everyone else about where the gold is, they are probably not going to show you where it actually is. You have to go and find it yourself.
James Dooley: For sure. Luke, is there anything you think we have missed?
Luke Bastin: One of the biggest values I see in split testing is from a persuasion and stakeholder management perspective, especially when you have enterprise clients.
Sometimes you need to convince three or four different people within the same organisation to get things approved. Testing becomes really important because you are bringing them a case study and a data-backed narrative explaining why something should be done. Sometimes you need budget approval, and that means another team does not get that budget because it is a zero-sum game. If you can go to them and say, “Here is the data going back to 2024. Here are the graphs. Here is what we did. Here is how we know it works. Here is the financial impact,” then it becomes much easier to get buy-in. Your relationships with clients and stakeholders become much stronger because you become the person who gets results. The only reason you become that person is because you secured the buy-in needed to implement the work in the first place. From a sales perspective, split testing is incredibly valuable.
Creators & Guests
Host
James Dooley is the founder of FatRank which is a UK lead generation company. James Dooley is the current CEO of FatRank that provides high-quality leads for UK business owners.
Guest
Mike Lovatt is a UK SEO specialist and digital entrepreneur based in France, specializing in the intersection of semantic SEO and AI-assisted content production. He is the founder of M&B…