E Commerce Podcast Logo

You Probably Don’t Need A/B Testing | Oliver Palmer

Today’s Guest Oliver Palmer

Here's a summary of the great stuff that we cover in this show:

  • A/B testing involves simultaneously implementing different approaches, measuring results, and determining the most effective one, commonly used in Conversion Rate Optimization (CRO).
  • Despite its popularity, businesses often default to A/B testing without assessing its necessity, driven by industry success stories and a fear of falling behind, even though actual success rates are relatively low (5-10%).
  • User research is promoted as a more effective alternative to A/B testing, providing insights into user behavior, needs, and motivations. It is considered cost-effective, less time-consuming, and more likely to lead to sustainable success.
  • The need for minimum traffic for meaningful A/B testing depends on statistical factors, with larger traffic volumes being more conducive to productive testing. A/B testing calculators can help determine the optimal duration of experiments.
  • The "Holy Trinity" of optimization comprises User Research, A/B Testing, and Analytics. Analytics tools like Google Analytics are crucial for understanding user behavior, and a balanced approach, considering factors like traffic volume, should guide decision-making.


Links & Resources from today’s show

Sponsor for this episode

At the eCommerce Cohort, we're committed to helping you deliver eCommerce WOW through our lightweight, guided monthly Sprint that cycles through all the key areas of eCommerce.

What happens in a Sprint?

Just like this eCommerce Podcast episode, each Sprint is themed-based. So using this topic of Everything You Need To Know About Subscription eCommerce as an example - here's how it would work:

  • Sprint Theme: Marketing.
  • Week One: Coaching Session -> Marketing.
  • Week Two: Expert Workshop -> Everything You Need To Know About Subscription eCommerce.
  • Week Three: Live Q&A with our experts and coaches. This is a time to ask questions and contribute your thoughts and ideas so we can all learn together.
  • Week Four: Submit your work for feedback, support, and accountability. Yup, all of this is to provide you with clear, actionable items you can implement in your eCommerce business or department! It's not about learning for the sake of learning but about making those constant interactions that keep you moving forward and ahead of your competitors. Sharing your work helps cement your understanding, and accountability enables you to implement like nothing else!

Who can join the eCommerce Cohort?

Anyone with a passion for eCommerce. If you're an established eCommercer already, you'll get tremendous value as it will stop you from getting siloed (something that your podcast host, Matt Edmundson, can attest to!).

If you're just starting out in eCommerce, we have a series of Sprints (we call that a Cycle) that will help you get started quicker and easier.

Why Cohort

Founder and coach Matt Edmundson started the Cohort after years of being in the trenches with his eCommerce businesses and coaching other online empires worldwide. One of Matt's most potent lessons in eCommerce was the danger of getting siloed and only working on those areas of the business that excited him - it almost brought down his entire eCommerce empire. Working on all aspects of eCommerce is crucial if you want to thrive online, stay ahead of your competitors and deliver eCommerce WOW.

Are you thinking about starting an eCommerce business or looking to grow your existing online empire? Are you interested in learning more about the eCommerce Cohort?

Visit our website www.ecommercecohort.com now or email Matt directly with any questions at [email protected].

Matt has been involved in eCommerce since 2002. His websites have generated over $50m in worldwide sales, and his coaching clients have a combined turnover of over $100m.