A/B Testing Prices on Shopify: What Works, What Breaks, and What to Do Instead
A classic price A/B test compares two prices, waits, and stops. Where that breaks on Shopify, and how continuous testing of several prices finds the most profitable one.
Short answer: you can A/B test prices on Shopify, but a classic test compares only two prices, needs a lot of traffic, and stops once it calls a winner. A better approach for most stores is continuous testing: several prices stay live, traffic shifts toward the ones earning the most profit per visitor, and a new set is tested when demand moves.
How a Classic Price A/B Test Works
Half your visitors see price A, half see price B. After enough orders, you compare the two and keep the winner. In theory it is the most scientific way to set a price. In practice it runs into four problems.
Where Classic Price Tests Break
1. They need a lot of traffic
Price effects are subtle. A 5 to 10% price change might move conversion by only a point or two, so a fixed 50/50 split needs thousands of visitors per price, per product, to reach a confident answer. On a page with 500 visits a month, that can take months, and by then demand has moved.
2. Shoppers can watch prices change
The real trust risk is not that two shoppers see different prices; that is how every test works. It is a single shopper seeing $49 today and $59 tomorrow. If a test cannot hold each shopper's price across visits, cart, and checkout, it will cost you trust.
3. One test at a time
Someone has to design each test, run it, read it, and set up the next. Across a 200-product catalog, that is a full-time job that never finishes.
4. Two prices, one answer
A/B tells you which of two prices won. Maybe the best price was in between, or above both. Finding out means another test. And the winner goes stale as soon as demand shifts.
The Alternative: Continuous Multi-Price Testing
- Several prices at once: up to five per product in Rylo, inside your min and max
- Traffic follows the evidence: stronger prices get more visitors, so less traffic is spent on losing prices
- The right score: profit per visitor against your original price, not conversion rate or revenue
- Every product with enough traffic, at the same time, without anyone designing the next test
- It adapts: when demand moves, Rylo moves to a new set of prices
- Each shopper keeps the price they saw: the Price Promise holds it on the product page, in the cart, and at checkout
Continuous testing still needs traffic. Products without enough of it stay at your price instead of being moved on thin evidence.
When a Classic A/B Test Still Makes Sense
- A one-time decision, like setting the launch price for a new product line
- A small number of hero products with very high traffic
- A question that is not about price level, like testing a bundle against single units
For the ongoing job of keeping every product at its most profitable price, continuous testing does the work a classic A/B test cannot keep up with. See how Rylo runs it on a catalog.