Guides

How Priceify tests stay safe and statistically valid.

Settings holds two choices — confidence level and minimum visitors per variation. Everything else runs on a fixed limit, and each guide below says what that limit is and where you meet it. Info icons in Admin open the matching section here.

Updated September 15, 2026

PRICE SAFETY

The fixed limits every test price is built against.

What you set, and what is fixed

Settings holds two choices: confidence level and minimum visitors per variation. Everything else that shapes a test is either fixed at a value you cannot edit, or set on the test itself rather than shop-wide. This section is the map of which is which.

Shop-wide and editable
Confidence level, minimum visitors per variation
Set per test
Revenue guardrail, traffic, audience, goals
Fixed, not editable
The price and planning limits below
Stamped at launch
All of them

Max price change

The widest a test price may move from the current catalog price, fixed at 15%. It is a hard cap on the band you type and on every price AI Suggest fills. The Products step is where you meet it, and where you can raise it in one click, up to 30%.

Value
15%, unless your store raised it
Ceiling
30%
Where you meet it
Create → Products step
Applies to
The typed band and every suggested price

Cost floor: min margin and assumed COGS

A second limit under max price change, so a suggested price never lands near cost. Margin must stay above 35%, measured from the product’s unit cost in Shopify — or, when there is no unit cost, from an assumed cost of 55% of price. Neither figure is a field, and neither pauses a live test.

Min margin
35%
Assumed cost
55% of price, when unit cost is unknown
Runs at
Plan build and AI Suggest
Live pause rule
No — only the revenue guardrail stops a live test

AI PRICING

How Suggest picks a test price.

AI price suggestions

On the Products step, Suggest fills a test price for every product in the variation you are on, inside a min–max band you set for that variation. Control stays at the catalog price, and every suggestion is still capped by your price safety settings.

Where
Create → Products step
Direction
Higher, lower, or AI decides
Band
Percent or dollar amount
Hard cap
Shop max price change
Rounding
Real price points, e.g. $43.99
Editable
Any cell, before launch

What the AI sees, and what it is told

Suggest sends every product you selected to the AI, 20 products to a request, with a few numbers about each, your two price safety limits, and a short list of rules. No customer data, no order records, no shop name, and nothing is stored or reused.

Provider
OpenAI, JSON-only reply
Per click
Every selected product, up to 500
Sent about a customer
Nothing
Time limit
About 40 seconds, then the even spread
Stored by Priceify
Nothing — every click is fresh

STATISTICS

The two settings you choose, and how a winner is called.

Confidence level

How sure the maths has to be before a variation is called the winner. 90% accepts about a 1-in-10 chance of a false winner and is the recommended default; 95% is stricter but needs more traffic and more orders to reach.

Where
Settings → Results settings
Options
90% (default) or 95%
Applies to
Tests launched from then on
Acts as
The second gate, after the sample floors

Minimum visitors per variation

The earliest point a result may be read. Until every variation reaches this many visitors, nothing is calculated — no confidence figure, no winner, no automatic price write. A second floor of 100 conversions per variation applies too, and both must be met.

Where
Settings → Results settings
Default
5,000 visitors per variation
Range
1 to 1,000,000
Measured on
The variation with the fewest visitors
Second floor
100 conversions per variation
Planning inputs
10% target lift, 80% power — both fixed

Minimum conversions per variation

The second floor a result has to clear: 100 conversions in every variation, however many visitors it has seen. There is no field for it, because a confidence figure read below it would be wrong rather than merely early.

Value
100 conversions per variation
Absolute minimum
10, whatever else is configured
Editable
No field — it is a validity floor
Measured on
The variation with the fewest orders

Primary success metric

The Audience step picks the one metric the test is judged on: revenue per visitor, conversion rate, or average order value. Revenue per visitor is the default and answers the commercial question; conversion rate is the only metric an automatic price write will act on.

Where
Create → Audience step
Primary choices
Revenue per visitor, conversion rate, or average order value
Default
Revenue per visitor

Traffic split

On Variations, each arm gets a share of assigned visitors. Those shares must add up to 100%. Control is the catalog baseline. Use Split evenly for an equal test, or give a challenger more traffic when you already have a strong hypothesis.

Sequential evidence and winner review

Results are read with a sequential boundary, so you may check a running test as often as you like without inflating false positives. Two layers do the work: a directional one covering every metric, and an exact one for conversion rate.

Directional layer
Mixture-SPRT, all metrics
Confirming layer
Exact, conversion rate only
Peeking
Safe — no penalty for checking early
Scope
Each product decides on its own

When a price is written automatically

Off unless your store turns it on. When on, a winning price is written to your catalog only after every condition holds — including a conversion-rate goal, exact confirmation, 14 days of running, and a three-day review window you can interrupt.

Default
Off, and there is no switch to turn it on
Metric
Conversion rate only
Minimum duration
14 days
Review window
3 days after you are emailed
Never applies
Revenue-per-visitor results

Product performance and ready-to-apply alerts

A test covering ten products is ten independent tests that finish at different times. The Overview tab shows Product performance by variation so you can apply a finished product without ending the rest of the test.

Where
Test → Overview tab
Granularity
One row per product
Actions
Apply a row, or apply all ready
Never offered
Products the revenue guardrail stopped
Alerts
Emailed once per product

Follow-up rounds

When a product finishes a round, Priceify may queue a second test for it — as a draft you review and launch, never as a live test. Up to three rounds per product, so a product cannot iterate on its own price indefinitely.

Queued as
A draft, on your tests list
Launches itself
Never
Cap
Three rounds per product
Uses
The settings current when you launch it

ENFORCEMENT

What stops a product, and what blocks Apply winner.

Revenue guardrail: the max revenue drop that stops a product

Checked product by product. Once each variation of a product has about 100 visitors, Priceify stops testing that product if any variation’s revenue per visitor is down on its control by more than the percent you set. The other products keep running. Each test sets its own figure, starting at 10%.

Where
Create → Audience step, per test
Default
10%
Range
3% to 50%
Starts checking at
~100 visitors per variation
Scope
Each product on its own
Effect
Stops that product; the rest keep running

Traffic split checks

Priceify continuously checks that visitors actually reached the variations in the proportions you set. A sample ratio mismatch is a data fault rather than a close result, so it blocks Apply winner instead of merely warning you.

Test
Chi-square against your allocation
Threshold
p < 0.001
Effect
Blocks Apply winner and automatic writes
Common causes
Bots, page caching, early assignment

OFFER TESTS

How offer prices show on the product page and at checkout.

Offer tests

Test a discount instead of a new list price. Control stays at the catalog price with no discount, assigned shoppers see a sale cutout on the product page, and checkout applies the discount through the Priceify checkout function.

Where
Create → Products step
One offer
Per test variation
Control
Catalog price, no discount
Requires
Checkout pricing functions on Store setup

PRICE LOCATIONS

Where a test price is painted on your storefront.

Price locations

A table of rows, each saying where one price appears: a page, which price type it is, and the theme selector that finds it. A running test repaints exactly these and nothing else. Auto-detect prices fills the table from your theme; Pick on site lets you click the price on your live storefront instead.

Where
Settings → Price locations
Applies to
Every price test on the shop
Limit
25 rows
Required
Product page, regular price

Global JS/CSS

Plain CSS and JavaScript—the same shape as visual editor rules—run on every storefront page. Errors are checked when you save.

Where
Settings → Global JS/CSS
JavaScript
window, document, Shopify, RipX, location
CSS
Injected in the document head

Guides FAQ

Quick answers while you read the guides above.

No. Every value a test is judged against is stamped on it at launch. Change confidence or minimum visitors per variation in Settings and the next test you launch picks them up; the revenue guardrail lives on the test itself, so edit it there.

Ready to test a price?
Install Priceify on your store.

Shopify Admin info icons link straight to these guides. Install free, run one test, and open any section when a limit needs explaining.

14-day free trial · No credit card · Uninstall in one click · Back to Priceify · Contact