How we know it worked
A number going up is not the same as a change working. Before we call anything a result, it has to pass the same four checks, whichever way the number moved.
The four checks
The checks run on every change, good news or bad. A change that fails one is still recorded, but it is never reported as a result.
Check one
The starting reading is taken before the change goes live, from the same report we read afterwards. A baseline pieced together later does not count.
Check two
Only one change can be live on a path at a time. When two things change together, neither can take the credit, so the second one waits.
Check three
Both readings carry their date range and where they came from, such as the store platform or the menu report. A number without dates is left out.
Check four
Every row lists anything else that could have moved the number that week: a promotion, a holiday, a change in where visitors came from. You judge the result with all of it in view.
When it does not count
Some changes make no difference, and a few make things worse. Each outcome has a set path, so a disappointing week is recorded rather than quietly dropped.
No movement
If the number holds steady through the reading window, the row says so and the next item on the list goes live.
Worse
A change that hurts the number comes out, and its row stays in the ledger with the drop written down.
Unclear
When something else clearly moved the number that week, the window is extended or the change is tried again later.
Direct answers
Short answers to what people ask most about how a result gets judged.
Answer
Not quite. A split test shows two versions to separate groups at the same time, which needs a lot of traffic. Most stores and business sites do not have enough, so we change one thing, compare it with the baseline, and record what else happened in the window.
Answer
We set the reading window before the change goes live, based on how many orders or inquiries the path sees. Choosing it afterwards would let anyone stop the clock on a good week.
Answer
The change comes out, the row stays in the ledger, and the drop is reported the same way a gain would be. A record that only keeps wins is not measuring anything.
Next step
The free plan names what to fix first, and every AI System Build starts with the baseline written down.
Build my AI system