Loopcraft Test plan, Queue 2 direction, state “default”, with example data for the fictional brand Sundays

SSundaysExampleSearch ads, briefs or askK
$900 of $1,500 in Oct1,240 creditsMO
EscQueueTest 2 · The weekend swap or the taste?
  1. Brief
  2. Ads
  3. Plan
  4. Live
  5. Result
2 of 6 in queueKJ

Do more people add to cart when we sell the weekend swap instead of the taste?

Plan· waiting for your approval of $600 · drafted from the test you accepted Oct 15

FromTest 1: taste beat mood, +11% to +31%67 of 214 reviews: a weekend drink instead of alcohol4 of 9 long-running competitor ads sell a swap
ATaste message· control
Sundays draft: the can on a stone block beside a yuzu in warm light, headline “Real yuzu, lightly sweet.”
Afternoon light
Sundays draft: a paper collage of the can with lemons on pink and blue, headline “Real yuzu, lightly sweet.”
Pink collage
BSwap message· new
Sundays draft: a hand taking the can from a full fridge, headline “Your weekend drink. No alcohol.”
Fridge grab
Sundays draft: the can on a green tablecloth by a window, headline “Your weekend drink. No alcohol.”
Window light

Two pictures a side, so a win is about the message, not one picture.

Type
Concept test · 2 flexible ads, 2 pictures each
Pictures
Meta picks one for each person
Split
Meta A/B test · each person sees one side
Settings
The same Advantage+ settings on both sides
Where
Facebook and Instagram feeds · US, 21–45
How long
Oct 17 – Oct 30 · 14 days · two full weekends
Budget
$300 per side · about $21 a day each

Spend limit

Hard stop
$600$300 per side, each stops on its own
After: $1,500 of $1,500 in Oct

Judged by

Set before launch
Cost per add to cartspend ÷ adds to cart, side by side

The deepest step with enough volume: about 60 a side at $5 each.

Clues
Click rate, and hook rate for video · never the judge
Guardrail
Purchases · too few at this spend to judge

How sure

Illustrative

This plan can spot a gap of 1.6× or more in cost per add to cart, such as $5.00 against $3.15. Smaller gaps read as unclear.

Other ways to spend on this test, and the smallest gap each can spot
Per sideAdds to cartCan spot
$200401.7×Cheaper, only bigger gaps
$300601.6×This plan
$450901.5×$300 over October’s cap

80% chance to catch a gap that size; 5% chance of a false alarm.

What it will narrow

Illustrative
Swap vs taste · cost per add to cart53 → 44 pts
  • Before your test: outside evidence
  • Expected after this test

Decision rule, set before launch

Shown unchanged at the result
  1. WinAdds to cart cost clearly less with the swap: its whole range is better than the taste.New ads, the shop page and emails lead with the swap.
  2. DropThey cost clearly more: its whole range is worse than the taste.The swap becomes a second line, not the lead.
  3. UnclearThe range still crosses zero on Oct 30. Gaps under about 1.6× often end here.The taste stays the lead. Loopcraft records what was ruled out; no rerun.

Results stay hidden until Oct 30. Loopcraft stops early only for a broken guardrail or the spend limit.

Guardrails

If one breaks, Loopcraft asks you
  • Purchasesthe winning side must not sell clearly less
  • Pictures in a sideeach gets 25% or more of its side’s views
  • Same person seeing itunder 2.5 times on average
  • Brand checks5 of 5 passed on all four pictures