Stop guessing. Let your customers pick the winner.
Test up to seven versions of an email or text on a small group. SmartyTap picks the winner by opens, clicks or orders and sends it to everyone else.
- versions in one test
- 7
- versions in one test
- winner sent to everyone else
- Auto
- winner sent to everyone else
- test length you choose
- 1-72 h
- test length you choose
In short
What is A/B testing?
A/B testing sends different versions of a message to a small group, measures which does best, and sends the winner to everyone else. In SmartyTap, each version is a whole email or text, and you choose whether open rate, click rate or placed order rate decides.
The problem
Every subject line is a guess until someone reads it. Without a test, a weak message goes to your whole list, and you learn nothing you can use next time. SmartyTap tries your ideas on a small group first, so the best one reaches everyone else and the next campaign starts ahead.
Everything you need to sell more.
Up to seven versions
Change the subject line, preview text or content. Each version is a full email or text.
An automatic winner
When the test ends, the best version goes to everyone who wasn't in it.
Three ways to win
Pick the winner by open rate, click rate or placed order rate.
You set the test
Choose a test size from 10% to 100%, and a test length from 1 to 72 hours.
Call it early
Don't want to wait? Send any version to everyone else from the test results.
Texts too
Duplicate a text, change the wording and test it, with placed order rate deciding.
How it works.
- 1
Create the test
Open a message and click Create A/B test.
- 2
Add your versions
Change one thing if you want to know what made the difference.
- 3
Set the rules
Choose the test size, how to pick the winner and how long to wait.
- 4
Schedule it
SmartyTap runs the test and sends the winner when time is up.
The details that make a test useful.
A short list of how SmartyTap handles the awkward cases.
A tie
If the results tie, Version A goes to everyone else.
A 100% split
Set the test size to 100% and everyone gets one of the versions, with no winner sent. Good for comparing across your whole audience.
Time zones
A test that picks a winner sends at one time. Use a 100% split to compare versions and still send in each recipient's local time.
One message per person
People in the test get one version, and only people outside it get the winner. Messages from the same campaign don't count toward Smart Sending.
What to test first
See what to test, how big to go and common mistakes in our guide to email A/B testing.
Step by step
Every setting is explained in the A/B tests docs.
Which number should pick the winner?
Match the number to what you changed.
| Pick the winner by | Use it when testing | Starting test length |
|---|---|---|
| Open rate | Subject lines and preview text. Email only. | 6 hours |
| Click rate | Content and offers. Needs link tracking on. Email only. | 6 hours |
| Placed order rate | Offers, when you have enough orders to tell versions apart. Email and texts. | 24 hours |
Open rate
- Use it when testing
- Subject lines and preview text. Email only.
- Starting test length
- 6 hours
Click rate
- Use it when testing
- Content and offers. Needs link tracking on. Email only.
- Starting test length
- 6 hours
Placed order rate
- Use it when testing
- Offers, when you have enough orders to tell versions apart. Email and texts.
- Starting test length
- 24 hours
SmartyTap compares whole versions. It doesn't run multivariate tests that measure each change separately.
AI help
Campaign Agent
Drafts the extra versions you want to test, from subject lines to whole emails.
More versions to test, less time writing.
What you get.
Better campaigns
Most of your audience gets the version that already proved itself.
Lessons that stick
Results sit with the campaign, so the next one starts from what worked.
No extra work
The test runs and the winner goes out without anyone pressing send.
Turn more first-time buyers into regulars.
Email, texts, forms, automations, customer data and AI, working together in one app.
- Email + texts
- Migration help
- Inbox setup
Common questions
Sending different versions of a message to a small group, measuring which does best and sending the winner to everyone else. In SmartyTap, you choose whether open rate, click rate or placed order rate decides.
Up to seven, for an email or a text. Each version is a full message.
You choose the number that decides and the test length, from 1 to 72 hours. When time is up, the best version goes to everyone who wasn't in the test. If results tie, Version A goes out.
Yes. Text tests use placed order rate, because phones don't report opens.
No. SmartyTap compares whole versions. Change one thing at a time if you want to know what made the difference.
Starter is $20 a month with 2,500 contacts, 25,000 emails and 250 SMS credits/segments. Pro is $199 a month, or $1,990 a year, with 25,000 contacts, 250,000 emails and 2,500 SMS credits/segments. New workspaces need a paid plan to send.
Explore more SmartyTap features.
