--- title: "A/B Test Emails and Texts - SmartyTap | Chargezen" description: "Test up to seven versions of an email or text on a small group. SmartyTap picks the winner by opens, clicks or orders and sends it to everyone else." url: "https://chargezen.com/smartytap/ab-testing" lang: "en" --- Canonical URL: https://chargezen.com/smartytap/ab-testing # Stop guessing. Let your customers pick the winner. Test up to seven versions of an email or text on a small group. SmartyTap picks the winner by opens, clicks or orders and sends it to everyone else. [Start SmartyTap](https://admin.chargezen.com/signup?product=smartytap) versions in one test 7 versions in one test winner sent to everyone else Auto winner sent to everyone else test length you choose 1-72 h test length you choose In short ## What is A/B testing? A/B testing sends different versions of a message to a small group, measures which does best, and sends the winner to everyone else. In SmartyTap, each version is a whole email or text, and you choose whether open rate, click rate or placed order rate decides. The problem Every subject line is a guess until someone reads it. Without a test, a weak message goes to your whole list, and you learn nothing you can use next time. SmartyTap tries your ideas on a small group first, so the best one reaches everyone else and the next campaign starts ahead. ## Everything you need to sell more. ### Up to seven versions Change the subject line, preview text or content. Each version is a full email or text. ### An automatic winner When the test ends, the best version goes to everyone who wasn't in it. ### Three ways to win Pick the winner by open rate, click rate or placed order rate. ### You set the test Choose a test size from 10% to 100%, and a test length from 1 to 72 hours. ### Call it early Don't want to wait? Send any version to everyone else from the test results. ### Texts too Duplicate a text, change the wording and test it, with placed order rate deciding. ## How it works. 1. 1 ### Create the test Open a message and click Create A/B test. 2. 2 ### Add your versions Change one thing if you want to know what made the difference. 3. 3 ### Set the rules Choose the test size, how to pick the winner and how long to wait. 4. 4 ### Schedule it SmartyTap runs the test and sends the winner when time is up. ## The details that make a test useful. A short list of how SmartyTap handles the awkward cases. ### A tie If the results tie, Version A goes to everyone else. ### A 100% split Set the test size to 100% and everyone gets one of the versions, with no winner sent. Good for comparing across your whole audience. ### Time zones A test that picks a winner sends at one time. Use a 100% split to compare versions and still send in each recipient's local time. ### One message per person People in the test get one version, and only people outside it get the winner. Messages from the same campaign don't count toward Smart Sending. ### What to test first See what to test, how big to go and common mistakes in our [guide to email A/B testing](https://chargezen.com/blog/email-ab-testing). ### Step by step Every setting is explained in the [A/B tests docs](https://chargezen.com/docs/smartytap/campaigns/ab-tests). ## Which number should pick the winner? Match the number to what you changed. ### Open rate Use it when testing Subject lines and preview text. Email only. Starting test length 6 hours ### Click rate Use it when testing Content and offers. Needs link tracking on. Email only. Starting test length 6 hours ### Placed order rate Use it when testing Offers, when you have enough orders to tell versions apart. Email and texts. Starting test length 24 hours SmartyTap compares whole versions. It doesn't run multivariate tests that measure each change separately. AI help ## Campaign Agent Drafts the extra versions you want to test, from subject lines to whole emails. More versions to test, less time writing. ## What you get. ### Better campaigns Most of your audience gets the version that already proved itself. ### Lessons that stick Results sit with the campaign, so the next one starts from what worked. ### No extra work The test runs and the winner goes out without anyone pressing send. ## Turn more first-time buyers into regulars. Email, texts, forms, automations, customer data and AI, working together in one app. [Start SmartyTap](https://admin.chargezen.com/signup?product=smartytap) [Back to SmartyTap](https://chargezen.com/smartytap) * Email + texts * Migration help * Inbox setup ## Common questions ### What is A/B testing in email marketing? Sending different versions of a message to a small group, measuring which does best and sending the winner to everyone else. In SmartyTap, you choose whether open rate, click rate or placed order rate decides. ### How many versions can I test? Up to seven, for an email or a text. Each version is a full message. ### How does SmartyTap pick the winner? You choose the number that decides and the test length, from 1 to 72 hours. When time is up, the best version goes to everyone who wasn't in the test. If results tie, Version A goes out. ### Can I A/B test texts? Yes. Text tests use placed order rate, because phones don't report opens. ### Does SmartyTap run multivariate tests? No. SmartyTap compares whole versions. Change one thing at a time if you want to know what made the difference. ### How much does SmartyTap cost? Starter is $20 a month with 2,500 contacts, 25,000 emails and 250 SMS credits/segments. Pro is $199 a month, or $1,990 a year, with 25,000 contacts, 250,000 emails and 2,500 SMS credits/segments. New workspaces need a paid plan to send. ## Explore more SmartyTap features. [ ### Campaigns A/B tests, Smart Sending and UTM tracking in one send.](https://chargezen.com/smartytap/campaigns) [ ### Reports Read test results next to everything else.](https://chargezen.com/smartytap/reports) [ ### Email templates Start every version from a layout you trust.](https://chargezen.com/smartytap/email-templates) [ ### Email A/B testing guide What to test first, and how to pick a winner.](https://chargezen.com/blog/email-ab-testing) [ ### A/B tests docs Every setting, step by step.](https://chargezen.com/docs/smartytap/campaigns/ab-tests) [ ### Glossary: A/B test What it is, and when it tells you something.](https://chargezen.com/glossary/ab-testing)