{"article":{"id":4523165348626,"url":"https://sendinblue.zendesk.com/api/v2/help_center/en-us/articles/4523165348626.json","html_url":"https://help.brevo.com/hc/en-us/articles/4523165348626-Create-an-A-B-test-campaign","author_id":391957702439,"comments_disabled":false,"draft":false,"promoted":false,"position":1,"vote_sum":19,"vote_count":97,"upvote_count":58,"downvote_count":39,"section_id":202146509,"created_at":"2022-03-04T10:39:26Z","updated_at":"2026-10-08T11:28:11Z","name":"Create an A/B test campaign","title":"Create an A/B test campaign","source_locale":"en-us","locale":"en-us","outdated":false,"outdated_locales":[],"edited_at":"2026-04-07T08:53:12Z","user_segment_id":null,"permission_group_id":114904,"content_tag_ids":[],"label_names":["banner_std+"],"body":"<p>When it comes to contact engagement, even <strong>small variations</strong> to your newsletters can have a <strong>big impact</strong>. A/B testing campaigns help you <strong>learn what works best for your contacts</strong> (and what doesn't).</p><p>Brevo allows you to run A/B test campaigns on your <a href=\"#2\" target=\"_self\">email subject lines or content</a>.</p><h1 id=\"1\">❓What is an A/B test campaign?</h1><p>An A/B test campaign (or split test campaign) allows you to <strong>test two different variations of an email campaign</strong> (A or B) with a portion of your recipient list. The \"winning\" or <strong>most successful variation</strong> of your campaign will be <strong>sent to the rest of your audience</strong> to help improve your statistics.</p><p>When creating an A/B Test campaign, you will:</p><ul>\n<li data-list-item-id=\"e6739e5d034685e10344c44475d9bd9a4\">Choose one element to test, such as your email <a href=\"#h_01FWEDAXDGEDS1G336FHJZT4RY\" target=\"_self\" rel=\"undefined\">subject line</a> or <a href=\"#h_01FWEDB2S4CFNNH44NCP60YE9X\" target=\"_self\" rel=\"undefined\">content</a>.</li>\n<li data-list-item-id=\"ee124a37f84cff4d997496b40bf391b80\">Select the sample size of recipients for the test (each variation will be sent to exactly half of the sample).</li>\n<li data-list-item-id=\"ef60bafb2c418dc8ef5174ca0ddc39136\">Choose the method for determining the winner: best open rate or best click rate.</li>\n<li data-list-item-id=\"efa6835fdb82705f16768f47b7f9bd57b\">Set the duration for when the test should run.</li>\n</ul><p>Each recipient in your sample will receive only one of the two variations: version A or version B. After the test period, the winning variation will be selected based on your criteria (open or click rate) and will be immediately sent to the rest of your campaign's recipient list. </p><p>This process ensures the best version of your campaign is sent to the largest group of recipients.</p><h1 class=\"wysiwyg-text-align-left\" id=\"2\">🧪 What elements can you test in A/B test campaigns?</h1><!-- START OF TABS CODE --><div class=\"tabs\">\n<div class=\"tabs-menu\">\n<span class=\"tabs-link is-active\">Subject Lines</span> <span class=\"tabs-link\">Email Content</span>\n</div>\n<div class=\"tab\">\n<figure class=\"wysiwyg-table wysiwyg-table-align-left\" style=\"width: 100%;\"><table style=\"border-collapse: collapse; border-style: none;\"><tbody><tr>\n<td class=\"wysiwyg-text-align-justify\" style=\"border-style: none; width: 25%;\">Email subject lines are the very first thing your recipients will see when receiving your campaign since subject lines are visible to them before they even open your campaign. <br>Research shows that 68% of people open an email based on the subject line alone.</td>\n<td style=\"border-style: none; text-align: center; width: 25%;\"><img src=\"https://help.brevo.com/hc/article_attachments/21013495702546\" alt=\"campaigns_subject-line-view_EN-US.png\" width=\"290\" height=\"255\"></td>\n</tr></tbody></table></figure><p>It is important to use an effective subject line for your campaigns depending on your audience. You can run A/B test campaigns on email subject lines to determine for example if it is more effective to: </p>\n<ul>\n<li data-list-item-id=\"e9c4e031ab04e9681d7b6f94d7129121d\">Use short or long subject lines.</li>\n<li data-list-item-id=\"e8aac305b53e4b3f0de955d2343f16301\">Use punctuation and/or emojis. </li>\n<li data-list-item-id=\"e28be39af53abf26ebb7a10723349396e\">Include personalization (like your contact's first name), a creative teaser, or mention an incentive, etc.</li>\n</ul>\n</div>\n<div class=\"tab is-hidden\">\n<p>You can test different elements in the campaign design itself that could influence or not the conversion of your clients like different section titles, article length, call-to-action buttons, images, and more. You might even test two completely different designs to see which one gets the most clicks.</p>\n<figure class=\"wysiwyg-table wysiwyg-table-align-left\" style=\"width: 100%;\"><table style=\"border-collapse: collapse;\"><tbody>\n<tr>\n<td style=\"background-color: #000000; text-align: center; width: 50%;\"><span style=\"color: #fff;\"><strong>Version A</strong></span></td>\n<td style=\"background-color: #000000; text-align: center; width: 50%;\"><span style=\"color: #fff;\"><strong>Version B</strong></span></td>\n</tr>\n<tr>\n<td style=\"text-align: center; vertical-align: middle; width: 50%;\"><img style=\"border-width: 0; box-shadow: none;\" src=\"https://help.brevo.com/hc/article_attachments/21013533559442\" alt=\"Campaigns_test-version-A_EN-US.png\"></td>\n<td style=\"text-align: center; vertical-align: middle; width: 50%;\"><img style=\"border-width: 0; box-shadow: none;\" src=\"https://help.brevo.com/hc/article_attachments/21013495707154\" alt=\"Campaigns_test-version-B_EN-US.png\"></td>\n</tr>\n</tbody></table></figure>\n</div>\n</div><!-- END OF TABS CODE --><h1 id=\"h_01KH3FCTHC7C3T91Z6N99VMA8P\">Before you start</h1><ul>\n    <li>\n      A/B test campaigns<strong> can only be sent to recipients who have received a campaign from you through Brevo in the past</strong>.\n      It means that you have to send at least one\n      <a href=\"https://help.brevo.com/hc/en-us/articles/4413566705298\" target=\"_blank\" rel=\"noopener\">regular email campaign</a>\n      before sending an A/B test campaign. \n    </li>\n    <li>\n      For statistically relevant test results, you should send your A/B test\n      campaign to <strong>at least 5,000 recipients</strong>.\n    </li>\n    <li>\n      It is impossible to send A/B test campaigns with our Send time optimization\n      tool (<strong>Send at the best time</strong>) \n    </li>\n    <li>\n      Make sure you\n      <a href=\"https://help.brevo.com/hc/en-us/articles/115000719584\" target=\"_blank\" rel=\"noopener\">imported your contacts into Brevo</a>\n      and have your\n      <a href=\"https://help.brevo.com/hc/en-us/articles/4408399178898\" target=\"_blank\" rel=\"noopener\">lists of contacts</a>\n      or\n      <a href=\"https://help.brevo.com/hc/en-us/articles/4411804163090\" target=\"_blank\" rel=\"noopener\">segments</a> ready\n      to be used. \n    </li>\n    <li>\n      Starting in February 2024, Gmail and Yahoo plan to\n      <strong>enforce new sender requirements</strong>. Ensure you comply with\n      these new requirements to keep reaching your recipients' inboxes. To\n      learn more, check our dedicated article\n      <a href=\"https://help.brevo.com/hc/en-us/articles/14925263522578\" target=\"_blank\" rel=\"noopener noreferrer\">Prepare for Gmail and Yahoo's new sender requirements</a>.\n    </li>\n    <li>\n      If you wish to use your own <strong>email template</strong>, make sure\n      it is ready to be used or learn how to\n      <a href=\"https://help.brevo.com/hc/en-us/articles/360019787120\" target=\"_blank\" rel=\"noopener\">create an email template</a>\n      before creating your campaign. <br>\n      <center></center>\n    </li>\n  </ul><h1 id=\"h_01EHW3NV8T81N0FPG2G8Y5YB16\">⚙️ Step 1: Configure your A/B test campaign</h1><p>A/B test campaigns are created in the same way as regular email campaigns but include additional steps to set the test criteria. To create an A/B test campaign:</p><ol>\n    <li>\n      Go to\n      <strong><a href=\"https://app.brevo.com/campaigns/listing/email\" target=\"_blank\" rel=\"noopener\">Marketing &gt; Campaigns &gt; Email</a>.</strong>\n    </li>\n    <li>\n      Click <strong>Create an email campaign</strong>.<strong><br></strong>\n    </li>\n    <li>\n      Click on the <strong>A/B test</strong> tab and fill in the relevant information:\n      <ol>\n        <li>\n          Choose which element you would like to test between\n          <a href=\"#2\" target=\"_self\"><strong>Subject lines</strong> and <strong>Email content</strong></a>.\n        </li>\n        <li>\n          Write a <strong>Campaign name</strong> that will help you find\n          it easily in the list of your campaigns.<br>\n          This name will only be visible to you.\n        </li>\n      </ol>\n    </li>\n    <li>\n      Click <strong>Create A/B campaign</strong><strong><br></strong>\n      <center>\n        <img src=\"https://help.brevo.com/hc/article_attachments/21013495699602\" alt=\"2022-09-30_15-34-19__1_.gif\" width=\"353\" height=\"368\">\n      </center>\n    </li>\n    <li>\n      Choose a sender and recipients from the\n      <a href=\"https://help.brevo.com/hc/en-us/articles/4413566705298#h_01FTWZB04JAJ2FFD9T7S34FBBY\" target=\"_blank\" rel=\"noopener\"><strong>From</strong></a>\n      and\n      <a href=\"https://help.brevo.com/hc/en-us/articles/4413566705298#h_01FTWZAPVP3MST6DVBHZ1912KR\" target=\"_blank\" rel=\"noopener\"><strong>To</strong></a>\n      sections respectively and set\n      <strong><a href=\"https://help.brevo.com/hc/en-us/articles/4413566705298#%F0%9F%95%B9%EF%B8%8F_Advanced_Settings\" target=\"_blank\" rel=\"noopener\">Advanced settings</a></strong>\n      if needed.<br>\n      To learn more, check our dedicated article on how to\n      <a href=\"#h_01EHW3NV8T81N0FPG2G8Y5YB16\" target=\"_blank\" rel=\"noopener\">Configure your campaign</a>.\n    </li>\n  </ol>\n  <!-- START OF TABS CODE -->\n  <div class=\"tabs\">\n    <div class=\"tabs-menu\">\n      <span class=\"tabs-link is-active\">Subject Lines</span><span class=\"tabs-link\">Email Content</span>\n    </div>\n    <div class=\"tab\">\n      <div style=\"border: 0; color: inherit; font-family: inherit; font-size: inherit; margin: 1rem 0; padding: .5rem; background-color: #efeefc; border-left: 3px solid #4f46b2; border-bottom-right-radius: 8px; border-top-right-radius: 8px;\">\n        <div style=\"margin: 0; padding: .5rem .75rem;\">\n          <div style=\"color: #4f46b2; font-size: 1.125rem; font-weight: bold; margin-bottom: 1rem;\">💡 Good to know</div>\n          Use artifical intelligence (AI) to generate a catchy subject\n          line for you in a few seconds with our integrated AI, the\n          <strong>Brevo AI assistant</strong>. To learn more, check our\n          dedicated article\n          <a href=\"https://help.brevo.com/hc/en-us/articles/11994642550674\" target=\"_blank\" rel=\"noopener\">Auto-generate engaging marketing content with the Brevo AI assistant</a>.\n        </div>\n      </div>\n      <p>\n        If you decided to test two different subject lines in your campaign,\n        click <strong>Add subjects</strong> and enter the two different subject\n        lines you want to test in the <strong>Subject line A</strong> and\n        <strong>Subject line B</strong>\n        fields respectively:\n      </p>\n      <p class=\"wysiwyg-text-align-center\">\n        <img src=\"https://help.brevo.com/hc/article_attachments/21013533562002\" alt=\"campaigns_ab-test-subject_EN-US.gif\" width=\"572\" height=\"340\">\n      </p>\n      <div style=\"border: 0; color: inherit; font-family: inherit; font-size: inherit; margin: 1rem 0; padding: .5rem; background-color: #efeefc; border-left: 3px solid #4f46b2; border-bottom-right-radius: 8px; border-top-right-radius: 8px;\">\n        <div style=\"margin: 0; padding: .5rem .75rem;\">\n          <div style=\"color: #4f46b2; font-size: 1.125rem; font-weight: bold; margin-bottom: 1rem;\">💡 Good to know</div>\n          You can insert personalization into your subject lines and preview\n          text using the 👤  icon. To learn more, check our dedicated\n          section on <strong>Subject</strong> in\n          <a href=\"https://help.brevo.com/hc/en-us/articles/4413566705298/preview/eyJhbGciOiJIUzI1NiJ9.eyJpZCI6NDQxMzU2NjcwNTI5OCwiZXhwIjoxNjQ1NTI0NjQ3fQ.qKcKehhDfpS3hTlw7pegvwIxiSP2NKm4OPtOVakUVjE#h_01FTWZBAZ9M7QB6V5B2V2DEC4M\" target=\"_blank\" rel=\"noopener\">Creating an email campaign</a>.\n        </div>\n      </div>\n    </div>\n    <div class=\"tab is-hidden\">\n      <p>\n        If you decided to test two different email content, you will see\n        in the <strong>Design</strong> section that you can create two email\n        designs:\n      </p>\n      <p class=\"wysiwyg-text-align-center\">\n        <img src=\"https://help.brevo.com/hc/article_attachments/21013533565842\" alt=\"campaigns_ab-test-email-content_EN-US.png\">\n      </p>\n      <p class=\"wysiwyg-text-align-left\">\n        Click <strong>Design version A</strong> to create your first email\n        design. Design your email campaign as if you were designing a regular\n        email campaign. To learn more, check our dedicated\n        section on how to\n        <a href=\"https://help.brevo.com/hc/en-us/articles/4413566705298#h_01EHW3P3C1FZW8A8ZJ13M7CF5Q\" target=\"_blank\" rel=\"noopener\">Design your email campaign</a>.\n      </p>\n      <p class=\"wysiwyg-text-align-left\">\n        Once you are done with designing email campaign A, you can duplicate\n        version A by clicking the duplicate icon , or restart your design\n        from\n        scratch or use another email template.\n      </p>\n      <p class=\"wysiwyg-text-align-center\">\n        <img src=\"https://help.brevo.com/hc/article_attachments/21013533567122\" alt=\"campaigns_ab-test-copy-A_EN-US.gif\" width=\"555\" height=\"353\">\n      </p>\n      <div style=\"border: 0; color: inherit; font-family: inherit; font-size: inherit; margin: 1rem 0; padding: .5rem; background-color: #efeefc; border-left: 3px solid #4f46b2; border-bottom-right-radius: 8px; border-top-right-radius: 8px;\">\n        <div style=\"margin: 0; padding: .5rem .75rem;\">\n          <div style=\"color: #4f46b2; font-size: 1.125rem; font-weight: bold; margin-bottom: 1rem;\">💡 Good to know</div>\n          You can switch from Version A to Version B directly from the\n          header of the Drag &amp; Drop Editor.\n        </div>\n      </div>\n    </div>\n  </div>\n  <!-- END OF TABS CODE --><h1 id=\"h_01JWQYYT0Y6VTDMGK3R2HD3TD5\">✂️ Step 2: Define split rules</h1><p>When creating an A/B Test campaign the <strong>Split Rules</strong> section is added to your campaign creation flow. <span style=\"font-family: -apple-system, BlinkMacSystemFont, 'Segoe UI', Helvetica, Arial, sans-serif;\">These rules will determine the </span><a style=\"background-color: #ffffff; font-family: -apple-system, BlinkMacSystemFont, 'Segoe UI', Helvetica, Arial, sans-serif;\" href=\"#h_01FWGH8Z4Y2WBZFFZ8AZFBG2PX\" target=\"_self\">size of the test groups</a><span style=\"font-family: -apple-system, BlinkMacSystemFont, 'Segoe UI', Helvetica, Arial, sans-serif;\">, how the </span><a style=\"background-color: #ffffff; font-family: -apple-system, BlinkMacSystemFont, 'Segoe UI', Helvetica, Arial, sans-serif;\" href=\"#h_01FWGH99MSZAGWJVN499VQD7RZ\" target=\"_self\">winning version</a><span style=\"font-family: -apple-system, BlinkMacSystemFont, 'Segoe UI', Helvetica, Arial, sans-serif;\"> will be selected, and the </span><a style=\"background-color: #ffffff; font-family: -apple-system, BlinkMacSystemFont, 'Segoe UI', Helvetica, Arial, sans-serif;\" href=\"#h_01FWGH9KDTS8QP84XV5KZ02Z5D\" target=\"_self\">amount of time</a><span style=\"font-family: -apple-system, BlinkMacSystemFont, 'Segoe UI', Helvetica, Arial, sans-serif;\"> for which the test will run. Click </span><strong style=\"font-family: -apple-system, BlinkMacSystemFont, 'Segoe UI', Helvetica, Arial, sans-serif;\">Add split rules</strong><span style=\"font-family: -apple-system, BlinkMacSystemFont, 'Segoe UI', Helvetica, Arial, sans-serif;\"> to start configuring them. </span></p><h2 id=\"h_01FWGH8Z4Y2WBZFFZ8AZFBG2PX\">Select the size of your test groups</h2><div style=\"border: 0; color: inherit; font-family: inherit; font-size: inherit; margin: 1rem 0; padding: .5rem; background-color: #fff4f0; border-left: 3px solid #ff6e3d; border-bottom-right-radius: 8px; border-top-right-radius: 8px;\">\n    <div style=\"margin: 0; padding: .5rem .75rem;\">\n      <div style=\"color: #663e0f; font-size: 1.125rem; font-weight: bold; margin-bottom: 1rem;\">❗️ Important</div>\n      You must first select your recipients to define test groups. \n    </div>\n  </div><p>The default test group size is 50% of the total recipient list with versions A and B each being sent to 25% of the recipient list. The remaining 50% of the recipients would receive the winning version after the test ends. The maximum size of each test group is 50% and each recipient in the test groups will receive only one version of your campaign. To change the test group size, simply move the slider right to increase the size or left to decrease it. </p><p class=\"wysiwyg-text-align-center\"><img src=\"https://help.brevo.com/hc/article_attachments/21013533569426\" alt=\"campaigns_ab-test-slider_EN-US.gif\" width=\"569\" height=\"214\"></p><h2 id=\"h_01FWGH99MSZAGWJVN499VQD7RZ\">How will the winning version be chosen?</h2><figure class=\"wysiwyg-table wysiwyg-table-align-left\" style=\"width: 100%;\"><table style=\"border-collapse: collapse; border-style: none;\"><tbody><tr>\n<td class=\"wysiwyg-text-align-justify\" style=\"border-style: none; padding: 10px; width: 50%;\">Select the method for determining the winning version: choose whether the version with the highest <strong>Open Rate</strong> or the highest<em> </em><strong>Click Rate </strong>wins.</td>\n<td style=\"border-style: none; padding: 10px; text-align: center; width: 50%;\"><img src=\"https://help.brevo.com/hc/article_attachments/21013533571858\" alt=\"campaigns_ab-test-open-click-rate_EN-US.png\" width=\"328\" height=\"92\"></td>\n</tr></tbody></table></figure><h2 id=\"h_01FWGH9KDTS8QP84XV5KZ02Z5D\">How long should we run the test? </h2><p>Select how long the test will run. After the test duration completes, the winning version will be identified and sent to the remaining recipients. The duration may be defined in hours or in days with a maximum test duration of 23 hours or 7 days. </p><p class=\"wysiwyg-text-align-center\"><img src=\"https://help.brevo.com/hc/article_attachments/21013495719442\" alt=\"campaigns_ab-test-duration_EN-US.gif\" width=\"590\" height=\"194\"></p><h1 id=\"🚀_Finalizing_your_campaign\">🚀 Step 3: Finalize your campaign</h1><p>After completing each section of the email campaign creation flow, you will find in the top-right corner of your screen three options: <a href=\"https://help.brevo.com/hc/en-us/articles/4413566705298#h_01FTX92ZGYY8AWM7WS9VWPNKCJ\" target=\"_blank\" rel=\"noopener noreferrer\"><strong>Save &amp; Quit</strong></a>, <a href=\"https://help.brevo.com/hc/en-us/articles/4413566705298#h_01FTX939YGHBAM0GX64MAD9KH1\" target=\"_blank\" rel=\"noopener noreferrer\"><strong>Preview &amp; Test</strong></a>, and <a href=\"https://help.brevo.com/hc/en-us/articles/4413566705298#h_01FTX93W035RTQH2QPSG7J81M2\" target=\"_blank\" rel=\"noopener noreferrer\"><strong>Schedule</strong></a>.</p><div style=\"border: 0; color: inherit; font-family: inherit; font-size: inherit; margin: 1rem 0; padding: .5rem; background-color: #fff4f0; border-left: 3px solid #ff6e3d; border-bottom-right-radius: 8px; border-top-right-radius: 8px;\">\n    <div style=\"margin: 0; padding: .5rem .75rem;\">\n      <div style=\"color: #663e0f; font-size: 1.125rem; font-weight: bold; margin-bottom: 1rem;\">❗️ Important</div>\n      The <strong>Best time</strong> and <strong>Send in batches</strong> options\n      cannot be used to schedule the sending of A/B test campaigns. You can\n      only choose between the <strong>Send now</strong> or\n      <strong>Schedule</strong> options to send your A/B test campaign. \n    </div>\n  </div><p>The test versions will be sent to the respective test groups depending on the schedule option you choose and the winning version will be sent automatically to the rest of the recipients as soon as the test duration ends.</p><div style=\"border: 0; color: inherit; font-family: inherit; font-size: inherit; margin: 1rem 0; padding: .5rem; background-color: #efeefc; border-left: 3px solid #4f46b2; border-bottom-right-radius: 8px; border-top-right-radius: 8px;\">\n    <div style=\"margin: 0; padding: .5rem .75rem;\">\n      <div style=\"color: #4f46b2; font-size: 1.125rem; font-weight: bold; margin-bottom: 1rem;\">➡️  For example</div>\n      If the test duration is 4 hours and the campaign is scheduled to be sent\n      at 1:00 pm on a certain date, the winning version will be sent out to\n      the remaining recipients at 5:00 pm on the same day.\n    </div>\n  </div><p>You will be able to edit and see your A/B test campaign in your <a href=\"https://app.brevo.com/campaigns/listing/email\" target=\"_blank\" rel=\"noopener noreferrer\">campaign list</a>. To help you identify an A/B test campaign from a regular campaign in your campaign list, an <strong>A/B test </strong>tag is added to your campaign name.</p><center>\n    <img src=\"https://help.brevo.com/hc/article_attachments/21013533577746\" alt=\"campaigns_tag-ab-test_EN-US.png\" width=\"624\" height=\"262\">\n  </center><h1 id=\"h_01HJ8YAKJR7K089BV7YXHZ0T8J\">📊 Access and understand your A/B test campaign reports</h1><p>Once your campaign is sent to all your recipients, you can access the report and see which version of your A/B test campaign won. To access your report, click the name of your A/B test campaign from <a href=\"https://app.brevo.com/campaigns/listing\" target=\"_blank\" rel=\"noopener noreferrer\"><strong>Marketing &gt; Campaigns &gt; Email</strong></a> once it has been sent to all your recipients. You will have access to all the statistics on your A/B test campaign. From the <strong>A/B test details</strong> section, you will be able to see which version of your A/B test campaign won:</p><p class=\"wysiwyg-text-align-center\"><img src=\"https://help.brevo.com/hc/article_attachments/21013533579666\" alt=\"campaigns_ab-test-report_EN-US.png\"></p><p>➡️ To learn more about how to understand your email campaign report, check our dedicated article <a href=\"https://help.brevo.com/hc/en-us/articles/19764406559506\" target=\"_blank\" rel=\"noopener noreferrer\">Analyze and export your email campaign report</a>.</p>","user_segment_ids":[]}}