{"id":13198,"date":"2024-03-20T15:17:58","date_gmt":"2024-03-20T14:17:58","guid":{"rendered":"https:\/\/helpcenter.blendee.com\/article\/how-to-set-up-an-experiments-testing\/"},"modified":"2024-03-20T15:17:58","modified_gmt":"2024-03-20T14:17:58","slug":"how-to-set-up-an-experiments-testing","status":"publish","type":"article","link":"https:\/\/helpcenter.streamwise.it\/en\/article\/how-to-set-up-an-experiments-testing\/","title":{"rendered":"How to Set Up an Experiments &#8211; Testing"},"content":{"rendered":"<p>Blendee provides the possibility to create A\/B\/X Tests by taking advantage of the flexibility and infinite possibilities offered by the <a href=\"https:\/\/helpcenter.streamwise.it\/article\/come-creare-delle-nuove-esperienze\/\">experience manager<\/a>, by accessing the <strong>Experiments<\/strong> section.<\/p>\n<p>Thanks to <strong>Experiments <\/strong> , it is possible to test any content that can be created with Blendee&#8217;s features: it will then be up to the platform itself, based on the results, to choose which will be the best option.<br \/>\nAutomatic mode, but not only: it is of course also possible to opt for the manual mode which leaves the user free to select the winner on the basis of the best performance obtained by the options tested.<\/p>\n<p>The immediate advantage of the solution adopted by Blendee for the management of A\/B\/X tests is that you do not have to take over an experience already created, stop it, make changes and then relaunch it. In fact, as we will see, everything happens smoothly and once our flows are set up, everything will be <strong>automated<\/strong>.<\/p>\n<p>Now let&#8217;s see how to proceed with the configuration. First you need to create\/edit <a href=\"https:\/\/helpcenter.streamwise.it\/article\/come-modificare-unesperienza\/\">an experience<\/a>, in the example we will create an experience for the abandoned cart and we will check which, between two email templates, will be the most performing.<br \/>\nWe will then test which, between two <a href=\"https:\/\/helpcenter.streamwise.it\/article\/come-configurare-un-behavioural-message\/\">behavioral messages<\/a>, leads to a greater conversion of carts.<\/p>\n<p>Within the Experience Manager you will find, at the bottom left, the section:<\/p>\n<p><a href=\"https:\/\/helpcenter.blendee.com\/wp-content\/uploads\/2022\/08\/Schermata-2022-08-12-alle-11.57.31.png\" data-lbwps-width=\"350\" data-lbwps-height=\"320\" data-lbwps-srcsmall=\"https:\/\/helpcenter.blendee.com\/wp-content\/uploads\/2022\/08\/Schermata-2022-08-12-alle-11.57.31.png\"><img class=\"aligncenter size-medium wp-image-8233\" data-original=\"https:\/\/helpcenter.blendee.com\/wp-content\/uploads\/2022\/08\/Schermata-2022-08-12-alle-11.57.31-300x274.png\" alt=\"\" width=\"300\" height=\"274\"><\/a><\/p>\n<p>At this point, we proceed by dragging the <strong>Testing<\/strong> block into our workflow to start configuring our test:<\/p>\n<p><a href=\"https:\/\/helpcenter.blendee.com\/wp-content\/uploads\/2022\/08\/Schermata-2022-08-12-alle-11.58.29.png\" data-lbwps-width=\"728\" data-lbwps-height=\"582\" data-lbwps-srcsmall=\"https:\/\/helpcenter.blendee.com\/wp-content\/uploads\/2022\/08\/Schermata-2022-08-12-alle-11.58.29.png\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-medium wp-image-8234\" src=\"https:\/\/helpcenter.blendee.com\/wp-content\/uploads\/2022\/08\/Schermata-2022-08-12-alle-11.58.29-300x240.png\" alt=\"\" width=\"300\" height=\"240\" srcset=\"https:\/\/helpcenter.streamwise.it\/wp-content\/uploads\/2022\/08\/Schermata-2022-08-12-alle-11.58.29-300x240.png 300w, https:\/\/helpcenter.streamwise.it\/wp-content\/uploads\/2022\/08\/Schermata-2022-08-12-alle-11.58.29.png 728w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/a>The first thing that is required is the choice of<strong>the number to<\/strong> be configured to recognize the test to be performed.<\/p>\n<p><em><strong>IMPORTANT<\/strong><\/em><\/p>\n<p>We recommend that you choose a &#8220;<strong>speaking<\/strong>&#8221; name for the test so that you can better identify it in the subsequent stages of reading the statistics, thus easily distinguishing it from other tests already present.<\/p>\n<p>Let&#8217;s now take a closer look at the differences between the two <strong>experiment management modes<\/strong> : <strong>Automatic<\/strong> and <strong>Manual<\/strong>.<\/p>\n<h1>&#8220;Automatic&#8221; mode<\/h1>\n<p><a href=\"https:\/\/helpcenter.blendee.com\/wp-content\/uploads\/2022\/08\/Schermata-2022-08-12-alle-12.02.18.png\" data-lbwps-width=\"700\" data-lbwps-height=\"776\" data-lbwps-srcsmall=\"https:\/\/helpcenter.blendee.com\/wp-content\/uploads\/2022\/08\/Schermata-2022-08-12-alle-12.02.18.png\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-medium wp-image-8235\" src=\"https:\/\/helpcenter.blendee.com\/wp-content\/uploads\/2022\/08\/Schermata-2022-08-12-alle-12.02.18-271x300.png\" alt=\"\" width=\"271\" height=\"300\" srcset=\"https:\/\/helpcenter.streamwise.it\/wp-content\/uploads\/2022\/08\/Schermata-2022-08-12-alle-12.02.18-271x300.png 271w, https:\/\/helpcenter.streamwise.it\/wp-content\/uploads\/2022\/08\/Schermata-2022-08-12-alle-12.02.18.png 700w\" sizes=\"(max-width: 271px) 100vw, 271px\" \/><\/a>Automatic mode is extremely easy to set up. You will only need to choose the evaluation metric to select the winning test. The available metrics are as follows:<\/p>\n<ul>\n<li>Views\/Openings;<\/li>\n<li>Click;<\/li>\n<li>Sales;<\/li>\n<li>Products Sold;<\/li>\n<li>Turnover;<\/li>\n<\/ul>\n<h1>&#8220;Manual&#8221; mode<\/h1>\n<p><a href=\"https:\/\/helpcenter.blendee.com\/wp-content\/uploads\/2022\/08\/Schermata-2022-08-12-alle-12.08.02.png\" data-lbwps-width=\"704\" data-lbwps-height=\"654\" data-lbwps-srcsmall=\"https:\/\/helpcenter.blendee.com\/wp-content\/uploads\/2022\/08\/Schermata-2022-08-12-alle-12.08.02.png\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-medium wp-image-8236\" src=\"https:\/\/helpcenter.blendee.com\/wp-content\/uploads\/2022\/08\/Schermata-2022-08-12-alle-12.08.02-300x279.png\" alt=\"\" width=\"300\" height=\"279\" srcset=\"https:\/\/helpcenter.streamwise.it\/wp-content\/uploads\/2022\/08\/Schermata-2022-08-12-alle-12.08.02-300x279.png 300w, https:\/\/helpcenter.streamwise.it\/wp-content\/uploads\/2022\/08\/Schermata-2022-08-12-alle-12.08.02.png 704w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/a><\/p>\n<p>By selecting the &#8220;Manual&#8221; mode, the choices to be made are greater but always very simple to configure.<\/p>\n<h4>Accuracy<\/h4>\n<p>Accuracy indicates the time we want Blendee to keep the test active and, as we will see, involves defining the number of users to be engaged before the test can be considered concluded.<br \/>\nObviously, a &#8220;High&#8221; accuracy allows you to have more reliable results, but the time in which the test is performed will be longer.<br \/>\nOn the other hand, a &#8220;Low&#8221; accuracy will involve a small number of users in a short time.<\/p>\n<p>The accuracy should also be chosen according to the type of test to be carried out. For example, if we are testing clicks on a message on the portal and visible to all users registered for newsletters, we can choose a low accuracy as we will not need much time and many users to understand which option is more performing.<\/p>\n<h4>Advanced Configuration<\/h4>\n<p>Once the accuracy has been selected, you can change the basic parameters by clicking on &#8220;Advanced Configuration&#8221;:<\/p>\n<p><a href=\"https:\/\/helpcenter.blendee.com\/wp-content\/uploads\/2022\/08\/Schermata-2022-08-12-alle-12.16.49.png\" data-lbwps-width=\"708\" data-lbwps-height=\"528\" data-lbwps-srcsmall=\"https:\/\/helpcenter.blendee.com\/wp-content\/uploads\/2022\/08\/Schermata-2022-08-12-alle-12.16.49.png\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-medium wp-image-8237\" src=\"https:\/\/helpcenter.blendee.com\/wp-content\/uploads\/2022\/08\/Schermata-2022-08-12-alle-12.16.49-300x224.png\" alt=\"\" width=\"300\" height=\"224\" srcset=\"https:\/\/helpcenter.streamwise.it\/wp-content\/uploads\/2022\/08\/Schermata-2022-08-12-alle-12.16.49-300x224.png 300w, https:\/\/helpcenter.streamwise.it\/wp-content\/uploads\/2022\/08\/Schermata-2022-08-12-alle-12.16.49.png 708w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/a>Within the advanced configuration, the data will be displayed according to the accuracy previously chosen and it is possible, if necessary, to modify the parameters:<\/p>\n<ul>\n<li><strong>Maximum users involved<\/strong> in the test<\/li>\n<li><strong>Maximum duration of the test<\/strong> (can be expressed in: hours, minutes, days, months and it is also possible to define a maximum end date of the test)<\/li>\n<li><strong>Waiting time<\/strong>: allows you to define a minimum waiting time to be taken into account before calculating performance statistics.<\/li>\n<\/ul>\n<p>The test is then configured, and all that remains is to proceed with the creation of the content to be tested. As mentioned, in our example, first of all we are going to test two emails for users who have an abandoned cart. The test includes the &#8220;Automatic&#8221; mode with the choice of the winner based on clicks.<\/p>\n<p>Here&#8217;s the full test that&#8217;s also configured to evaluate the custom message.<\/p>\n<p><a href=\"https:\/\/helpcenter.blendee.com\/wp-content\/uploads\/2022\/08\/ab-test.png\" data-lbwps-width=\"888\" data-lbwps-height=\"1258\" data-lbwps-srcsmall=\"https:\/\/helpcenter.blendee.com\/wp-content\/uploads\/2022\/08\/ab-test.png\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-8427 size-large\" src=\"https:\/\/helpcenter.blendee.com\/wp-content\/uploads\/2022\/08\/ab-test-723x1024.png\" alt=\"AB-TEST\" width=\"699\" height=\"990\" srcset=\"https:\/\/helpcenter.streamwise.it\/wp-content\/uploads\/2022\/08\/ab-test-723x1024.png 723w, https:\/\/helpcenter.streamwise.it\/wp-content\/uploads\/2022\/08\/ab-test-212x300.png 212w, https:\/\/helpcenter.streamwise.it\/wp-content\/uploads\/2022\/08\/ab-test-768x1088.png 768w, https:\/\/helpcenter.streamwise.it\/wp-content\/uploads\/2022\/08\/ab-test.png 888w\" sizes=\"(max-width: 699px) 100vw, 699px\" \/><\/a><\/p>\n<p>As you can see from the image, the links between the content blocks (email and behavioural messages) and the test have a different colour from the other links to allow a better reading of the flow.<\/p>\n<p><strong><em>IMPORTANT<\/em><\/strong><\/p>\n<p>As you can see from the image, both test blocks are connected to the same output block, this is because the evaluation of the test does not take place with regard to the &#8220;paths&#8221; that we can create based on the various conditions: the tests aim to evaluate which of two contents\/copy\/templates is more performing.<\/p>\n<p>It is very important, when testing Web Personalizations (recommendations, behavioural messages, etc&#8230;), to place a waiting block so that users do not immediately exit the experience and view one of the tests.<\/p>\n<h4>Choosing the &#8220;Winner&#8221;<\/h4>\n<p>Once the experience is launched, Blendee allows you to view separate statistics for each <strong>Experiments <\/strong> and choose the winner.<br \/>\nTo proceed:<\/p>\n<ul>\n<li>select the &#8220;<strong>Experiments<\/strong>&#8221; button next to the name of the experience in the list of experiences<\/li>\n<li>Once clicked, we will choose the experiment to analyze.<\/li>\n<\/ul>\n<p><a href=\"https:\/\/helpcenter.blendee.com\/wp-content\/uploads\/2022\/08\/Schermata-2022-08-12-alle-13.00.32.png\" data-lbwps-width=\"1976\" data-lbwps-height=\"750\" data-lbwps-srcsmall=\"https:\/\/helpcenter.blendee.com\/wp-content\/uploads\/2022\/08\/Schermata-2022-08-12-alle-13.00.32.png\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-medium wp-image-8243\" src=\"https:\/\/helpcenter.blendee.com\/wp-content\/uploads\/2022\/08\/Schermata-2022-08-12-alle-13.00.32-300x114.png\" alt=\"\" width=\"300\" height=\"114\" srcset=\"https:\/\/helpcenter.streamwise.it\/wp-content\/uploads\/2022\/08\/Schermata-2022-08-12-alle-13.00.32-300x114.png 300w, https:\/\/helpcenter.streamwise.it\/wp-content\/uploads\/2022\/08\/Schermata-2022-08-12-alle-13.00.32-1024x389.png 1024w, https:\/\/helpcenter.streamwise.it\/wp-content\/uploads\/2022\/08\/Schermata-2022-08-12-alle-13.00.32-768x291.png 768w, https:\/\/helpcenter.streamwise.it\/wp-content\/uploads\/2022\/08\/Schermata-2022-08-12-alle-13.00.32-1536x583.png 1536w, https:\/\/helpcenter.streamwise.it\/wp-content\/uploads\/2022\/08\/Schermata-2022-08-12-alle-13.00.32.png 1976w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/a><\/p>\n<p>In the analysis of statistics, within an experiment in automatic mode, Blendee will automatically select the winner but the user can still change it by clicking on the &#8220;Edit&#8221; button;<\/p>\n<p><a href=\"https:\/\/helpcenter.blendee.com\/wp-content\/uploads\/2022\/08\/Schermata-2022-08-12-alle-14.02.50.png\" data-lbwps-width=\"2672\" data-lbwps-height=\"640\" data-lbwps-srcsmall=\"https:\/\/helpcenter.blendee.com\/wp-content\/uploads\/2022\/08\/Schermata-2022-08-12-alle-14.02.50.png\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-medium wp-image-8245\" src=\"https:\/\/helpcenter.blendee.com\/wp-content\/uploads\/2022\/08\/Schermata-2022-08-12-alle-14.02.50-300x72.png\" alt=\"\" width=\"300\" height=\"72\" srcset=\"https:\/\/helpcenter.streamwise.it\/wp-content\/uploads\/2022\/08\/Schermata-2022-08-12-alle-14.02.50-300x72.png 300w, https:\/\/helpcenter.streamwise.it\/wp-content\/uploads\/2022\/08\/Schermata-2022-08-12-alle-14.02.50-1024x245.png 1024w, https:\/\/helpcenter.streamwise.it\/wp-content\/uploads\/2022\/08\/Schermata-2022-08-12-alle-14.02.50-768x184.png 768w, https:\/\/helpcenter.streamwise.it\/wp-content\/uploads\/2022\/08\/Schermata-2022-08-12-alle-14.02.50-1536x368.png 1536w, https:\/\/helpcenter.streamwise.it\/wp-content\/uploads\/2022\/08\/Schermata-2022-08-12-alle-14.02.50-2048x491.png 2048w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/a><\/p>\n<p>The statistical analysis can then be further deepened by verifying the results broken down by user segment.<br \/>\nIn the <strong>&#8220;Filter by Segments&#8221;<\/strong> area, you can select the segments you want to analyze:<\/p>\n<p><a href=\"https:\/\/helpcenter.blendee.com\/wp-content\/uploads\/2022\/08\/Schermata-2022-08-12-alle-14.18.49.png\" data-lbwps-width=\"2342\" data-lbwps-height=\"282\" data-lbwps-srcsmall=\"https:\/\/helpcenter.blendee.com\/wp-content\/uploads\/2022\/08\/Schermata-2022-08-12-alle-14.18.49.png\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-medium wp-image-8246\" src=\"https:\/\/helpcenter.blendee.com\/wp-content\/uploads\/2022\/08\/Schermata-2022-08-12-alle-14.18.49-300x36.png\" alt=\"\" width=\"300\" height=\"36\" srcset=\"https:\/\/helpcenter.streamwise.it\/wp-content\/uploads\/2022\/08\/Schermata-2022-08-12-alle-14.18.49-300x36.png 300w, https:\/\/helpcenter.streamwise.it\/wp-content\/uploads\/2022\/08\/Schermata-2022-08-12-alle-14.18.49-1024x123.png 1024w, https:\/\/helpcenter.streamwise.it\/wp-content\/uploads\/2022\/08\/Schermata-2022-08-12-alle-14.18.49-768x92.png 768w, https:\/\/helpcenter.streamwise.it\/wp-content\/uploads\/2022\/08\/Schermata-2022-08-12-alle-14.18.49-1536x185.png 1536w, https:\/\/helpcenter.streamwise.it\/wp-content\/uploads\/2022\/08\/Schermata-2022-08-12-alle-14.18.49-2048x247.png 2048w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/a><\/p>\n<p>By clicking on &#8220;Search&#8221;, in the area below you will be able to view the results divided by segment.<\/p>\n<div class=\"wrap-post-useful post_useful_13198\">\n<p><div style=\"color: black; margin-bottom: 15px;\"><strong>Was this content useful?<\/strong><\/div><\/p>\n<p class=\"post_useful_success post_useful_success_13198\">Thanks for contributing!<\/p>\n<div class=\"post-useful-buttons post_useful_buttons_13198\">\n<a href=\"javascript:;\" style=\"border:0px;\" title=\"Yes\" class=\"post-useful-vote post-useful-vote-yes\" data-id=\"13198\" data-rate=\"1\">Yes<\/a>\n<a href=\"javascript:;\" style=\"border:0px;\" title=\"No\" class=\"post-useful-vote post-useful-vote-no\" data-id=\"13198\" data-rate=\"0\">No<\/a>\n<\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>Blendee provides the possibility to create A\/B\/X Tests by taking advantage of the flexibility and infinite possibilities offered by the experience manager, by accessing the Experiments section. Thanks to Experiments , it is possible to test any content that can be created with Blendee&#8217;s features: it will then be up to the platform itself, based [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"menu_order":0,"template":"","format":"standard","article-category":[523,599],"article-tag":[570,571,596,592,593,600],"class_list":["post-13198","article","type-article","status-publish","format-standard","hentry","article-category-a-b-xtesting","article-category-campaigns-manager-en","article-tag-a-b-testing","article-tag-a-b-x","article-tag-blendee-experiments-en","article-tag-campaign-manager-en","article-tag-experience-manager-en","article-tag-experiments-en"],"_links":{"self":[{"href":"https:\/\/helpcenter.streamwise.it\/en\/wp-json\/wp\/v2\/article\/13198"}],"collection":[{"href":"https:\/\/helpcenter.streamwise.it\/en\/wp-json\/wp\/v2\/article"}],"about":[{"href":"https:\/\/helpcenter.streamwise.it\/en\/wp-json\/wp\/v2\/types\/article"}],"author":[{"embeddable":true,"href":"https:\/\/helpcenter.streamwise.it\/en\/wp-json\/wp\/v2\/users\/1"}],"version-history":[{"count":0,"href":"https:\/\/helpcenter.streamwise.it\/en\/wp-json\/wp\/v2\/article\/13198\/revisions"}],"wp:attachment":[{"href":"https:\/\/helpcenter.streamwise.it\/en\/wp-json\/wp\/v2\/media?parent=13198"}],"wp:term":[{"taxonomy":"article-category","embeddable":true,"href":"https:\/\/helpcenter.streamwise.it\/en\/wp-json\/wp\/v2\/article-category?post=13198"},{"taxonomy":"article-tag","embeddable":true,"href":"https:\/\/helpcenter.streamwise.it\/en\/wp-json\/wp\/v2\/article-tag?post=13198"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}