A/B Testing Magento Extension by Amasty | User Guide
0 likes7,564 views
The document is a user guide for an A/B testing extension for Magento, detailing settings, experiment creation, and report display. It includes sections on configuring notifications, creating tests for products and attributes, and analyzing results. Additionally, the guide discusses CSS override settings and custom design options for enhanced testing flexibility.
A/B Testing Magento Extension by Amasty | User Guide
- 1. User Guide: A/B Testing Page 1 A/B Testing Magento Extension User Guide Official extension page: A/B Testing Support: http://amasty.com/contacts/
- 2. Page 2 Table of contents: 1. Notifications and Ignore List settings…………………………………….……………….….…..3 2. Experiment Creation………………………………………………………………………………….….4 3. Reports Display…………………………………………………………………………………….……..13 4. CSS Override Settings……………………………………………………………………….……….…15 5. Custom Design…………………………………………………………………………………………….17 6. Frontend Examples………………………………………………………………………………………19 Support: http://amasty.com/contacts/ User Guide: A/B Testing
- 3. Page 3 1. Notifications and Ignore List settings Support: http://amasty.com/contacts/ To configure ‘Admin notifications’ and ‘Ignore list’ settings please go to System ->Configuration -> A/B Testing User Guide: A/B Testing Set to ‘Yes’ to automatically send notifications to admin users when the experiment is complete. Specify sender info and choose email template. To prevent pages with test variations from indexation and avoid content duplication specify user agents to ignore. You can exclude particular IP addresses (e.g. admin users addresses) from the experiment to get more precise results.
- 4. Page 4 To create a new test or check the results of running experiments please go to Sales -> A/B Testing Support: http://amasty.com/contacts/ User Guide: A/B Testing Click here to create a new test. 2. Experiment Creation Click on one of the launched experiments to see its settings and check reports information.
- 5. Page 5 Support: http://amasty.com/contacts/ User Guide: A/B Testing On the Products to Test tab you can choose necessary products for which you want to run a test. It’s possible to specify either one product or launch the experiment for a group of products. 2. Experiment Creation
- 6. Page 6 Choose the product attribute which you want to test. Support: http://amasty.com/contacts/ User Guide: A/B Testing 2. Experiment Creation You can test either one attribute or specify a couple of attributes to run a multivariate test. After you’ve specified which attributes for which products you want to test, please click the Continue Button.
- 7. Page 7 Support: http://amasty.com/contacts/ User Guide: A/B Testing When the experiment is saved you can edit its name and specify the goal type (4 types are available). NOTE: Click the Run Experiment button only after you specify Variations data. 2. Experiment Creation
- 8. Page 8 Support: http://amasty.com/contacts/ User Guide: A/B Testing If you want to check out how many people came to a particular page (e.g. a subscription page, or ‘thank you for purchase’ page) right after the product page specified in the ‘Products to test’ tab, please insert the URL for this page here. 2. Experiment Creation
- 9. Page 9 Support: http://amasty.com/contacts/ User Guide: A/B Testing If you’ve enabled Test Auto Complete option you can specify the minimal conversion rate change against the original variant that will trigger the test completion. 2. Experiment Creation
- 10. Page 10 Support: http://amasty.com/contacts/ User Guide: A/B Testing In this tab you can check whether you’ve chose correct products to test. 2. Experiment Creation
- 11. Page 11 Support: http://amasty.com/contacts/ User Guide: A/B Testing In the Variation tab you’ll find the fields according to the attribute you are going to test. NOTE: In case you test one attribute – its data will be copied to the Variation 1 tab automatically as the original variant. 2. Experiment Creation
- 12. Page 12 Support: http://amasty.com/contacts/ User Guide: A/B Testing After all necessary attributes data are specified, please return to the General Tab and click the Run Experiment button. 2. Experiment Creation Once the experiment is launched, the Report tab will be added.
- 13. Page 13 Support: http://amasty.com/contacts/ User Guide: A/B Testing Right after the experiment launch you can track its results in real time. 3. Reports Display
- 14. When the experiment has been running for 4 days already and there is enough data to estimate you’ll see the detailed report. Page 14 Support: http://amasty.com/contacts/ User Guide: A/B Testing 3. Reports Display NOTE: The smart extension algorithm will display the winning variant more often than other variations, to prevent you from sagging sales before test completion.
- 15. Page 15 Support: http://amasty.com/contacts/ User Guide: A/B Testing Choose this option in the Attributes list to customize and test website styles, for example : • the size and color of Add to Cart button; • Font changes etc. 4. CSS Override settings
- 16. Page 16 Support: http://amasty.com/contacts/ User Guide: A/B Testing Here we’ve changed the Add to Cart button color (see page 21). 4. CSS Override settings
- 17. Page 17 Support: http://amasty.com/contacts/ User Guide: A/B Testing 5. Custom Design Test not only product attributes, but custom design and layout as well.
- 18. Page 18 Support: http://amasty.com/contacts/ User Guide: A/B Testing Choose the necessary template from the dropdown. As soon as you define the templates for all variations, they’ll be randomly displayed to customers. 5. Custom Design
- 19. Page 19 Support: http://amasty.com/contacts/ User Guide: A/B Testing When you choose ‘Name’ as a attribute to test, the module will randomly display different variations to store visitors. 6. Frontend Examples
- 20. Page 20 Support: http://amasty.com/contacts/ User Guide: A/B Testing See the example of product description variations displayed to customers. 6. Frontend Examples
- 21. Page 21 Support: http://amasty.com/contacts/ User Guide: A/B Testing See the example Custom CSS override usage (see page 16) 6. Frontend Examples
- 22. Thank you! Your feedback is absolutely welcome! Should you have any questions or feature suggestions, please contact us at: http://amasty.com/contacts/ Page 22 Support: http://amasty.com/contacts/ User Guide: A/B Testing