Mobile A/B tests or experiments are code changes that affect how your mobile app looks, or how it works.
- Visual Tests: Consist of UX changes, and are set up using the codeless mobile interface. They’re often used to modify how the app looks and change the text or color.
- Developer Tweaks: Variables that you can code into the app in a way that makes them editable through Mixpanel. These are often used to modify underlying parameters that are not accessible via the codeless mobile interface.
Creating an A/B Test
You can set up a simple visual A/B Test by connecting to the codeless mobile interface in the A/B Testing tool. All you need is a working mobile app that has the latest version of Mixpanel installed.
Minimum tracking library versions required to set up a mobile A/B Test:
Follow the detailed instructions in the Mixpanel developer documentation to set up your own A/B test:
To begin creating an A/B test in Mixpanel, select A/B Testing from the Take Action drop-down.
Click New Experiment to create an A/B Test, then select either iOS or Android from the window that pops up. See the developer documentation for detailed instructions.
A/B Test Analytics
Click Analytics beside an A/B Test to view the effectiveness of your test.
The chart shows how much activity your app is receiving for users in the test vs. users not in the test.