Go to website
A/B and Multivariate Testing
Information and best practices for A/B and Multivariate Testing on the Flagsmith platform
Can I set up an A/B test or A/B/N test with flag values?
Yes. There's more info on current A/B testing here: https://docs.flagsmith.com/ab-testing/ Multivariate testing will be released in late Q1 2021,
What is the best way to track performance for different features in an A/B test?
Most users already have their analytics / event stream set up with a third party like Amplitude or Mixpanel, and so we suggest integrating with that third party for tracking performance of A/B tests. Flagsmith does not provide event tracking within the platform. There's more information here which will hopefully help explain things: https://docs.flagsmith.com/ab-testing/
Is customer bucketing guaranteed in A/B tests over time to ensure their consistent system experience?
Yes, as long as the user is identified then they are placed in the same cube as long as they have the same ID.
I am running an A/B test, but the users will not be logged in. Will segmenting work if I can't identify a user?
Flagsmith needs some sort of consistent ID that you store against the user on the client, otherwise it's impossible to serve a consistent test to that user. Generally people just create a random GUID and then store it on the client (e.g. using cookie on web).