Schema talk:MobileWikiAppABTest

Maintainer:Dmitry Brant
Team:Mobile Apps
Project:Mobile Apps
Status:active
Sampling:1:1
Purge:Hash eventCapsule PII after 90 days, keep the rest indefinitely

[[Category:Schemas (Mobile Apps team)]]

A/B testing

edit

A bit more detail about the "test_group" field:

As an example, suppose we want to run an A/B test where the A group sees a notification that encourages the user to keep editing in the app, and the B group does not get this notification, and we want to measure editor retention as a result of this notification.

When a user in the A group sees the notification, an event will be sent with a "test_group" of "editNotification_GroupA". And when the user in the B group is supposed to see the notification (but doesn't), an event will be sent with a "test_group" of "editNotification_GroupB".

When the test period is finished, we will have a total number of users for whom either the "GroupA" or "GroupB" event was sent, which should be an evenly-split distribution. And because this schema also records the "app_install_id" of each user, we should be able to look at the Editing schemas for each corresponding app_install_id, and see what each user's editing behavior turned out to be.

Return to "MobileWikiAppABTest" page.