Skip to Content
0

A/B testing

Feb 23, 2017 at 07:41 AM

70

avatar image

Is it possible to use A/B testing functionality for some other types of campaigns than email?

For ex, I would like to export data about test groups, or send them SMS.

is it possible to customize winning criteria?

BR,

Ana

10 |10000 characters needed characters left characters exceeded
* Please Login or Register to Answer, Follow or Comment.

5 Answers

Joyca Vervinckt Feb 23, 2017 at 04:07 PM
0

Hello Ana,

How do you imagine an A/B testing setup for export data??

I can't imagine a scenario in which you would have two ways to export data and want to select the "best" way based on ... ?

Also for SMS I don't think A/B testing can be used because we don't get any criteria for selecting a winner. For emails we get statistics on number of opened mails and clickthroughs, but I think for SMS we only get delivered or failed statistics. (I'm not certain as I haven't used the SMS scenario yet).

Please detail your ideas on using A/B tests on these scenario's further.

Kr,

Joyca

Share
10 |10000 characters needed characters left characters exceeded
Ana Milovanovic Feb 24, 2017 at 02:10 PM
0

If for example, I use another solution for sending mail, so I want to export data about test groups, and import back the results. Is it possible?

BR,

Ana

Share
10 |10000 characters needed characters left characters exceeded
Joyca Vervinckt Feb 24, 2017 at 03:15 PM
0

Well yes, you can always use the export list functionality to export data.

You can use the random split functionality in segmentation to create multiple target groups for your external solution, one for your A group and one for your B group for example, and a final one to send the winning version to. But it's your external tool that will have to determine which is the "winning" variant then.

I've also seen the option to import campaign success data in the Import Data app, but I haven't used it myself.

Share
10 |10000 characters needed characters left characters exceeded
Ana Milovanovic Feb 27, 2017 at 02:31 PM
0

Thank you Joyca,

The problem is that by default in A/B testing you can only perform "send email" action after creating test groups. If I choose export, i get an error in system. Do you think this is dificult to change? is it possible?

BR,

Ana

Share
10 |10000 characters needed characters left characters exceeded
Joyca Vervinckt Mar 01, 2017 at 08:26 AM
0

Ana,

What I tried to make clear is that it's not logic to me to have an A and a B version of the action "export list".

You can only create an export list in one way.

Whereas for an email, you can create a mail content version A, and a slightly different version B, and you want to test which of the two contents works best. For example a difference in the email title to test which one is more likely to be opened by contacts.

But there are no two different versions possible of "exporting". You can export two times. But you cannot export in two ways.

Anyway I checked the customizing and the technical name of A/B Testing is AB_TEST_EMAIL. So maybe if you have an ABAP developer you could create an alternative version based on a Z-class.

ab-test-mail.jpg

Kr,

Joyca


ab-test-mail.jpg (252.8 kB)
Share
10 |10000 characters needed characters left characters exceeded