A Sliced Design Approach for Conducting Online Experiments with Four Platforms, with Application to an Industry Email Campaign

Sadeghi, Soheil; Hung, Tzu-Hsiang; Chien, Peter; Arora, Neeraj

doi:10.51387/24-NEJSDS63

The New England Journal of Statistics in Data Science

A Sliced Design Approach for Conducting Online Experiments with Four Platforms, with Application to an Industry Email Campaign

Volume 2, Issue 3 (2024), pp. 311–322

Soheil Sadeghi Tzu-Hsiang Hung Peter Chien All authors (4)

https://doi.org/10.51387/24-NEJSDS63

Pub. online: 29 May 2024 Type: Engineering Science

Open Access

Accepted
20 January 2024

Published
29 May 2024

Abstract

Multivariate testing is a popular method to improve the effectiveness of digital marketing in industry. Online campaigns are often conducted across multiple platforms, such as desktops, tablets, smart phones, and smart watches. We propose minimum sliced aberration designs to accommodate online experiments with four platforms. This approach provides important insights into how different sets of design factors work differently across the four platforms, which can be used by industry for optimizing many forms of digital marketing. The effectiveness of the proposed approach is illustrated by an industrial email campaign with four platforms.

References

[1]

Addelman, S. Techniques for constructing fractional replicate plans. Journal of the American Statistical Association 58(301) 45–71 (1963). MR0150901

[2]

Goldfarb, A. and Tucker, C. Online display advertising: Targeting and obtrusiveness. Marketing Science 30(3) 389–404 (2011).

[3]

Haizler, T. and Steinberg, D. M. Factorial designs for online experiments. Technometrics 63(1) 1–12 (2021). https://doi.org/10.1080/00401706.2019.1701556. MR4205687

[4]

Kannan, P., Reinartz, W. and Verhoef, P. C. (2016). The path to purchase and attribution modeling: Introduction to special section.

[5]

Lambrecht, A. and Tucker, C. When does retargeting work? information specificity in online advertising. Journal of Marketing research 50(5) 561–576 (2013).

[6]

Lenth, R. V. Quick and easy analysis of unreplicated factorials. Technometrics 31(4) 469–473 (1989). https://doi.org/10.2307/1269997. MR1041567

[7]

Ryan, D. Understanding digital marketing: marketing strategies for engaging the digital generation. Kogan Page Publishers (2016).

[8]

Sadeghi, S., Chien, P. and Arora, N. Sliced designs for multi-platform online experiments. Technometrics 62(3) 387–402 (2020). https://doi.org/10.1080/00401706.2019.1647288. MR4125504

[9]

Sahni, N. S., Wheeler, S. C. and Chintagunta, P. Personalization in email marketing: The role of noninformative advertising content. Marketing Science 37(2) 236–258 (2018).

[10]

Wu, C. J. and Hamada, M. S. Experiments: Planning, Analysis, and Optimization, Volume 552. John Wiley & Sons (2011). MR2583259

[11]

Wu, C. J. and Zhang, R. Minimum aberration designs with two-level and four-level factors. Biometrika 80. 203–209 (1993). https://doi.org/10.1093/biomet/80.1.203. MR1225225

Full article

Open access article under the CC BY license.

Keywords

Multivariate testing Factorial designs Sliced designs Email campaign

Metrics

since December 2021

130 Article info views	71 Full article views
63 PDF downloads	15 XML downloads

RSS

Authors

Abstract

References

Export citation

Copy and paste formatted citation

Download citation in file