Message send time optimisation: a case study

At Emarsys our goal is to make marketing communication truly personal. A significant part of this is sending messages at the right time. With the help of R and shiny we developed a machine learning algorithm resulting in increased open rates and shorter times between sending and opening messages. The algorithm is based on the multi-armed Bayesian bandit method and continuously learns from incoming user behaviour data. In this talk I want to highlight the most important milestones of this journey.

First we proved the significance of sending times with a simulation in shiny. After that we prototyped several algorithms to assess their expected performances, scalability properties and implementation costs. Later we measured the performance of the algorithm already running in production with several pilot clients and assessed the impact of our previous choices. We had as many different scenarios as pilot clients, either the set-up was different, or their users’ behaviour. We will show what we learned during this process about the algorithm, about our assumptions and how we should ease the feature’s usage for our clients. Examples include modification of the priors of the Bayesian bandit and assisting clients in setting up correct A/B tests.

Czeller Ildikó
Data Scientist, Emarsys Technologies Kft.

I work in the Emarsys Data Team for more than 2 years now after finishing my masters in Mathematics. I am most inspired by the variety of our tasks: we see through a data related projects from the birth of a new idea through implementation to explaining results and interesting phenomena to clients of non-technical background. Besides work I am a mentor at the Budapest RLadies meetup and teach Software Engineering to high-school students.