Tests, Controls and Results
I was chatting with a friend of mine the other day around an End of Year online campaign and we were discussing the results. I was really intrigued at trying to understand whether or not a mobile text that went out before the campaign had increased the open and donation rates. I kept thinking, surely if I text someone ahead of an email (another Multi-Channel campaign case) I would see a significant increase in open rates and donation rates. However, I was so regretfully disappointed as they didn’t set up their test appropriately for us to really understand the impact.
So, what do you have to do to set up a test RIGHT so that you can read results and have the significance needed to be sure that the results will be the same going forward?
Why is it so important to have a control and statistically significant data to have a result? It is like building or buying a house, but not insuring it. Testing is expensive and has large opportunity cost both positive and negative. So, if you are going to test something, make sure it is worth it and you can after the test is complete, that you have a result. Otherwise, it is just interesting and the test was a fun exercise.
Subscribe to receive posts via email:
Get answers to product questions, join "Birds of a Feather" discussions and more. Join the Online Community
Alltop - Nonprofit
A Small Change
Bob Ottenhoff's Blog
Donor Power Blog
Future Leaders in Philanthropy
Katya's Nonprofit Marketing Blog
Kivi’s Nonprofit Communications Blog
Nonprofit Law Prof
Pamela’s Grant Blog
Sea Change Strategies
Zen and the Art of Nonprofit Technology