We noted you are experiencing viewing problems
- 
        
        Check with your IT department that JWPlatform, JWPlayer and Amazon AWS & CloudFront are not being blocked by your network. The relevant domains are *.jwplatform.com, *.jwpsrv.com, *.jwpcdn.com, jwpltx.com, jwpsrv.a.ssl.fastly.net, *.amazonaws.com and *.cloudfront.net. The relevant ports are 80 and 443.
 - 
        
        Check the following talk links to see which ones work correctly:
Auto Mode
HTTP Progressive Download Send us your results from the above test links at access@hstalks.com and we will contact you with further advice on troubleshooting your viewing problems. - 
        
        No luck yet? More tips for troubleshooting viewing issues
 - 
        
        Contact HST Support access@hstalks.com
 
- 
        Please review our troubleshooting guide for tips and advice on resolving your viewing problems.
 - 
        For additional help, please don't hesitate to contact HST support access@hstalks.com
 
We hope you have enjoyed this limited-length demo
                    
                    This is a limited length demo talk; you may
                    
                      login or
                    
                    review methods of
                    obtaining more access.
                  
                
                
              Printable Handouts
Navigable Slide Index
- Introduction
 - Talk outline
 - Importance of testing
 - Why test?
 - Testing is not a substitute for judgement
 - What to test?
 - Key factors influencing campaign profitability
 - Statistical concepts
 - Test and control
 - Randomness
 - Normal distribution
 - Standard deviation
 - Response rate
 - Standard deviation varies with sample size
 - The effect of increasing sample size
 - Determining sample size
 - Variations in response rate
 - 3 factors determine sample size calculation
 - Illustration for sample size calculation
 - Formula for sample size (1)
 - Formula for sample size (2)
 - Values for t
 - Sample size calculation
 - Example of sample size calculation
 - Formula for sample size (3)
 - Sample size calculation with P = 5%
 - Practical considerations
 - Selecting the sample
 - Stages in selecting the sample
 - Practical campaign example (1)
 - Practical campaign example (2)
 - Practical campaign example - incentive test
 - Practical campaign example - incentive test (2)
 - Practical campaign example - creative test
 - Practical campaign example - creative test (2)
 - Evaluation of direct marketing test - example
 - Evaluation of direct marketing test - step 1
 - Evaluation of direct marketing test - step 2
 - Evaluation of direct marketing test - step 3
 - Evaluation of direct marketing test - step 4
 - Evaluation of direct marketing test - step 5
 - Significance levels for test statistic
 - Summary
 - Thank you
 
Topics Covered
- Importance of testing
 - What to test?
 - Statistical concepts
 - How large a sample size?
 - Example
 - Selecting the sample
 - Formula for sample size
 - Practical considerations
 - Practical example: incentive test
 - Practical example: creative test
 
Talk Citation
Hathway, N. (2008, May 22). How to design and evaluate a direct marketing test [Video file]. In The Business & Management Collection, Henry Stewart Talks. Retrieved November 4, 2025, from https://doi.org/10.69645/EQKB6775.Export Citation (RIS)