This diagram that I put together is my first attempt to organize the analytics, growth, testing and optimization tool landscape. This slide is also available as a PDF. Discussion on Hacker News.

Another of my clients is about embark on another round of A/B testing, so I thought I’d post some of my favorite A/B testing resources, summarizing each as a single rule: Why you should always set your sample size (n) in advance: In How Not to Run an A/B Test @evmill makes the case for always fixing your sample size in advance. I generally agree with him – this is good research design.

The best (and least “mathy”) explanation I’ve seen for Confidence Intervals in a long time. Anyone who relies on quantitative research should understand this. What Is a Confidence Interval and Why Would You Want One?

Just finished with web 2.0 expo (SF). The conference was not well attended, probably the result of bad timing (right after SXSW) and a name that was AWESOME in 2007. That said, here are two of my favorite presentations. There were others, but the presenters haven’t posted the slides. 1. Cindy Alvarez, “But How Am I Doing Compared to Other Companies?” If you do any A/B testing, conversion optimization, or direct-response online advertising then you will find this useful.