The most immediate difference is that Lead Honestly communicates and works directly with a manager, and by extension their employees, where 15Five works with all parties. As a result Lead Honestly is able to be applied however a manager wishes, and is offered at a much lower price point.
@lucisferre, you're 100% correct here. I certainly don't ignore 300-600ms differences but I only look for them after I've exhausted other, perhaps larger, gains.
As for how many times the test was run, it was randomized but but somewhere between ~60-100 times.
Making the guide responsive is an absolute must, and something I am looking to do right away. For now I just wanted to get it out there and start collecting feedback.