45
Conversion rate optimisation. What’s really proved to matter? Viacheslav Kravchuk Atwix

Meet Magento Belarus - Viacheslav Kravchuk

  • Upload
    amasty

  • View
    259

  • Download
    0

Embed Size (px)

DESCRIPTION

Meet Magento Belarus - Viacheslav Kravchuk speech on: Conversion rate optimisation. What's really proved to matter? http://by.meet-magento.com/ http://amasty.com/

Citation preview

Page 1: Meet Magento Belarus - Viacheslav Kravchuk

Conversion rate optimisation. !What’s really proved to matter?

Viacheslav Kravchuk!Atwix

Page 2: Meet Magento Belarus - Viacheslav Kravchuk

Background

CEO of Atwix (www.atwix.com), MCSS, Google Analytics QI, CSM.

Page 3: Meet Magento Belarus - Viacheslav Kravchuk

The story about conversion rate!experiments

Page 4: Meet Magento Belarus - Viacheslav Kravchuk

The point of highest impact

Page 5: Meet Magento Belarus - Viacheslav Kravchuk
Page 6: Meet Magento Belarus - Viacheslav Kravchuk

Checkout

Page 7: Meet Magento Belarus - Viacheslav Kravchuk

Checkout

Page 8: Meet Magento Belarus - Viacheslav Kravchuk

Tools

Page 9: Meet Magento Belarus - Viacheslav Kravchuk

Battlefields

Page 10: Meet Magento Belarus - Viacheslav Kravchuk
Page 11: Meet Magento Belarus - Viacheslav Kravchuk
Page 12: Meet Magento Belarus - Viacheslav Kravchuk

In 5 days…

Page 13: Meet Magento Belarus - Viacheslav Kravchuk

In 5 days…

OneStepChekout!converted 2.5x better!

vs. Awesome Chekout

Page 14: Meet Magento Belarus - Viacheslav Kravchuk

In 5 days…

OneStepChekout!converted 2.5x better!

vs. Awesome Chekout

Page 15: Meet Magento Belarus - Viacheslav Kravchuk

Because of a bug!

Page 16: Meet Magento Belarus - Viacheslav Kravchuk

Lesson #1:!!

Making experiments is easy. Making the right

conclusions - is not

Page 17: Meet Magento Belarus - Viacheslav Kravchuk

Let’s do it properly

Page 18: Meet Magento Belarus - Viacheslav Kravchuk

Let’s do it properly

You want to prove something? Do it on your own dime!

Page 19: Meet Magento Belarus - Viacheslav Kravchuk

Let’s do it properly~ 6 weeks

Page 20: Meet Magento Belarus - Viacheslav Kravchuk

Let’s do it properly~ 6 weeks

OSC shows 7.5% improvementStatistical significance: 80%

Page 21: Meet Magento Belarus - Viacheslav Kravchuk

Statistical significance is the probability that your result is not a false positive !

!

95% is industry standard!!

Run experiments longer for higher confidence

http://bit.ly/1qZZCku

Page 22: Meet Magento Belarus - Viacheslav Kravchuk
Page 23: Meet Magento Belarus - Viacheslav Kravchuk

~ 6 weeksOSC shows 2.8% improvement

Statistical significance: 85%

Page 24: Meet Magento Belarus - Viacheslav Kravchuk

Segment for extra insight- Device type!- Location of the customers!- Browser type!- Any data that Google Analytics offers!

Page 25: Meet Magento Belarus - Viacheslav Kravchuk

- Create segments including sessions with each checkout URL!- Exclude PayPal express!- Exclude checkout variation that customers are redirected to

How to segment

Page 26: Meet Magento Belarus - Viacheslav Kravchuk

Segmenting converted customers by visited pages

> 50% >

PP Express Orders: Visited PP Express confirmation

AC Orders: Not visited OSC and not visited PP Express

OSC Orders: Visited OSC and not visited PP Express

Page 27: Meet Magento Belarus - Viacheslav Kravchuk

Example: Mobile traffic

Page 28: Meet Magento Belarus - Viacheslav Kravchuk

Interesting observation:!!

Responsive checkout does not help non-responsive

website.

Page 29: Meet Magento Belarus - Viacheslav Kravchuk

Conclusion:!!

Each case is different. Test checkouts on your store

long enough. It will pay off.

Page 30: Meet Magento Belarus - Viacheslav Kravchuk

Next experiment: Secure Seal.

Page 31: Meet Magento Belarus - Viacheslav Kravchuk

What researches tell?

2510 US adults were asked in 2013.!!

About half answered “Don’t know or no preference”.

Page 32: Meet Magento Belarus - Viacheslav Kravchuk

The other half:

Page 33: Meet Magento Belarus - Viacheslav Kravchuk

CarPartKings Experiment!(by ConversionIQ)

Page 34: Meet Magento Belarus - Viacheslav Kravchuk
Page 35: Meet Magento Belarus - Viacheslav Kravchuk
Page 36: Meet Magento Belarus - Viacheslav Kravchuk
Page 37: Meet Magento Belarus - Viacheslav Kravchuk
Page 38: Meet Magento Belarus - Viacheslav Kravchuk

! Variation 2 (Norton Secure Seal) won by 15%.

Page 39: Meet Magento Belarus - Viacheslav Kravchuk

Conclusion:!!

It’s worth testing. Chances are the seal will help. Even if it does not mean much.

Page 40: Meet Magento Belarus - Viacheslav Kravchuk

Next experiment: Checkout fields.

Page 41: Meet Magento Belarus - Viacheslav Kravchuk

Hiding the Fax field helps 4.3% so far, hiding Fax & Company fields helps 0.9% (SS 84%).

Page 42: Meet Magento Belarus - Viacheslav Kravchuk

Experiments in progress:- Add to cart button color!- Welcome to checkout text!- Free shipping order total motivation!- Secure Seal impact

Page 43: Meet Magento Belarus - Viacheslav Kravchuk

Ideas for experiments

http://bit.ly/1h0Md2i

Page 44: Meet Magento Belarus - Viacheslav Kravchuk

Some takeaways1. Different stores = different cases. Make your own tests.!2. Be careful with conclusions. Verify the results (for ex. with GA) and try to find out the reasons.!3. Conversion rate is not only about UI/UX (traffic quality, site speed, etc.).

Page 45: Meet Magento Belarus - Viacheslav Kravchuk

Go set up your tests!

[email protected]