A/B split test our home page? - Ecommerce Forums
Page 1 of 2 12 LastLast
Results 1 to 15 of 22

Thread: A/B split test our home page?

  1. #1

    A/B split test our home page?

    How do I set this up? I want to change a few things on our home page and test out how well they work.

  2. #2
    The easiest way is to make a new article or category page that looks how you want your homepage to look then run the test from the content>experiments section in Analytics using your existing hompage as the A version and your new page as the B version.

    I haven't done this since they moved website optimiser in to Analytics, there were a few quirks with GWO and Volusion, so you might have to tinker a little.

    Let me know how you get on.

  3. #3
    This would imply that you can split test the inside page content, but not the Top bar and left nav?

  4. #4
    That's right, this was possible with the old GWO multivariate tests and an awful lot of jquery but with the new content experiments I don't know of a way it can be done.

  5. #5
    (noting that I am not a programer)....
    In the product pages, we have control over the meta tags. Is it possible to use this control to insert commands that prevent a whole bunch of stuff from loading on the page? This would then provide complete control of a page to use as the "b" in the split test?

  6. #6
    You could create a category/ product page and throw in some CSS/js to manipulate the appearance of the top and left nav, however it won't carry through to other pages on the site so the user experience might be a bit odd.

    If you go down this route, I suggest using a reduction in bounce rate as your goal as your changes will only really effect the landing page.

  7. #7
    Look into Optimizely.

  8. #8
    I use Visual Website Optimizer, it works for me, and it's a pretty good interface. I've heard Optimizely works well too and is perhaps simpler though not as powerful.

  9. #9
    Quote Originally Posted by Alvinl View Post
    I use Visual Website Optimizer, it works for me, and it's a pretty good interface. I've heard Optimizely works well too and is perhaps simpler though not as powerful.
    I've used both for years, and I'm also a certified VWO partner. I've found that Optimizely is much more powerful. It allows you to use historical data for goals, manually activate tests via a javascript API, and use regular expressions for URLs.

  10. #10
    well you have to do it correct if you're going to do it.

    Begin broad, test two EXTREMELY different designs. If one wins, make two more designs more like the winner, as you pick out your winners get more and more narrow until you're really just changing colors. Then do it all over again.


    1) Don't act on data that is not statistically significant. This is important to prevent from making the wrong decisions
    2) Lose your emotional attachment with your designs in favor of revenue
    3) Begin testing broadly different designs, narrow down, do it again.

    This is science, not your preference, what you think "pops" etc. Do this by the math and you'll be glad you did.

  11. #11
    Color me slow, cabin-fevered, or whatever, but what is an A/B split test?

  12. #12
    It's a method where you have two versions of something on your site, so you can gauge how it impacts customers and conversions.

    Do customers like BIG COLORFUL BUTTONS?

    Or do they like sad, grey buttons

    Do customers click more if your link is at the TOP of a page?

    Or do they click more if it's at the bottom of your page.

    You keep performing these tests, and then apply them. Many, many sites do this and you may not even be aware of it.

  13. #13
    Highly recommend doing testing of your site. Customers, unfortunately, do not usually act the way you think they would :-)

    Through testing, you can figure out how they act on your site. And each site is unique, so something that may work on another site, won't on yours.

  14. #14
    Quote Originally Posted by Lightning2000 View Post
    Color me slow, cabin-fevered, or whatever, but what is an A/B split test?
    A/B split testing is one of the core methods of improving your site's conversion rate. When you built your site, it was generally a creative process (tangent: Although it should no longer be a creative process which is why there are so many poorly designed sites out there. People are attracted to "pretty" sites and low-cost designs instead of designing from a conversion perspective) where you usually discuss what could happen on your site. Once you launch your site, you have your analytics which answers the question "is it working?"

    A/B split testing can be effectively used to find out how closely you're matching the visitor's expectations and allow you to test ideas that will help increase engagement and therefore increased revenue into your pocket. It is much more than changing colors and buttons.

    For example, I know if I look at most of your sites your product pages focus on features instead of benefits. Remember:

    • A feature is what your product or service does
    • A benefit is what your product does for them

    So you could do a test of your main product...page A would be your traditional list of features and then page B would be a list of features. The software would randomly show page A or B to your visitors measuring engagement and/or goals (e.g. buying). After time, the software would declare a winner and you could measure that page B drove 20% more sales than page A (for example).

    I love this quote "A man who goes into a hardware store to buy a quarter-inch drill bit does not need a quarter-inch drill bit -- he needs a quarter-inch hole"

    What does your customer need? A/B split testing can give you those answers...
    Erik Ellsworth
    Free SEO Analysis

  15. #15
    has anyone tried the Google method? I see you need to paste additional code onto the original version of the page only.... just wondering how the did this. ( they ask for the code to be in the head tag, which would put it on all pages via template..) guessing some Java is needed so it only triggers on the home page ( if a/b testing home page)

Similar Threads

  1. GWT just dropped all links to my home page???
    By GGG in forum Search Engine Optimization
    Replies: 20
    Last Post: 02-12-2013, 07:52 AM
  2. Tested on V Test Store?
    By AWCthreads in forum Site Performance
    Replies: 3
    Last Post: 09-06-2012, 12:07 PM
  3. centering stuff on home page?
    By Laura Mapchick in forum Store Design
    Replies: 2
    Last Post: 08-27-2012, 10:27 AM
  4. Google +1 for home page
    By KKS in forum Social Media
    Replies: 6
    Last Post: 07-10-2012, 10:34 AM
  5. Test your site in all browsers
    By GGG in forum Store Design
    Replies: 2
    Last Post: 06-15-2012, 08:43 AM


Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts