User Experience research and testing helps sell EV Certificates

The User Experience team was involved in the SSL marketing team's effort to sell our new EV (Extended Validation) certificates. The first EV-compatible browser, IE7, turns the URL field green if the Web server has an EV SSL Certificate installed.

Research methods

In late 2006, our team did research was to learn whether users would notice the green bar with no additional information, and secondly, if once they learned what the green bar meant, if they would respond positively to it. We gathered more than 70 users, typical online shoppers who had a greater than minimal interest in online security to participate in a WebEx session during which they would go through two mock sites —one with EV, and one without, and answer questions.

Brian put together a prototype and took 56 participants through a series of steps for each site, and recorded their sessions.

The results from the VeriSign User Experience department

The results from this research were very positive, both about the green address bar of EV, and about VeriSign.

  • 100% of participants said they will notice the green bar in the future.
  • 100% of participants said they are likely to share credit card information with a site that shows the green bar.
  • 98% of participants preferred to shop at the site that shows the green bar.
  • 91% of participants said they preferred the name "VeriSign" as the issuer of the EV certificate.

Krista Van Laan wrote a white paper, but the results were so strong for VeriSign, it seemed that in order to promote this to potential customers, we needed to be scrupulously certain that these numbers would hold up. It was determined that we would hire a neutral third party to let them do similar testing with more users, and let them collect and guarantee the results. We hired Tec-Ed, Inc., an Ann Arbor-based usability and research company, to perform a similar study, testing a greater number of users for better statistical accuracy.

The results from Tec-Ed

The User Experience team provided Tec-Ed with a test plan and prototype. Tec-Ed interviewed and performed similar studies on 384 users in a blind test (not telling them the session was sponsored by VeriSign). In early 2007, the results were in, and taking into account the range of projected statistical accuracy, were almost identical:

  • 100% of users expect to notice sites with the green EV address bar in the future.
  • 97% of users say they are likely to share their credit card information with sites that show the green bar.
  • 93% of users prefer to shop on a site that displays the green EV address bar.
  • 97% of users recognize the name "VeriSign." The CA with the next-highest recognition factor is recognized by 65% of users.
  • 88% of users stated a preference for or a feeling of trust or security using a VeriSign-protected EV site. The next-highest response to any other CA was 22%.

A second, more comprehensive white paper was put together just in time for Tim C to take to the 2007 RSA conference, where it got a lot of attention. For the User Experience group at VeriSign, we were glad to have concrete proof that our methods are reliable. For one-eighth the price of the consulting company, our results were almost identical.