Review analytics of community and contribution header

[Tosin-Balogun]

What

We need to review the performance of the new header for the community section of the service manual website

Why

Since we made the change to the header from 'community' to 'community and contribution', we need to see if this has had any effect on our page sign posting

Related

#1003

[Tosin-Balogun]

Community VS Community and contribution

Methodology

People were asked to complete a first click test on Optimal Workshop. They were given the following task to complete:

Your team has created a new way to show images on the website. It recently tested well with users. You want to share this with the service manual team so it can be added to the service manual. Where would you click to do this?

They were asked to complete this task twice, but shown different screens each time. The task order was randomised to reduce order effects.

Results

The image on the left shows the control screen, showing just the word "Community" in the main top navigation, and in the card navigation.

The image on the right shows the variation screen, showing the words "Community and contribution" in the main top navigation, and in the card navigation. 

Control

67% of people successfully clicked either the "Community" link in the main top navigation or the "Community" card.

• 6% clicked the community link in the main top navigation
• 61% clicked the community card

Other places people clicked included:

• 3% clicked the "Content style guide" link in the main top navigation
• 3% clicked the "What's new" link
• 25% clicked the "get in touch" link

People took 16.8 seconds on average to do their first click.

Variation

72% of people successfully clicked either the "Community and contribution" link in the main top navigation or the "Community and contribution" card.

• 41% clicked the "Community and contribution" link in the main top navigation
• 31% clicked the "Community and contribution" card

Other places people clicked included:

• 6% clicked the "Design system" card
• 19% clicked the "get in touch" link

People took 13.3 seconds on average to do their first click.

Recommendations

• The control and variation don't have much difference in success rates. This indicates that people are probably familiar with the word "Community" and what it means. There was not much difference in success rate between people who used the service manual and people who did not. However, there were only a small number of participants who had not used the service manual before.
  -- More testing could be done with people who don't regularly use the service manual. 
• On average, people were able to find the "Community and contribution" link slightly faster. This indicates it might be a little more recognisable as the right place to complete this task.
  -- More testing could be done with different tasks.
• A high proportion of people are still clicking on the "get in touch" link. We should look to repurpose this link, or make a more obvious distinction between "get in touch" and contributions areas.
  -- Investigate how to distinguish between "get in touch" and allowing people to make contributions.