Skip to main content

https://defradigital.blog.gov.uk/2024/12/23/using-hypotheses-to-improve-our-content-review-process/

Using hypotheses to improve our content review process

Posted by: , Posted on: - Categories: Defra content design, Defra digital, User centred design

Continuing our series on Defra content community projects, content designer Lauren Stopps writes about a project to improve the content team's internal review process.

Did you know, every piece of content or change published by a member of the Defra content team must be reviewed by a second content designer? They make sure the original editor hasn’t missed anything and give the final nod to publish. We call this a ‘second pair of eyes’ or ‘2i’ for short.

Our community project team found the content review process lacked consistency and clarity, with no standard approach among Defra content design teams.

A better 2i process

We found the current 2i process is:

  • not as clear as it could be, particularly for content designers with less experience
  • causing uneven workloads
  • creating inefficiencies in content publishing
  • not ensuring consistency across our content to the level we'd like

Ultimately, this affects both Defra stakeholders and our users.

How we approached the problem

As content designers we regularly set and test hypotheses to make improvements.

Hypotheses help us explore different ways to solve a problem. They include:

  • the action you will take
  • what effect you expect
  • how you will measure it

They should also be based on data and evidence.

Creating hypotheses

Hypotheses can be based on outcomes for users or changes to key performance indicators. They help us make sure the changes we make have the effect we wanted.

We based ours on solving the problems we’d identified with the current 2i process. For example, through surveys and focus groups we found:

  • 57% of respondents ‘disagreed’ when asked if they felt comfortable balancing content reviews with other work priorities
  • 71% ‘disagreed’ when asked if they allocated time during their working week to review other content designers' work
  • 29% ‘strongly disagreed’ when asked whether they get the same sort of feedback regardless of who is reviewing their work

As a project group we used these results to create our hypotheses. These address bottlenecks and pain points in the current 2i process.

We used the formula:

We believe … will …
We’ll know this is true when …
We believe this will ultimately help improve …

Essentially, our hypotheses were based on potential solutions to user pain points.

An ‘internal review’ rota

Our initial hypothesis said:

We believe a rota will ensure balanced workloads and reduce workload-related blockers for the 2i’er and the requester.

We’ll know this is true when there’s a reduced timeframe between a 2i request being submitted and it being actioned.

We believe this will ultimately help improve the overall amount of time it takes to 2i.

A ticketing system

Our second hypothesis said:

We believe a ticketing system with templates for requests will ensure the requester knows exactly what information is needed by the 2i’er and why.

We’ll know this is true when there is a drop in requests for missing or additional information and the reviewer knows what level of review is needed.

We believe this will ultimately help improve the overall amount of time it takes to 2i, make 2i’ing easier, and improve the quality of 2i’s.

Training and guidance

Our third hypothesis said:

We believe training and guidance on the end-to-end process of 2i’ing will standardise the 2i process and improve confidence and understanding for the 2i’er and requester.

We’ll know this is true when pulse checks after the training result in a reduction on mistakes missed in 2i’s.

We believe this will ultimately help improve the length of time to 2i and quality of 2i’s as well as democratisation of the 2i process.

Reduce jargon

Our final hypothesis said:

We believe a clear and plainer describing process will make communication easier for stakeholders and new starters.

We’ll know this is true when there is a reduction in errors being missed in 2i’s and increased engagement with crits and peer reviews.

We believe this will ultimately help improve the quality of published content and understanding of the process.

Next up

We’ll check our hypotheses with the wider content team. After gathering their feedback, we can test the hypotheses and analyse the data to understand the effect of the proposed solutions. Did we get it right? We’ll blog again when the results are in.


Check out our LinkedIn page for all the latest news, stories and job openings. While you're there, why not give us a follow.

Sharing and comments

Share this page

Leave a comment

We only ask for your email address so we know you're a real person

By submitting a comment you understand it may be published on this public website. Please read our privacy notice to see how the GOV.UK blogging platform handles your information.