Design Evaluation (UX) - Fall 2021 Academic Project
Partnering with Planted Meals, they requested we evaluate a new design for their website and ordering process.
My role was to conduct a heuristic evaluation and design, then conduct the observational study.
Conduct a design evaluation with a partner company. Work with them to complete an evaluation that fits their needs.
A heuristic evaluation and an observational study to test the website's usability.
User Study Researcher
5 Weeks (2021)
When we first contacted Planted Meals, a vegan meal delivery service, they had been working on redesigning their website. They wanted insights on the new design regarding usability concerns and what kind of personality it gave off.
We decided that a heuristic evaluation and an observational study would be most comprehensive in the short allotted time frame of 5 weeks. While a controlled study was considered, early feedback revealed that we would be able to garner more data with a less controlled, observational study.
My role was to complete an individual heuristic evaluation and lead, then conduct the observational study.
Research questions used to guide our study.
The heuristic evaluation was used to gauge the usability of the new ordering process using Jakob Nielsen's 10 Usability Heuristics.
We individually performed a heuristic evaluation based on a task for an intended user, a vegan who worked from home and was often too busy to make their own meals.
The task was to: Make a ‘One Time Purchase’ of two Kale Caesar Salads, and one chocolate chip cookie to your cart. On the order confirmation page, add a Chickpea Smash Jar.
I led the design of the observational study which compared the current and new mobile websites and was designed to analyze personality and usability, addressing Planted Meals' initial requests
Most studies were conducted remotely, as such, Google Forms was used to guide participants through tasks. A pre-study questionnaire helped us understand participants' demographics and familiarity with food ordering platforms.
They completed four tasks and were asked to think aloud their thoughts so we could better understand their actions and when necessary, to elaborate on their thoughts:
The mobile device was screen and audio recorded for the purpose of further analysis. The post-study questionnaire asked participants questions regarding the sites’ personality and usability.
As the new designs were currently only responsive for mobile, the study was conducted for that size.
From my individual heuristic evaluation, the notable issues I found were:
Heuristic: Minimize Memory Load
No prices shown within the "Frequently Bought Together" section
Gray colours are used when the buttons are meant to be clickable
Heuristic: Provide Clear Exits, Provide Shortcuts
In the order process, users cannot easily jump to different steps
Triangulating data from the Heuristic Evaluation and Observational Study, we used Affinity Diagramming to group data through several layers of categorizing before summarizing and analyzing the results.
1. How do users feel about the personality of each site?
The majority of participants liked the new website, citing a clear brand identity, with improved colours and layout.
2. Are there usability issues in the ordering process and other pages of the website?
While users generally found the redesigned website easy to navigate, there were a few areas of concern.
An early challenge we faced was that we did not have access to recruit existing Planted Meals' vegan customers and used external participants.
While 5 weeks was fine for the scope of the project, with more time I would have recruited a larger number of participants. They could then be grouped into separate groups such as experts and non-experts, which would have yielded more extensive results in the usability testing.
At the end of the term, we presented our study to Planted Meals and received positive feedback. We sent them our report detailing all issues encountered and they noted that they would take our recommendations into account as they continued working on their redesign.