Entrust Content Creation

Goal

To make the exam platform scalable and customizable, a content creation platform is needed. The goal for this platform is for it to be a user-friendly interface that allows content experts without any computer programming background to directly create case scenarios and deploy them on the platform.

When designed this platform, we ask ourselves, what kind of system could better support the needs of the exam platform?

Outcomes

We built an ecosystem that enables the surgical professionals in different EPAs level to create exam contents, take exams and assess trainee's performance in terms of surgical decision-making.

This case study mainly focuses on the design process of the content creation platform. Other case studies of this ecosystem: the exam platform and the design system.

Time
Feb 2020 - Present

Client
Stanford Medicine

Role
UX/UI Design
Visual Design

Team
Edward M. | Principal Investigator
Oleksandra K. | PM
Fatyma C. | Character Artist
Jason T. & Ruonan C.| Engineer

  How might we enable content experts to create surgical exams for different patient cases and diseases efficiently and make the platform scalable and adaptable?       

Design Research

The Ecosystem

A new ecosystem containing three collaborative platforms is constructed, which contains a content creation platform that creates new patient cases for trainees to test, an exam platform that provides tests in a highly simulated environment, and an evaluation platform that collects, visualizes, and analyzes trainee data.

Primary Research

For this content creation platform, we started conducting user interviews in order to gain insights on content experts' needs when authoring the exam.

Affinity Map

Solutions

The goal of this platform is to the process creating new cases convenient and offer flexibility for customization. The design follows a hierarchal and template-based principle to simplify the complex process. As the flow shows, the author will be sorted into different tiers of management level, which gives them the different authority of editing the content.

User Flow

Authority hierarchy

The authoring platform has three key panels: order, case, and exam. The accessibility of panels is limited to authors with different authorization. Therefore, authors only need to customize a few components based on the template created by authors who own higher authorization.

For example author tier 1 could import the lab value in the order panel, which could be used in creating a trauma patient case by author tier 2. Finally, author tier 3 could assemble those cases into an EPAs exam.

Three Panel

We leverage Angular Material Design to design the style of the interface.

1

Order Panel

Users can add or edit orders, such as add a fluid, change a medicine's properties, etc. All the changes will be automatically applied to the case panel and exam panel.

2

Case Panel

Users can create or edit patient cases. For instance, customize patient avatars, input physical exam diagnosis, etc. All the changes in this panel will automatically be updated in the exam panel.

3

Exam Panel

Users can create exams that combine the existing cases and reorder the cases.

Multi platforms integration

In the case panel , the patient graphics can be tailored in the content creation platform to reflect the age, ethnicity, body habitus and physical findings of the patient.  

When published, a corresponding patient avatar will show on the exam platform. For example, these two images on the right side indicated the different clinical settings, gender, and body feature of patients.

The relationship between the content creation platform and the exam platform

Patient creation part in the content creation platform

A female inpatient

A male outpatient

Validation

Usability Test

We conducted usability tests frequently with clients. I gathered feedback in each process to iterate the user flow till they're satisfied with the result.

Achievement

Overall Improvement

Compared with the traditional in-person verbal interrogation via the oral boards and the old platform, Entrust has improvements in the following aspects:

Factors
Oral Board
(Traditional Way)
Sicko
(Old Platform)
Entrust
(New Platform)
1. Features standardized scenarios
2. Less time-and resource-intensive
3. Minimizes bias and subjectivity of faculty
4. Reduces the burden upon faculty to complete evaluations
5. Reproducible
6. Use as clinical judgement for rarely encountered yet critical scenarios

Project Impact

I'm glad this project has been going very well and received beyond expected results:

Improved trainees' performance in the pilot test

Won Excellence in Research Award in ACSCC 2021

Won two grants

Collaborated with institutions from 15 counties

After graduation, I‘m hired by the clients as a contractor to keep working on it and further expand the platform in order to reach out to broader audiences.

Reflection

Working with the team and clients who are passionate about making the idea come true is so lucky. Everyone is eager to learn to make things perfect. Through this process, I learned:

  • Clients have great insights about the process and have a lot of valuable feedback. It's helpful to create an environment that both designers and clients are confident to discuss.
  • It's professional to conduct the research in each stage, whether or not it's just a quick interview or playtest.
  • Defining the opportunity and success metric for each stage is important.
  • It's important to sync the progress regularly in order to get instant feedback.