Mixed Reality - CPR, firefighting & medical training

Mixed Reality - CPR,
firefighting 
& medical training

Mixed Reality -
CPR, firefighting
& medical training

CREATIVE DIRECTOR, UI / UX, ANIMATION, VISUAL DESIGN, PHOTO/VIDEOGRAPHY

CREATIVE DIRECTOR, UI / UX, ANIMATION,
VISUAL DESIGN, PHOTO/VIDEOGRAPHY


CREATIVE DIRECTOR, UI / UX, ANIMATION, VISUAL DESIGN, PHOTO/VIDEOGRAPHY

Mixed Reality is an emerging tech that overlays virtual objects over your environment and on top of anchored elements that you can interact with using your own hands. This is especially useful for training as it uses the context of user' actual (work) environment, it can simulate situations that are otherwise impossible to experience in regular trainings and  there's no need to use controllers, unlike VR.

We used this technology to develop innovative and engaging training courses for the medical and safety industries.

Floating Hololens 2

Summary

Behind the scenes // process

Behind the scenes // process

Context

The problem
Health and safety training is often seen as dull and stagnant, lacking innovation and priority in the industry. Common complaints include inflexible scheduling, high costs, and limited effectiveness. Mandatory yearly training is repetitive and uninspiring, often reaching only a select few in organizations.

The problem
The health and safety training sector is often seen as stagnant and unexciting, with slow innovation. While many acknowledge the importance of training for life-threatening situations, it often lacks priority. Common complaints include inflexible scheduling, high costs, and limited effectiveness. Yearly mandatory training is uninspiring, repetitive, and doesn't simulate real danger, typically reaching only a select few in organizations.

The goals

The goals

  • Use Mixed Reality with the HoloLens 2 to create realistic and immersive trainings that can teach users essential life-saving skills in ways that can't be replicated with traditional trainings.
  • Lower the barrier to entry by making training accessible for anyone that wants to learn at any time in an organisation.
  • Boost learning retention, confidence, and cost-effectiveness through flexible and scalable usage.
  • Make sure products are user-friendly & easy to use despite the target audience's hesitance towards new tech and having interaction patterns that (almost) nobody is used to.
  • Create a company brand that stands out as fun, inspiring and solution-focused compared to competitors that mostly focus on the gimmicky newness of the technology and often feel very administrative and dry.
  • Comply with established guidelines and be aware of anything
    that can reflect negatively on the organisation' reputation.
  • Ideally use the established color palette, art direction & tone of voice.
  • The game should be playable in both English and German.
  • The game should be playable within ~1h by 3 to 6 people in a relaxed
    setting while still providing a clear take-away of info & understanding.
  • The physical element should be easy to (re)produce, resist
    basic scratch damage and lends itself to be dismantled for storage.
  • The game should be playable in different settings & environments,
    with various lighting conditions that can affect object tracking. 
  • Use Mixed Reality to create realistic & immersive trainings that teach users essential life-saving skills in ways that can't be replicated with traditional trainings.
  • Lower the barrier to entry by making training accessible for anyone that wants to learn at any time in an organisation.
  • Boost learning retention, confidence, and cost-effectiveness through flexible and scalable usage.
  • Make sure products are user-friendly & easy to use despite the target audience's hesitance towards new tech and having interaction patterns that (almost) nobody is used to.
  • Create a company brand that stands out as fun, inspiring and solution-focused compared to competitors that mostly focus on the newness of the tech or feel very administrative and dry.

My role

As creative director, I've led & collaborated with the company' designers, developers, marketers, interns and internal + external stakeholders. Upon joining I was responsible for conceptualising and creating the brand strategy & identity. I also managed the creation of the mixed reality software, marketing campaigns and contributed to overall business & brand strategy. Given my technical knowledge, I functioned as a bridge between the founders, clients and devs to translate objectives, business goals, client wishes & timelines into actionable & realistically exexutable plans.

  • Comply with established guidelines and be aware of anything
    that can reflect negatively on the organisation' reputation.
  • Ideally use the established color palette, art direction & tone of voice.
  • The game should be playable in both English and German.
  • The game should be playable within ~1h by 3 to 6 people in a relaxed
    setting while still providing a clear take-away of info & understanding.
  • The physical element should be easy to (re)produce, resist
    basic scratch damage and lends itself to be dismantled for storage.
  • The game should be playable in different settings & environments,
    with various lighting conditions that can affect object tracking. 

The process

  • Facilitated brand workshops with the founders, core staff and clients to distill the company's essence so I could develop the brand strategy & identity.
  • Software created through agile development, two-weekly release cycle.
  • Continuous user testing with user groups, both target audience & clients. Incl. journey mapping, (paper) prototyping, usability testing and A/B tests.
  • Comply with established guidelines and be aware of anything
    that can reflect negatively on the organisation' reputation.
  • Ideally use the established color palette, art direction & tone of voice.
  • The game should be playable in both English and German.
  • The game should be playable within ~1h by 3 to 6 people in a relaxed
    setting while still providing a clear take-away of info & understanding.
  • The physical element should be easy to (re)produce, resist
    basic scratch damage and lends itself to be dismantled for storage.
  • The game should be playable in different settings & environments,
    with various lighting conditions that can affect object tracking. 

The outcomes

  • Created multiple MR apps for B2C & B2B. incl. schools, businesses & hospitals. They reported a faster pace of learning, better staff performance and increased learning retention compared to traditional learning.
  • Extensive user testing revealed recurring and rewarding feedback; users expressed they finally felt confident and empowered to act in time of need.
  • Created a unique brand that stood out from its competitors
  • Managed to reach the national news multiple times.
  • Became official Microsoft Silver Mixed Reality partner.
  • Comply with established guidelines and be aware of anything
    that can reflect negatively on the organisation' reputation.
  • Ideally use the established color palette, art direction & tone of voice.
  • The game should be playable in both English and German.
  • The game should be playable within ~1h by 3 to 6 people in a relaxed
    setting while still providing a clear take-away of info & understanding.
  • The physical element should be easy to (re)produce, resist
    basic scratch damage and lends itself to be dismantled for storage.
  • The game should be playable in different settings & environments,
    with various lighting conditions that can affect object tracking. 

AR, VR, and MR?

AR, VR, and MR?

AR, VR, and MR?

Hot damn, there's a lot few terms nowadays. No worries, check out the video to see what the difference are!

Hot damn, there's quite a few terms nowadays.
No worries, check out the video to see what the difference are!

Hot damn, there's quite a few terms nowadays. No worries, check out the
video to see what the difference are!

In a nutshell

Phone AR icon

Augmented Reality
AR puts a digital layer over reality that you control through an interface, like a phone or tablet.

Augmented Reality
AR puts a digital layer over reality that you control
through an interface, like a phone or tablet.

Augmented Reality
AR puts a digital layer over reality that you control through an interface, like a phone or tablet.

Man VR icon

Virtual Reality
VR shows an entire virtual world, taking you out of reality. You will need to use controllers to interact.

Virtual Reality
VR shows an entire virtual world, taking you out of reality.
You will need to use controllers to interact.

Virtual Reality
VR shows an entire virtual world, taking you out of reality. You will need to use controllers to interact.

Female hololens 2 icon

Mixed Reality
MR blends digital elements with the real world, which you can interact with using your hands.

Mixed Reality
MR blends digital elements with the real world,
which you can interact with using your hands.

CPR plus logo

CPR+

CPR+

Would you know what to do if someone had a cardiac arrest right now? 🤔 If not, you’re not the only one. Enter CPR+, the Mixed Reality course that teaches you all the steps to perform a resuscitation, whenever and wherever you want.

The HoloLens 2 projects a lifelike digital victim over a CPR dummy. The app guides you through each step, while keeping track of your progress to share feedback along the way.

 

 

 

 

 

 

Fire plus logo

Fire+

Fire+

Fire+

If a fire would start near you, would you know how to act? 👩‍🚒 A fire occurs more often than you might think. With Fire+ you'll learn how to deal with different fire types and fire extinguishers in a playful way.

Through guidance or by experimenting yourself, you learn what works, what doesn't, and why. You see the consequences of wrong choices to learn what the impact can be. For example, throwing water on a grease fire is quite… exhilarating.

 

 

 

 

 

 

 

Vital plus logo

Vital+

Training medicall staff on realistic scenario's is limited, given a lot of accidents & conditions can't be fully replicated by actors. With Vital+, the ABCDE method is trained using mixed reality, which overlays a victim on top of a dummy with sensors.

A trainer can trigger interventions & monitor how staff is performing on the patient. This way an entire procedure can be trained,  incl. swellings, increases in blood pressure, fainting, etc.

 

 

 

 

Keep on innovating!

Keep on innovating!

Keep on innovating!

Chicken dancing animation

Highfive for reading the whole thing!

Wow, you made it down here!

If I can help you with a similar project, let's talk.

Other projects

Branding Zero Emissions WorldGamifying an impactful climate NGO

Covid-19 RapidpassAlleviating the Philippines' medical system

The future of energyHow to create a sustainable energy grid

Molecules to MedicineAn AR journey through innovation

Managing the GridInto the future of rail logistics

Infectious FanaticsStories of intense fans

Daily RendersCadence of Pixels

Daily UIInterface explorations

3D PlaygroundExploring polygons

Tangible LettersFont personalities visualized

Fading BoundariesHumans x Digital

LinkedIn
Medium
Dribbble