During the Fall Semester 2018, the students were expected to respond to these important issues:
- Explore and identify a design opportunity around a specific theme in which mixed reality (MR) is a game changer.
- Design a system that considers a hard and software design concept for a mixed reality experience.
- Ideate scenarios that demonstrate an improved task flow enabled by mixed reality.
- Tell the story of why mixed reality makes this specific experience better.
- Visualize details of the mixed reality design.
- Realize and test ideas using ThingWorx Studio software, Unity and the Microsoft HoloLens.
- Apply the user centered, stakeholder focused design process.
The students researched in teams of four and developed their concepts in teams of two. Since I taught two sections I was able to introduce two main topics. Section 1 focused on the theme “How MR could impact Simulation and Training?”. Section 2 focused on the theme “How MR could impact the Design Process?”
It was important to introduce students to the current capabilities of AR/VR/MR technology. We had access to a HTC Vive VR headset and a Microsoft HoloLens.
The students explored various visualization possibilities.
Storyboarding was essential to quickly describe an activity sequence. Gravity Sketch on the HTC Vive was great to explore and ideate in 3D.
Photo-shopped panorama images showed more refined steps of the envisioned MR experience including possible interaction input.
These are selected project overview videos:
The L bot is a surveillance robot for museums.
This concept was envisioned by Dong Hyeok (Justin) Lee and Dongwhee (Claude) Lim.
Optimizing Warehouse Safety Through AR Glasses
This concept was envisioned by Quinn King and Alec Gillinder.
The Forklift Training Lab is a VR Trainer for current and aspiring forklift operators.
This concept was envisioned by Jingfu Chen and Nick Ng.