Date of Defense

3-28-2025

Date of Graduation

4-2025

Department

Statistics

First Advisor

Halil Dursunoglu

Second Advisor

Jason Johnson

Abstract

The Mixed Reality Heart Anatomy Lesson was created to address the WMU Homer Stryker M.D. School of Medicine’s need for an interactive and dynamic laboratory lesson. The application allows for a more efficient way for medical students to learn and comprehend the material. The design and development of a mixed reality application running on smart glasses provides students with a situation aware, fully engaged, and immersive learning experience. The Apple Vision Pro device allows medical students to complete their labs by merging physiology and anatomy concepts through 3D models, object detection, self-assessments, and an artificial intelligence chatbot. There can be somewhat of a disconnect between the anatomy they are learning in the lab and the physiology they are learning in the classroom. The application addresses pre-established learning objectives. Each lesson consists of a content-based page followed by 3D heart interaction practice and an AI chatbot that recognizes voice input. We implemented object detection, allowing the system to recognize a physical heart model and map it to a digital model, like a “digital twin,” providing users with a more immersive and realistic learning experience. Moreover, users have the possibility to assess their knowledge by the end of the lessons through two multiple choice quizzes. The objective of the Mixed Reality Heart Lab lesson is to create an innovative and convenient heart anatomy laboratory lesson for medical students using the Apple Vision Pro device. The application offers an interactive experience that integrates physiology lessons with immersive 3D anatomy exploration. The user can engage in nine different content-based lessons followed by 3D interaction and physical heart detection. Moreover, a chatbot is present throughout the lesson to answer any immediate questions through text or voice command. The main goal of the mixed reality heart lab is to provide users with engaging, innovative, and convenient anatomy lessons.

Comments

Co-authored with:

Aiden Kim

Iskandar Kholmatov

Jim Park

Martina Veit Acosta

Camilla Vincent

Access Setting

Honors Thesis-Open Access

Additional Files
Presentation.pdf (3024 kB)
Defense Presentation
Poster-Senior Design (1).pdf (698 kB)
Poster
Download

Included in

Data Science Commons

Share

COinS