Date of Defense

4-16-2019

Date of Graduation

4-2019

Department

Electrical and Computer Engineering

First Advisor

Steven Durbin

Second Advisor

Bradley Bazuin

Abstract

A system which consists of two wirelessly enabled data gloves and two windows desktop applications which enable downward hand motions and motion captured from two cameras to trigger MIDI note events and generate sound was created. The data gloves consist of a battery, mini-USB lithium-ion polymer battery charging module, and a tinyTILE development board. The Intel Curie module on the tinyTILE, which houses an MCU, Bluetooth 4.0 transceiver, and IMU, allows the direction and angle of the user’s hand movements to determined and the data transmitted to a PC via the Bluetooth Low Energy protocol.

Motion detection algorithms, implemented with the Open Computer Visual library and the EMGU.CV wrapper for C#, count the total number of motion pixels within each frame of the camera feeds. The user’s hand movements and motion pixel count are used to trigger MIDI note data. The MIDI data is sent over a virtual MIDI port opened by the virtual MIDI driver (created by Tobias Erichsen and used with his consent) to a proprietary audio sampler. The audio sampler then generates bongo drum sounds via its two channels and included royalty free bongo sample library.

Access Setting

Honors Thesis-Restricted

Download

Share

COinS