Multimodal Interaction

Multimodal Interaction

Multimodal Interaction - The Project

A virtual piano that can be played by gesture with a kinect.

CW: 27

mmiPosted by Maria 06 Jul, 2015 01:12:59

We now have a functional, interactive menu, where the user can switch between four different instruments and rhythm patterns.

The menu is usable by keyboard and gestures. The speech recognition is still not really reliable, but we are working on this problem.

Our first impressions of a virtual piano changed to a virtual music pad. It's now easy to implement more instruments and rhyth pattern. But at this point we are happy that it's working.

What we need now is the final input of the project and the production of the video for our final presentation.



  • Comments(0)//mmi.formisano.me/#post8