Multimodal Interaction in Augmented Reality

Multimodal interaction is having various forms of input modes to interact with the system and user can use different interaction methods sequentially (use one mode at time only) as well as simultaneously (more than one mode at a time). I have used sequential multimodal interaction technique for this project. To know more about Multimodal Interaction, click here.

Initial Sketching 1

Initial Sketching 2

Prototype design for interface

Prototype design for interaction 1

Prototype design for interaction 2

ML_Controller.mp4

Final Outcome: Interaction with Magic Leap Controller

To view the controller interaction, click on the video.

ML_HandGesture.mp4

Final Outcome: Interaction with Hand Gesture

To view the controller interaction, click on the video.