Towards a Hand-Based Gestural Language for Smart-Home Control Using Hand Shapes and Dynamic Hand Movements

The application of gestural application can vary a lot: from a simple pointing mechanism to a visual sign language. Application of gestural interaction as a sign language with a proper formalism to interact with the technology has not been studied much. In this work, we present our Kinect-based gesture recognition system that is able to recognize personalized hand shapes and dynamic hand movements. We then describe how we created a “language” for smart-home control based on a specific syntax over sequences of hand shapes and hand movements.