We develop a smart TV system that uses volley gestures to control multiple applications for the application scenarios of smart TV environments. The related applications include movie recommendation, community, call, weather information, chat room and travel platform. In addition, provide in Windows X, volley gestures are used to implement the functions of presentations, browser search, media playback, etc., replacing traditional hardware input methods.

This technical contribution defines a set of generic gestures which are suitable for operating a range of smart applications, and integrates smart TV control interfaces for general gestures such as movies, travel, social groups, cell phone calls, and chat rooms. The Gesture Finite State Machine is another contribution that defines the manipulation flow gestures between smart applications.

The current research and development results prove that the user can directly train the user＇s new custom gestures in real time without changing the structure of the model. This custom gesture control system can be applied in some fields such as medical, large interactive billboards, virtual interactions and the like in connection with the contactless interface.