Gesture Control Interaction

Creative Director

 

Client: YouSpace

Team: Designers, Engineers

The future of user interface - Touch-free gesture control interaction.

Do you ever imagine having superpowers like Doctor Strange or owning Iron Man’s studio? Imagine your home environment knowing what you want by recognizing your hand gestures and body movements by waving your hand to change TV channels or draw a circle to turn on the fan, etc. Imagine having no more remote controls, touch screens, or VR headsets. 

YouSpace’s proprietary technology is focused on recognizing human body pose, gestures, and movements. This technology can integrate into our environment and make superpower fantasies real.  

The Challenge

Design a visually responsive gesture control users can interact with.

 
 
 

 

Visual Feedback Interaction Study

How to give the user feedback for free-hand gesture and body movement recognition? 

There are no physical buttons or a device to provide tactile feedback to the users. All recognition depends on real-time body movement; therefore, visual interactive feedback becomes critical for users to command the environment or space around them.

We studied and developed a set of visual interaction libraries. 

 
 

1st Prototype Showed to Investor Has Raised 4 Million USD, 2016

The first functional prototype, 2016 - Fast, Accurate and Lightweight.


 

Point To Select

 

Swipe Left Or Right

 

2 Hands To Zoom, Enlarge or Expand

 

Superpower Gestures

 

Full Body Tracking

 

 

Deployment

In 2017, YouSpace successfully deployed a touch-free interactive display at Parc Central Mall in Guangzhou, China. It featured games and advertising to attract customers to the store. Within 7 months, we were able to capture 400,000 poses with ~57,000 individuals.

 

Fire & ice interactive big screen, Parc Central Mall, China.