By looking only for that first rotational gesture, the Matchpoint system does not need to be initially calibrated and it can recognize this first "pay attention" command whether you're standing in front of the TV or sitting farther back in the room.
After triggering the system with the first gesture, an onscreen menu pops up presenting further options, contextual to whatever TV program you're using. Let's say you're watching a video. The menu might give you two options — playback and volume. Rotate your coffee mug to sync with the movement onscreen and the system knows to watch your mug for playback commands. From that point on, every time you rotate the mug clockwise, the video will fast-forward. Go counter-clockwise and the playback will rewind.
RELATED: These Wireless Earbuds Provide Real-Time Foreign Language Translation
Meanwhile, you could map the volume to your left hand, say, and the system starts tracking that hand. Raise your hand and the volume increases. Lower it and … well, you get the picture.
Christopher Clarke, developer of the technology and a Ph.D. student at Lancaster University's School of Computing and Communications, said the goal with Matchpoint was to create a gesture control system where users could essentially improvise.
“Our main aim in developing MatchPoint was to provide users with a technique that does not constrain how they interact with the system,” Clarke told Seeker. “Current gesture technology places limitations on how the user can interact with the system — mustn't be holding an object, must be clearly visible to the camera, and standing two meters away. [With Matchpoint] users are free to use any body part or object to interact with the system, and it does not require the user to be in a specific position such as sitting or standing.”
The gesture control assignments can be decoupled at any time, and the system resets itself when you turn off the TV or switch to another application. Going the other way, you can program the system to remember a “long-term coupling,” in which case your mug would always control playback and your left hand would always control volume.
RELATED: Microsoft Is ‘Infusing AI Into Every Product and Service’ It Offers
Clarke said the system has additional applications for anyone who needs to control a video while holding an object — if you're wielding a mixer while following a recipe, say, or a drill while watching a YouTube instructional video. Matchpoint could also prove useful for anyone with a disability that prevents the use of a traditional remote control.
For now, Matchpoint is in an early prototype phase, Clarke said, and it will be a while before the technology has any chance of making into the commercial market.
“We are currently looking into commercialization opportunities, but it is a little bit too early to say at the moment,” Clarke said. “The applications we find most interesting involve 'sterile' applications, such as surgery or working in the kitchen, where it is desirable to have a system that users can use any type of object with and doesn’t involve touching things and cross-contaminating objects.”
WATCH: This New 'Perfect' Battery Has Experts Stumped