Sunday, April 23, 2017
Search
  
Submit your own News for
inclusion in our Site.
Click here...
Breaking News
Questions Remain About The Fate Of Toshiba's HDD and SSD Business
SK Hynix Develops First 8Gb GDDR6
Call of Duty Game Returns to WWII
Twitch to Sell Video Games
Apple May Invest in Boeing Satellite Broadband Project
Chrome's Rumored Ad-blocker May Not Be Exactly an Ad-blocker
GM To Launch Electric Cars in China by 2020
New HP Zbook Laptops Take On Apple's Mac Pro
Active Discussions
Which of these DVD media are the best, most durable?
How to back up a PS2 DL game
Copy a protected DVD?
roxio issues with xp pro
Help make DVDInfoPro better with dvdinfomantis!!!
menu making
Optiarc AD-7260S review
cdrw trouble
 Home > News > General Computing > Researc...
Last 7 Days News : SU MO TU WE TH FR SA All News

Thursday, July 18, 2013
Researchers Use Kinect As Digital Assistance To Sign-Language Users


Researchers from Microsoft have collaborated with colleagues from the Institute of Computing Technology at the Chinese Academy of Sciences (CAS) to explore how Kinect?s body-tracking abilities can be applied to the problem of sign-language recognition.

Sign language is the primary language for many deaf and hard-of-hearing people. But it currently is not possible for these people to interact with computers using their native language.

Because of this, researchers in recent years have spent lots of time studying the challenges of sign-language recognition, because not everyone understands sign language, and human sign-language interpreters are not always available.

Then along came a device called the Kinect. Results have been encouraging in enabling people whose primary language is sign language to interact more naturally with their computers, in much the same way that speech recognition does.

"From our point of view," says CAS Professor Xilin Chen, "the most significant contribution is that the project demonstrates the possibility of sign-language recognition with readily available, low-cost 3-D and 2-D sensors."

Kinect, with its ability to provide depth information and color data simultaneously, makes it easier to track hand and body actions more accurately - and quickly.

In this project, the hand tracking leads to a process of 3-D motion-trajectory alignment and matching for individual words in sign language. The words are generated via hand tracking by the Kinect for Windows software and then normalized, and matching scores are computed to identify the most relevant candidates when a signed word is analyzed.

The algorithm for this 3-D trajectory matching, in turn, has enabled the construction of a system for sign-language recognition and translation, consisting of two modes. The first, Translation Mode, translates sign language into text or speech. The technology currently supports American sign language but has potential for all varieties of sign language.

The second, Communications Mode, enables communications between a hearing person and a deaf or hard-of-hearing person by use of an avatar. Guided by text input from a keyboard, the avatar can display the corresponding sign-language sentence. The deaf or hard-of-hearing person responds using sign language, and the system converts that answer into text.

"One unique contribution of this project is that it is a joint effort between software researchers and the deaf and hard of hearing," Zhou says. "A group of teachers and students from Beijing Union University joined this project, and this enabled our algorithms to be conducted on real-world data."

And while the research is valuable in the realm of visual information processing, it also is intended to provide practical assistance to people who communicate primarily in sign language.

"We believe that IT should be used to improve daily life for all persons," says Guobin Wu, a research program manager from Microsoft Research Asia. "While it is still a research project, we ultimately hope this work can provide a daily interaction tool to bridge the gap between the hearing and the deaf and hard of hearing in the near future."


Previous
Next
Google 2Q Results Hit By Low Ad Rates        All News        Dell Shareholders Voting On Buyout Postponed
Google 2Q Results Hit By Low Ad Rates     General Computing News      Dell Shareholders Voting On Buyout Postponed

Get RSS feed Easy Print E-Mail this Message

Related News
Microsoft Says U.S. Foreign Intelligence Surveillance Requests Doubled
Microsoft Announces Patent License Agreement with Toyota
Adobe, Microsoft To Offer Solutions That Share Sales Data
Microsoft and Steelcase Present Concepts For The Future Workplace
Microsoft's Outlook.com Premium Emal Service Now Available
Microsoft To Give A Face Lifting To Windows 10 With 'Project NEON'
Microsoft Edge Will Soon Get New Features
Cloud Services Boost Microsoft's Sales And Profit
Microsoft Announces Intune for Education And New Windows 10 PCs for School
Microsoft, NXP Semiconductors, IAV and Auto Mobility Partners showcase Technologies For Safe And Personalized Automated Friving at CES 2017
Microsoft Partners with TomTom Mapping Company On Azure
European Commission Approves Acquisition of LinkedIn by Microsoft, Subject to Conditions

Most Popular News
 
Home | News | All News | Reviews | Articles | Guides | Download | Expert Area | Forum | Site Info
Site best viewed at 1024x768+ - CDRINFO.COM 1998-2017 - All rights reserved -
Privacy policy - Contact Us .