{"330461":{"#nid":"330461","#data":{"type":"news","title":"Researchers create software for Google Glass that provides captions  for hard-of-hearing users","body":[{"value":"\u003Cp\u003EA team of Georgia Institute of Technology researchers has created speech-to-text software for Google Glass that helps hard-of-hearing users with everyday conversations. A hard-of-hearing person wears Glass while a second person speaks directly into a smartphone. The speech is converted to text, sent to Glass and displayed on its heads-up display.\u003C\/p\u003E\u003Cp\u003EA group in Georgia Tech\u2019s College of Computing created the Glassware when one of its own said he was having trouble hearing and thought Glass could help him.\u003C\/p\u003E\u003Cp\u003E\u201cThis system allows wearers like me to focus on the speaker\u2019s lips and facial gestures,\u0022 said School of Interactive Computing Professor Jim Foley. \u201cIf hard-of-hearing people understand the speech, the conversation can continue immediately without waiting for the caption. However, if I miss a word, I can glance at the transcription, get the word or two I need and get back into the conversation.\u201d\u003C\/p\u003E\u003Cp\u003EFoley\u2019s colleague, Professor Thad Starner, leads the Contextual Computing Group working on the project. He says using a smartphone with Glass has several benefits as compared to using Glass by itself.\u003C\/p\u003E\u003Cp\u003E\u201cGlass has its own microphone, but it\u2019s designed for the wearer,\u201d said Starner, who is also a technical lead for Glass. \u201cThe mobile phone puts a microphone directly next to the speaker\u2019s mouth, reducing background noise and helping to eliminate errors.\u201d\u003C\/p\u003E\u003Cp\u003EStarner says the phone-to-Glass system is helpful because speakers are more likely to construct their sentences more clearly, avoiding \u201cuhs\u201d and \u201cums.\u201d However, if captioning errors are sent to Glass, the smartphone software also allows the speaker to edit the mistakes, sending the changes to the person wearing the device.\u003C\/p\u003E\u003Cp\u003E\u0022The smartphone uses the Android transcription API to convert the audio to text,\u0022 said Jay Zuerndorfer, the Georgia Tech Computer Science graduate student who developed the software. \u0022The text is then streamed to Glass in real time.\u0022\u003C\/p\u003E\u003Cp\u003ECaptioning on Glass is currently available to install from \u003Ca href=\u0022https:\/\/glass.google.com\/glassware\/1585906026233130545\u0022\u003EMyGlass\u003C\/a\u003E. More information and support can be found at the project website \u003Ca href=\u0022http:\/\/cog.gatech.edu\u0022\u003Ehere\u003C\/a\u003E.\u003C\/p\u003E\u003Cp\u003EFoley and the students are working with the \u003Ca href=\u0022http:\/\/www.aldapeach.org\/\u0022\u003EAssociation of Late Deafened Adults in Atlanta\u003C\/a\u003E to improve the program.\u003C\/p\u003E\u003Cp\u003EThe same group is also working on a second project, Translation on Glass, that uses the same smartphone-Glass Bluetooth connection process to capture sentences spoken into the smartphone, translate them to another language and send them to Glass. The only difference is that the person wearing Glass, after reading the translation, can reply. The response is translated back to the original language on the smartphone. Two-way translations are currently available for English, Spanish, French, Russian, Korean and Japanese.\u003C\/p\u003E\u003Cp\u003E\u0022For both uses, the person wearing Glass has to hand their smartphone to someone else to begin a conversation,\u201d said Starner. \u201cIt\u2019s not ideal for strangers, but we designed the program to be used among friends, trusted acquaintances or while making purchases.\u201d\u003C\/p\u003E\u003Cp\u003EThe group is working to get Translation on Glass ready for the public.\u003C\/p\u003E","summary":null,"format":"limited_html"}],"field_subtitle":"","field_summary":[{"value":"\u003Cp\u003EA team of Georgia Institute of Technology researchers has created speech-to-text software for Google Glass that helps hard-of-hearing users with everyday conversations. A hard-of-hearing person wears Glass while a second person speaks directly into a smartphone. The speech is converted to text, sent to Glass and displayed on its heads-up display.\u0026nbsp;\u003C\/p\u003E","format":"limited_html"}],"field_summary_sentence":[{"value":"New software allows hard-of-hearing users to see captions in Google Glass."}],"uid":"27560","created_gmt":"2014-10-02 12:52:19","changed_gmt":"2022-05-26 17:09:36","author":"Jason Maderer","boilerplate_text":"","field_publication":"","field_article_url":"","dateline":{"date":"2014-10-02T00:00:00-04:00","iso_date":"2014-10-02T00:00:00-04:00","tz":"America\/New_York"},"extras":[],"hg_media":{"330481":{"id":"330481","type":"image","title":"Captioning on Glass phone display","body":null,"created":"1449245090","gmt_created":"2015-12-04 16:04:50","changed":"1475894557","gmt_changed":"2016-10-08 02:42:37","alt":"Captioning on Glass phone display","file":{"fid":"200341","name":"screen_shot_2014-10-01_at_3.31.24_pm.png","image_path":"\/sites\/default\/files\/images\/screen_shot_2014-10-01_at_3.31.24_pm_0.png","image_full_path":"http:\/\/tlwarc.hg.gatech.edu\/\/sites\/default\/files\/images\/screen_shot_2014-10-01_at_3.31.24_pm_0.png","mime":"image\/png","size":2029842,"path_740":"http:\/\/tlwarc.hg.gatech.edu\/sites\/default\/files\/styles\/740xx_scale\/public\/images\/screen_shot_2014-10-01_at_3.31.24_pm_0.png?itok=bDi9kXrH"}},"330511":{"id":"330511","type":"image","title":"Captioning on Glass user display","body":null,"created":"1449245090","gmt_created":"2015-12-04 16:04:50","changed":"1475894557","gmt_changed":"2016-10-08 02:42:37","alt":"Captioning on Glass user display","file":{"fid":"200344","name":"screen_shot_2014-10-02_at_1.00.53_pm.png","image_path":"\/sites\/default\/files\/images\/screen_shot_2014-10-02_at_1.00.53_pm_0.png","image_full_path":"http:\/\/tlwarc.hg.gatech.edu\/\/sites\/default\/files\/images\/screen_shot_2014-10-02_at_1.00.53_pm_0.png","mime":"image\/png","size":788378,"path_740":"http:\/\/tlwarc.hg.gatech.edu\/sites\/default\/files\/styles\/740xx_scale\/public\/images\/screen_shot_2014-10-02_at_1.00.53_pm_0.png?itok=VPop5ftK"}},"330501":{"id":"330501","type":"image","title":"Jim Foley","body":null,"created":"1449245090","gmt_created":"2015-12-04 16:04:50","changed":"1475894557","gmt_changed":"2016-10-08 02:42:37","alt":"Jim Foley","file":{"fid":"200343","name":"15c10302-p7-005.jpg","image_path":"\/sites\/default\/files\/images\/15c10302-p7-005_0.jpg","image_full_path":"http:\/\/tlwarc.hg.gatech.edu\/\/sites\/default\/files\/images\/15c10302-p7-005_0.jpg","mime":"image\/jpeg","size":1821131,"path_740":"http:\/\/tlwarc.hg.gatech.edu\/sites\/default\/files\/styles\/740xx_scale\/public\/images\/15c10302-p7-005_0.jpg?itok=Vqaz_ktz"}},"330491":{"id":"330491","type":"image","title":"Jay Zuerndorfer","body":null,"created":"1449245090","gmt_created":"2015-12-04 16:04:50","changed":"1475894557","gmt_changed":"2016-10-08 02:42:37","alt":"Jay Zuerndorfer","file":{"fid":"200342","name":"15c10302-p7-006.jpg","image_path":"\/sites\/default\/files\/images\/15c10302-p7-006_0.jpg","image_full_path":"http:\/\/tlwarc.hg.gatech.edu\/\/sites\/default\/files\/images\/15c10302-p7-006_0.jpg","mime":"image\/jpeg","size":1709093,"path_740":"http:\/\/tlwarc.hg.gatech.edu\/sites\/default\/files\/styles\/740xx_scale\/public\/images\/15c10302-p7-006_0.jpg?itok=mjQYyuzf"}}},"media_ids":["330481","330511","330501","330491"],"related_links":[{"url":"http:\/\/cog.gatech.edu\/","title":"Captioning on Glass Website"},{"url":"https:\/\/glass.google.com\/glassware\/1585906026233130545","title":"Install from MyGlass"}],"groups":[{"id":"47223","name":"College of Computing"}],"categories":[],"keywords":[{"id":"96071","name":"captioning on glass"},{"id":"654","name":"College of Computing"},{"id":"82341","name":"Google Glass"},{"id":"114601","name":"Press Release"}],"core_research_areas":[{"id":"39501","name":"People and Technology"}],"news_room_topics":[{"id":"71881","name":"Science and Technology"}],"event_categories":[],"invited_audience":[],"affiliations":[],"classification":[],"areas_of_expertise":[],"news_and_recent_appearances":[],"phone":[],"contact":[{"value":"\u003Cp\u003EJason Maderer - National Media Relations\u003C\/p\u003E","format":"limited_html"}],"email":["maderer@gatech.edu"],"slides":[],"orientation":[],"userdata":""}}}