{"604972":{"#nid":"604972","#data":{"type":"news","title":"Pardon the Interruption: IC\u0027s Siddhartha Banerjee Explores Convenience, Efficiency in Robotic Intrusion","body":[{"value":"\u003Cp\u003ESchool of Interactive Computing (IC) robotics Ph.D. student \u003Cstrong\u003ESiddhartha Banerjee\u003C\/strong\u003E remembers the moment he fell in love with LEGOs. He had a neighbor in India, where he grew up, who bought his son an early-generation LEGO tech kit. Flip a switch, and a motor is activated that would move the LEGO structures around.\u003C\/p\u003E\r\n\r\n\u003Cp\u003EThis particular model was a spaceship. Flip a few more switches and everything from the payload door to a satellite or flashing LED lights would activate.\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u0026ldquo;I thought it was the coolest thing,\u0026rdquo; Banerjee recalls fondly.\u003C\/p\u003E\r\n\r\n\u003Cp\u003EHe begged his parents for the same spaceship kit, but it was expensive and he had never really owned any of LEGO\u0026rsquo;s robotic kits. So, instead, his parents built up to it. Each birthday, Banerjee received a new LEGO set. He built the model, which began as just plain, unmoving LEGO models first, and then wait for his next birthday for another set.\u003C\/p\u003E\r\n\r\n\u003Cp\u003EFinally, around his 13\u003Csup\u003Eth\u003C\/sup\u003E birthday, he got the spaceship that he had wanted all that time ago.\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u0026ldquo;I still have that kit lying around,\u0026rdquo; he said, some 14 years later.\u003C\/p\u003E\r\n\r\n\u003Cp\u003EBy the time he got the spaceship, LEGO had begun producing its Mindstorms games, which utilize programmable robotics. Banerjee was fascinated by the opportunity to program his creations.\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u0026ldquo;As a kid, it was amazing to be able to type something on a screen and watch as your LEGO robot did what you told it to do,\u0026rdquo; he said. \u0026ldquo;I think that was the first time I really encountered robotics, and I was sold.\u0026rdquo;\u003C\/p\u003E\r\n\r\n\u003Cp\u003EHe joined an extracurricular group in high school that competed in the Indian Robot Olympiad. Admittedly, his team didn\u0026rsquo;t do very well, but he was a part of it, and that was most important.\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u0026ldquo;We were abysmal, but it was fun,\u0026rdquo; he said. \u0026ldquo;I think that\u0026rsquo;s where the interest came from for me.\u0026rdquo;\u003C\/p\u003E\r\n\r\n\u003Ch3\u003E\u003Cstrong\u003EA career interrupted\u003C\/strong\u003E\u003C\/h3\u003E\r\n\r\n\u003Cp\u003EThat interest has led him on a path to Georgia Tech where he began studying as a Ph.D. student in 2015. He came by way of Yale University and a two-year stint in industry. At Yale, his main focus was on electrical engineering. At Redfin, a real estate brokerage, it was on web development.\u003C\/p\u003E\r\n\r\n\u003Cp\u003EBut he never lost that affinity for robotics and feared seeing his career be pigeon holed into one different area. So, in 2015, he came to Georgia Tech to study with Associate Professor \u003Ca href=\u0022https:\/\/www.ic.gatech.edu\/people\/11322\/sonia-chernovas\u0022\u003E\u003Cstrong\u003ESonia Chernova\u003C\/strong\u003E\u003C\/a\u003E.\u003C\/p\u003E\r\n\r\n\u003Cp\u003EWith Chernova, Banerjee has been exploring interruptibility, an interesting and largely untapped area of robotics research. Interruptibility explores robotic capabilities to distinguish between someone who may be free and approachable and someone who is distracted or focused on another task.\u003C\/p\u003E\r\n\r\n\u003Cp\u003EThe field has important impacts in environments like hospitals or, as Banerjee and Chernova pitched to NASA, in space exploration.\u003C\/p\u003E\r\n\r\n\u003Cp\u003EConsider the scenario:\u003C\/p\u003E\r\n\r\n\u003Cp\u003EOn a space or extraterrestrial deployment, robots are in use. Perhaps one of the robots is in need of assistance to complete a programmed task, but the accompanying human astronauts are busy. The astronauts\u0026rsquo; time is obviously very valuable, but, while mission control is likely always available, there is also high latency because of the distance and delay between the two parties.\u003C\/p\u003E\r\n\r\n\u003Cp\u003EThe more effective approach would be to request assistance from the astronaut, but it is preferable that the robot only interrupts at a convenient moment.\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u0026ldquo;That was the impetus for this project,\u0026rdquo; Banerjee said.\u003C\/p\u003E\r\n\r\n\u003Cp\u003ETo study the subject, Banerjee said he and his collaborators began with some specific clues in human behavior. When an individual is busy, they are usually hunched over in a skeleton pose that shows engagement with something else. An unoccupied individual\u0026rsquo;s gaze is likely wandering, looking around and not focused on one thing in particular.\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u0026ldquo;There are body cues,\u0026rdquo; Banerjee said. \u0026ldquo;There are also contextual cues such as where you are. Are you in the kitchen, or are you in the office? If you\u0026rsquo;re in the kitchen, are you working on a laptop, or are you drinking from a coffee mug? Those things signal whether you might be interruptible or not.\u0026rdquo;\u003C\/p\u003E\r\n\r\n\u003Cp\u003EInterruptibility has been studied a lot in human-computer interaction research to gauge when people are available for smartphone messages. On robots, contextual cues used in HCI can be augmented with context from understanding a scene through the robot\u0026rsquo;s cameras, such as with the use of object detection. Coupled with social cues, you can begin to get robust interruptibility estimates.\u003C\/p\u003E\r\n\r\n\u003Cp\u003EThe research is far from complete. Early findings from associated studies have shown various results.\u003C\/p\u003E\r\n\r\n\u003Cul\u003E\r\n\t\u003Cli\u003EThe time it takes a human to complete a task while being interrupted by a robot is largely unaffected. Why? Humans tend to speed up production to make up for lost time. When they speed up, however, accuracy and effectiveness of the overall task begins to decrease.\u003C\/li\u003E\r\n\t\u003Cli\u003EA larger effect was seen on the robot\u0026rsquo;s task performance. If a robot can interrupt an individual quickly, rather than waiting for someone until they are available to assist, its efficiency increases.\u003C\/li\u003E\r\n\u003C\/ul\u003E\r\n\r\n\u003Cp\u003EThe latest research in this area is currently under review for publication.\u003C\/p\u003E\r\n\r\n\u003Ch3\u003E\u003Cstrong\u003EPlanning for the future\u003C\/strong\u003E\u003C\/h3\u003E\r\n\r\n\u003Cp\u003EIn the future, Banerjee sees the research taking a slightly different direction. More specifically, he and his collaborators would like to step back and try to figure out what\u0026rsquo;s causing this interruptibility classification to come about in the first place.\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u0026ldquo;There\u0026rsquo;s a need for a robot to approach a human,\u0026rdquo; Banerjee said. \u0026ldquo;What\u0026rsquo;s that need? Is it a new environment configuration that the robot hasn\u0026rsquo;t seen before, and is this a trigger for interrupting a human to ask for a demonstration?\u0026rdquo;\u003C\/p\u003E\r\n\r\n\u003Cp\u003EHe\u0026rsquo;s nearing three years studying at Georgia Tech, where he said he\u0026rsquo;s had a great experience working with faculty like Chernova, IC Associate Professor \u003Ca href=\u0022https:\/\/www.ic.gatech.edu\/people\/7103\/mark-riedls\u0022\u003E\u003Cstrong\u003EMark Riedl\u003C\/strong\u003E\u003C\/a\u003E, and IC Professor \u003Ca href=\u0022https:\/\/www.ic.gatech.edu\/people\/7068\/ashok-goels\u0022\u003E\u003Cstrong\u003EAshok Goel\u003C\/strong\u003E\u003C\/a\u003E.\u003C\/p\u003E\r\n\r\n\u003Cp\u003EIn his two plus years at the school, he\u0026rsquo;s volunteered as the social chair and now president of the \u003Ca href=\u0022http:\/\/robograds.gatech.edu\/\u0022\u003ERoboGrads\u003C\/a\u003E.\u003C\/p\u003E\r\n\r\n\u003Cp\u003EHe said he\u0026rsquo;s looking forward to seeing what the next few years has for his research, collaboration, and community at Georgia Tech.\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u0026ldquo;I\u0026rsquo;m very thankful that Georgia Tech gave me a chance to work with its amazing researchers,\u0026rdquo; he said.\u003C\/p\u003E\r\n","summary":null,"format":"limited_html"}],"field_subtitle":"","field_summary":"","field_summary_sentence":[{"value":"Alongside advisor Sonia Chernova, Siddhartha Banerjee has been exploring interruptibility, an interesting and largely untapped area of robotics research."}],"uid":"33939","created_gmt":"2018-04-11 18:45:53","changed_gmt":"2018-04-11 18:46:28","author":"David Mitchell","boilerplate_text":"","field_publication":"","field_article_url":"","dateline":{"date":"2018-04-11T00:00:00-04:00","iso_date":"2018-04-11T00:00:00-04:00","tz":"America\/New_York"},"extras":[],"hg_media":{"604970":{"id":"604970","type":"image","title":"Sid Banerjee Main Image","body":null,"created":"1523471067","gmt_created":"2018-04-11 18:24:27","changed":"1523471067","gmt_changed":"2018-04-11 18:24:27","alt":"Siddhartha Banerjee with a robot","file":{"fid":"230651","name":"Main.jpg","image_path":"\/sites\/default\/files\/images\/Main.jpg","image_full_path":"http:\/\/tlwarc.hg.gatech.edu\/\/sites\/default\/files\/images\/Main.jpg","mime":"image\/jpeg","size":206824,"path_740":"http:\/\/tlwarc.hg.gatech.edu\/sites\/default\/files\/styles\/740xx_scale\/public\/images\/Main.jpg?itok=hNkUDjBT"}}},"media_ids":["604970"],"related_links":[{"url":"http:\/\/www.robotics.gatech.edu\/","title":"Institute for Robotics and Intelligent Machines"}],"groups":[{"id":"47223","name":"College of Computing"},{"id":"50876","name":"School of Interactive Computing"}],"categories":[],"keywords":[{"id":"177671","name":"siddhartha banerjee"},{"id":"169047","name":"Sonia Chernova"},{"id":"667","name":"robotics"},{"id":"177672","name":"interruptibility"},{"id":"8494","name":"HCI"},{"id":"79181","name":"national robotics week"},{"id":"78271","name":"IRIM"}],"core_research_areas":[{"id":"39521","name":"Robotics"}],"news_room_topics":[],"event_categories":[],"invited_audience":[],"affiliations":[],"classification":[],"areas_of_expertise":[],"news_and_recent_appearances":[],"phone":[],"contact":[{"value":"\u003Cp\u003EDavid Mitchell\u003C\/p\u003E\r\n\r\n\u003Cp\u003ECommunications Officer\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u003Ca href=\u0022mailto:david.mitchell@cc.gatech.edu\u0022\u003Edavid.mitchell@cc.gatech.edu\u003C\/a\u003E\u003C\/p\u003E\r\n","format":"limited_html"}],"email":[],"slides":[],"orientation":[],"userdata":""}}}