File Download

There are no files associated with this item.

  Links for fulltext
     (May Require Subscription)

Conference Paper: Modeling Natural Language Controlled Robotic Operations

TitleModeling Natural Language Controlled Robotic Operations
Authors
Issue Date2017
PublisherIEEE. The Journal's web site is located at http://ieeexplore.ieee.org/xpl/conhome.jsp?punumber=1800486
Citation
2017 IEEE 7th Annual International Conference on CYBER Technology in Automation, Control, and Intelligent Systems (CYBER), Honolulu, HI, USA, 31 July-4 August 2017, p. 1072-1077 How to Cite?
AbstractThere are multiple ways to control a robotic system. Most of them require the users to have prior knowledge about robots. Natural language based control is a very promising method due to its versatility, ease of use, and without the need for extensive training for novice users. Since natural language instructions from users cannot be understood by the robots directly, the linguistic input has to be processed into a formal representation which captures the task specification and removes the ambiguity inherent in natural language. For most of existing natural language controlled robotic system, they assume the given language instructions are already in correct orders. However, it is very likely for untrained users to give commands in a mixed order based on their direct observation and intuitive thinking. Simply following the order of the commands can lead to failures of tasks. To provide a remedy for the problem, we propose a framework named Dependency Relation Matrix (DRM) to model and organize the linguistic input, in order to figure out a feasible subtask sequence for later execution. Besides, the proposed approach projects both linguistic input and sensory information into the same space, and use the difference between the goal specification and temporal sensory feedback to drive the system moving forward. It also helps to monitor the progress of task execution by comparing the temporal sensory feedback and the goal configuration. In this paper, we describe the DRM framework in detail, and illustrate the utility of this approach with experiment results.
Persistent Identifierhttp://hdl.handle.net/10722/283036
ISBN

 

DC FieldValueLanguage
dc.contributor.authorCheng, Y-
dc.contributor.authorBao, J-
dc.contributor.authorJia, Y-
dc.contributor.authorDeng, Z-
dc.contributor.authorSun, Z-
dc.contributor.authorBi, S-
dc.contributor.authorLi, C-
dc.contributor.authorXi, N-
dc.date.accessioned2020-06-05T06:24:15Z-
dc.date.available2020-06-05T06:24:15Z-
dc.date.issued2017-
dc.identifier.citation2017 IEEE 7th Annual International Conference on CYBER Technology in Automation, Control, and Intelligent Systems (CYBER), Honolulu, HI, USA, 31 July-4 August 2017, p. 1072-1077-
dc.identifier.isbn978-1-5386-0491-5-
dc.identifier.urihttp://hdl.handle.net/10722/283036-
dc.description.abstractThere are multiple ways to control a robotic system. Most of them require the users to have prior knowledge about robots. Natural language based control is a very promising method due to its versatility, ease of use, and without the need for extensive training for novice users. Since natural language instructions from users cannot be understood by the robots directly, the linguistic input has to be processed into a formal representation which captures the task specification and removes the ambiguity inherent in natural language. For most of existing natural language controlled robotic system, they assume the given language instructions are already in correct orders. However, it is very likely for untrained users to give commands in a mixed order based on their direct observation and intuitive thinking. Simply following the order of the commands can lead to failures of tasks. To provide a remedy for the problem, we propose a framework named Dependency Relation Matrix (DRM) to model and organize the linguistic input, in order to figure out a feasible subtask sequence for later execution. Besides, the proposed approach projects both linguistic input and sensory information into the same space, and use the difference between the goal specification and temporal sensory feedback to drive the system moving forward. It also helps to monitor the progress of task execution by comparing the temporal sensory feedback and the goal configuration. In this paper, we describe the DRM framework in detail, and illustrate the utility of this approach with experiment results.-
dc.languageeng-
dc.publisherIEEE. The Journal's web site is located at http://ieeexplore.ieee.org/xpl/conhome.jsp?punumber=1800486-
dc.relation.ispartofIEEE International Conference on Cyber Technology in Automation, Control, and Intelligent Systems (CYBER)-
dc.rightsIEEE International Conference on Cyber Technology in Automation, Control, and Intelligent Systems (CYBER). Copyright © IEEE.-
dc.rights©2017 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.-
dc.titleModeling Natural Language Controlled Robotic Operations-
dc.typeConference_Paper-
dc.identifier.emailBi, S: shengbi@hku.hk-
dc.identifier.emailXi, N: xining@hku.hk-
dc.identifier.authorityXi, N=rp02044-
dc.description.naturelink_to_subscribed_fulltext-
dc.identifier.doi10.1109/CYBER.2017.8446270-
dc.identifier.hkuros310104-
dc.identifier.spage1072-
dc.identifier.epage1077-
dc.publisher.placeUnited States-

Export via OAI-PMH Interface in XML Formats


OR


Export to Other Non-XML Formats