File Download
There are no files associated with this item.
Links for fulltext
(May Require Subscription)
- Publisher Website: 10.1109/ICSensT.2016.7796256
- Scopus: eid_2-s2.0-85010041765
Supplementary
-
Citations:
- Scopus: 0
- Appears in Collections:
Conference Paper: Teach robots understanding new object types and attributes through natural language instructions
Title | Teach robots understanding new object types and attributes through natural language instructions |
---|---|
Authors | |
Keywords | human-robot interaction natural language processing object recognition vision-based object detection |
Issue Date | 2016 |
Publisher | IEEE. The Journal's web site is located at https://ieeexplore.ieee.org/xpl/conhome.jsp?punumber=1002593 |
Citation | 2016 10th International Conference on Sensing Technology (ICST), Nanjing, China, 11-13 November 2016, p. 1-6 How to Cite? |
Abstract | Robots often have limited knowledge about the environment and need to continuously acquire new knowledge in order to collaborate with the humans. To address this issue, this paper presents a method which allows the human to teach a robot new object types and attributes through natural language (NL) instructions. A simple yet robust vision algorithm is proposed to segment objects and describe the relations between objects. The segmented objects as well as their relations are regarded as the basic knowledge of the robot. The NL instructions are processed to domain-specific representations for the robot to identify the target objects. The target objects as well as the object type or attribute labels referred in the NL instructions are collected as training samples for the robot to learn. Experimental results demonstrate the effectiveness and advantages of the proposed method. |
Persistent Identifier | http://hdl.handle.net/10722/261968 |
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Bao, J | - |
dc.contributor.author | Hong, Z | - |
dc.contributor.author | Tang, H | - |
dc.contributor.author | Cheng, Y | - |
dc.contributor.author | Jia, Y | - |
dc.contributor.author | Xi, N | - |
dc.date.accessioned | 2018-09-28T04:51:07Z | - |
dc.date.available | 2018-09-28T04:51:07Z | - |
dc.date.issued | 2016 | - |
dc.identifier.citation | 2016 10th International Conference on Sensing Technology (ICST), Nanjing, China, 11-13 November 2016, p. 1-6 | - |
dc.identifier.uri | http://hdl.handle.net/10722/261968 | - |
dc.description.abstract | Robots often have limited knowledge about the environment and need to continuously acquire new knowledge in order to collaborate with the humans. To address this issue, this paper presents a method which allows the human to teach a robot new object types and attributes through natural language (NL) instructions. A simple yet robust vision algorithm is proposed to segment objects and describe the relations between objects. The segmented objects as well as their relations are regarded as the basic knowledge of the robot. The NL instructions are processed to domain-specific representations for the robot to identify the target objects. The target objects as well as the object type or attribute labels referred in the NL instructions are collected as training samples for the robot to learn. Experimental results demonstrate the effectiveness and advantages of the proposed method. | - |
dc.language | eng | - |
dc.publisher | IEEE. The Journal's web site is located at https://ieeexplore.ieee.org/xpl/conhome.jsp?punumber=1002593 | - |
dc.relation.ispartof | International Conference on Sensing Technology (ICST) Proceedings | - |
dc.rights | International Conference on Sensing Technology (ICST) Proceedings. Copyright © IEEE. | - |
dc.rights | ©2016 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. | - |
dc.subject | human-robot interaction | - |
dc.subject | natural language processing | - |
dc.subject | object recognition | - |
dc.subject | vision-based object detection | - |
dc.title | Teach robots understanding new object types and attributes through natural language instructions | - |
dc.type | Conference_Paper | - |
dc.identifier.email | Xi, N: xining@hku.hk | - |
dc.identifier.authority | Xi, N=rp02044 | - |
dc.identifier.doi | 10.1109/ICSensT.2016.7796256 | - |
dc.identifier.scopus | eid_2-s2.0-85010041765 | - |
dc.identifier.hkuros | 292808 | - |
dc.identifier.spage | 1 | - |
dc.identifier.epage | 6 | - |
dc.publisher.place | United States | - |