Inspired by the human nature that a child can learn by taking an objectthen observing it, we proposed two novel methods: (1) Object Detection by Interactive Perception (ODIP), where a few-shot object detector gradually learns unseen instances by interacting with a well-developed object grasping system, collecting required visual dataannotations in an automatic manner. (2) an efficienteffective few-shot object detection model with novel attention mechanism called Dual-Awareness Attention (DAnA).

"It is expected that human will work with robots in the coming years. However, it is still unknown how both can collaborate together. Meanwhile, it is still very time-consuming to deploy intelligent robots in production lines. For this work, we investigate deep comprehension for 3D (point cloud)text (voice) signals to enable novel human-robotic object referring for robotic arms. For the task