Detect functions of objects based on operational task input

Yuchi Ishikawa, Haruya Ishikawa, Shuichi Akizuki, Yoshimitsu Aoki

Research output: Contribution to journalArticlepeer-review


Recently, the development of deep learning has enabled robots to grasp objects more reliably than ever. Given this fact, there is an increasing demand for helper robots or home robots. To make these robots real, robots need to understand not only how to grasp objects but also their functions. We propose a new representation for the functions of objects, task-oriented function, which is based on operational task input. This representation makes it possible to describe a variety of ways to use an object. We also propose a new dataset for task-oriented function and a network to detect it. This model reached 79.7% mean IOU in our dataset.

Original languageEnglish
Pages (from-to)1136-1142
Number of pages7
JournalSeimitsu Kogaku Kaishi/Journal of the Japan Society for Precision Engineering
Issue number12
Publication statusPublished - 2019


  • Affordance
  • Deep learning
  • Robotics
  • Segmentation
  • Task-oriented

ASJC Scopus subject areas

  • Mechanical Engineering


Dive into the research topics of 'Detect functions of objects based on operational task input'. Together they form a unique fingerprint.

Cite this