A Voice-Controlled Motion Reproduction Using Large Language Models for Polishing Robots

Yuki Tanaka, Seiichiro Katsura

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In recent years, the shortage of professionally skilled people in industrial fields has been a major social problem. To solve this problem, the transfer of skills to robots has been attracting much attention. However, they are not familiar with robot control, and hard to teach robots their skills by numerical commands or program source code. For more user-friendly human-robot interaction, a lot of studies have been conducted. In previous researches, robot task processes are pre-defined and not changed in task execution. We developed a robot system using the motion-copying system and GPT-3, one of the Large Language Models. This system can not only copy the motion but also modify saved motion in execution by using natural language commands. We evaluated the proposed system by applying it to polishing robots and confirmed that the surface of used workpieces was changed following to input commands.

Original languageEnglish
Title of host publicationProceedings - 2023 IEEE International Conference on Mechatronics, ICM 2023
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781665466615
DOIs
Publication statusPublished - 2023
Event2023 IEEE International Conference on Mechatronics, ICM 2023 - Leicestershire, United Kingdom
Duration: 2023 Mar 152023 Mar 17

Publication series

NameProceedings - 2023 IEEE International Conference on Mechatronics, ICM 2023

Conference

Conference2023 IEEE International Conference on Mechatronics, ICM 2023
Country/TerritoryUnited Kingdom
CityLeicestershire
Period23/3/1523/3/17

Keywords

  • human-robot interaction
  • large language models
  • motion control
  • motion reproduction system
  • natural language processing
  • polishing robot
  • robot teaching
  • transfer of skills

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Mechanical Engineering
  • Control and Optimization

Fingerprint

Dive into the research topics of 'A Voice-Controlled Motion Reproduction Using Large Language Models for Polishing Robots'. Together they form a unique fingerprint.

Cite this