An artificial sensory neuron with visual-haptic fusion

Changjin Wan, Pingqiang Cai, Xintong Guo, Ming Wang, Naoji Matsuhisa, Le Yang, Zhisheng Lv, Yifei Luo, Xian Jun Loh, Xiaodong Chen

研究成果: Article査読

111 被引用数 (Scopus)


Human behaviors are extremely sophisticated, relying on the adaptive, plastic and event-driven network of sensory neurons. Such neuronal system analyzes multiple sensory cues efficiently to establish accurate depiction of the environment. Here, we develop a bimodal artificial sensory neuron to implement the sensory fusion processes. Such a bimodal artificial sensory neuron collects optic and pressure information from the photodetector and pressure sensors respectively, transmits the bimodal information through an ionic cable, and integrates them into post-synaptic currents by a synaptic transistor. The sensory neuron can be excited in multiple levels by synchronizing the two sensory cues, which enables the manipulating of skeletal myotubes and a robotic hand. Furthermore, enhanced recognition capability achieved on fused visual/haptic cues is confirmed by simulation of a multi-transparency pattern recognition task. Our biomimetic design has the potential to advance technologies in cyborg and neuromorphic systems by endowing them with supramodal perceptual capabilities.

ジャーナルNature communications
出版ステータスPublished - 2020 12月 1

ASJC Scopus subject areas

  • 化学 (全般)
  • 生化学、遺伝学、分子生物学(全般)
  • 物理学および天文学(全般)


「An artificial sensory neuron with visual-haptic fusion」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。