Ambient rhythm-melodic sonification of status information for iot-enabled devices

George Chernyshov, Jiajun Chen, Yenchin Lai, Vontin Noriyasu, Kai Kunze

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)


In this paper we explore how to embed status information of IoT-enabled devices in the acoustic atmosphere using melodic ambient sounds while limiting obtrusiveness for the user. The user can use arbitrary sound samples to represent the devices he wants to monitor. Our system combines these sound samples into a melodic ambient rhythm that contains information on all the processes or variables that user is monitoring. We focus on continuous rather than binary information (e.g. "monitoring progress status" rather then "new message received"). We evaluate our system in a machine monitoring scenario focusing on 5 distinct machines/processes to monitor with 6 priority levels for each. 9 participants use our system to monitor these processes with an up to 92.44% detection rate, if several levels are combined. Participants had no previous experience with this or similar systems and had only 5-10 minute training session before the tests.

Original languageEnglish
Title of host publicationProceedings IOT 2016 - 6th International Conference on the Internet of Things
PublisherAssociation for Computing Machinery
Number of pages6
ISBN (Electronic)9781450348140
Publication statusPublished - 2016 Nov 7
Event6th International Conference on the Internet of Things, IOT 2016 - Stuttgart, Germany
Duration: 2016 Nov 72016 Nov 9

Publication series

NameACM International Conference Proceeding Series


Other6th International Conference on the Internet of Things, IOT 2016


  • Acoustic Atmosphere
  • Interfaces
  • IoT
  • Process monitoring
  • Sonification

ASJC Scopus subject areas

  • Software
  • Human-Computer Interaction
  • Computer Vision and Pattern Recognition
  • Computer Networks and Communications


Dive into the research topics of 'Ambient rhythm-melodic sonification of status information for iot-enabled devices'. Together they form a unique fingerprint.

Cite this