TY - GEN
T1 - onNote
T2 - 24th Annual ACM Symposium on User Interface Software and Technology, UIST'11
AU - Yamamoto, Yusuke
AU - Uchiyama, Hideaki
AU - Kakehi, Yasuaki
N1 - Copyright:
Copyright 2011 Elsevier B.V., All rights reserved.
PY - 2011
Y1 - 2011
N2 - This paper presents a novel musical performance system named onNote that directly utilizes printed music scores as a musical instrument. This system can make users believe that sound is indeed embedded on the music notes in the scores. The users can play music simply by placing, moving and touching the scores under a desk lamp equipped with a camera and a small projector. By varying the movement, the users can control the playing sound and the tempo of the music. To develop this system, we propose an image processing based framework for retrieving music from a music database by capturing printed music scores. From a captured image, we identify the scores by matching them with the reference music scores, and compute the position and pose of the scores with respect to the camera. By using this framework, we can develop novel types of musical interactions.
AB - This paper presents a novel musical performance system named onNote that directly utilizes printed music scores as a musical instrument. This system can make users believe that sound is indeed embedded on the music notes in the scores. The users can play music simply by placing, moving and touching the scores under a desk lamp equipped with a camera and a small projector. By varying the movement, the users can control the playing sound and the tempo of the music. To develop this system, we propose an image processing based framework for retrieving music from a music database by capturing printed music scores. From a captured image, we identify the scores by matching them with the reference music scores, and compute the position and pose of the scores with respect to the camera. By using this framework, we can develop novel types of musical interactions.
KW - Image retrieval
KW - Musical instrument
KW - Tangible interface
UR - http://www.scopus.com/inward/record.url?scp=80755168345&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=80755168345&partnerID=8YFLogxK
U2 - 10.1145/2047196.2047249
DO - 10.1145/2047196.2047249
M3 - Conference contribution
AN - SCOPUS:80755168345
SN - 9781450307161
T3 - UIST'11 - Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology
SP - 413
EP - 422
BT - UIST'11 - Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology
Y2 - 16 October 2011 through 19 October 2011
ER -