ACM ISS 2022
Sun 20 - Thu 24 November 2022 Wellington, New Zealand

Humans have been developing and playing musical instruments for millennia. With technological advancements, instruments were becoming ever more sophisticated. In recent decades computer-supported innovations have also been introduced in hardware design, usability, and aesthetics. One of the most commonly digitally augmented instruments is the piano. Besides electronic keyboards, several prototypes augmenting pianos with different projections providing various levels of interactivity on and around the keyboard have been implemented in order to support piano players. However, it is still unclear whether these solutions support the learning process. In this paper, we present a systematic review of augmented piano prototypes focusing on instrument learning based on the four themes derived from interviews with piano experts to understand better the problems of teaching the piano. These themes are (i) synchronised movement and body posture, (ii) sight-reading, (iii) ensuring motivation, and (iv) encouraging improvisation. We found that prototypes are saturated on the synchronisation themes, and there are opportunities for sight-reading, motivation, and improvisation themes. We conclude by presenting recommendations on augmenting piano systems towards enriching the piano learning experience as well as on possible directions to expand knowledge in the area.

Wed 23 Nov

Displayed time zone: Auckland, Wellington change

13:30 - 15:00
Session 8: Alternative ScreensPapers at Rutherford House Lecture Theatre 2
Chair(s): Jason Leigh Laboratory for Advanced Visualization and Applications, University of Hawai‘i at Mānoa
13:30
22m
Talk
A Survey of Augmented Piano Prototypes: Has Augmentation Improved Learning Experiences?Honourable Mention
Papers
Jordan Aiko Deja University of Primorska; De La Salle University, Sven Mayer LMU Munich, Klen Čopič Pucihar University of Primorska, Matjaž Kljun University of Primorska
DOI Media Attached
13:52
22m
Talk
Dynamic Pinhole Paper: Interacting with Horizontal Displays through Perforated Paper
Papers
Cuauhtli Campos University of Primorska, Klen Čopič Pucihar University of Primorska, Matjaž Kljun University of Primorska
DOI Media Attached
14:15
22m
Talk
LightMeUp: Back-print Illumination Paper Display with Multi-stable Visuals
Papers
Cuauhtli Campos University of Primorska, Matjaž Kljun University of Primorska, Jakub Sandak InnoRenew CoE, Klen Čopič Pucihar University of Primorska
DOI Media Attached
14:37
22m
Talk
UbiChromics: Enabling Ubiquitously Deployable Interactive Displays with Photochromic Paint
Papers
Amani Alkayyali University of Michigan, Yasha Iravantchi University of Michigan, Jaylin Herskovitz University of Michigan, Alanson P. Sample University of Michigan
DOI Media Attached