ACM ISS 2022
Sun 20 - Thu 24 November 2022 Wellington, New Zealand

The task of learning the piano has been a centuries-old challenge for novices, experts and technologists. Several innovations have been introduced to support proper posture, movement, and motivation, while sight-reading and improvisation remain the least-explored areas. In this PhD, we address this gap by redesigning the piano augmentation as an interactive and adaptive space. Specifically, we will explore how to support learners with adaptive visualisations through a two-pronged approach: (1) by designing adaptive visualisations based on the proficiency of the learner to support regular piano playing and (2) by assisting them with expert annotations projected on the piano to encourage improvisation. To this end, we will build a model to understand the complexities of learners' spatiotemporal data and use these to support learning. We will then evaluate our approach through user studies enabling practice and improvisation. Our work contributes to how adaptive visualisations can push music instrument learning and support multi-target selection tasks in immersive spaces.

Poster (iss22-deja.pdf)4.37MiB

Jordan Aiko Deja is a PhD student at the University of Primorska, Faculty of Mathematics, Natural Sciences and Information Technologies (UP FAMNIT), Koper, Slovenia. He is part of the HICUP research group which explores novel interaction concepts, advancing sensing methods and finding ways of improving personalised services using models and algorithms. He is also a member of the Department of Software Technology and the COMET research group of College of Computer Studies, De La Salle University, Manila, Philippines. He is one of the Directors of User Experience Philippines (UXPH). He is also one of the co-founders of the Manila ACM SIGCHI Chapter where he is currently chapter secretary.

Sun 20 Nov

Displayed time zone: Auckland, Wellington change

11:00 - 12:30
11:00
30m
Talk
Social VR for Socially Isolated Adolescents with Significant Illnesses
Doctoral Symposium
Udapola Balage Hansi Shashiprabha Udapola Victoria University of Wellington; University of Kelaniya
DOI File Attached
11:30
30m
Talk
Piano Learning and Improvisation through Adaptive Visualisation and Digital Augmentation
Doctoral Symposium
Jordan Aiko Deja University of Primorska; De La Salle University
DOI File Attached
12:00
30m
Talk
Lightning Talks and Close
Doctoral Symposium

Mon 21 Nov

Displayed time zone: Auckland, Wellington change

17:30 - 20:00
Posters, Demos, Doctoral Symposium Evening SessionPosters / Doctoral Symposium at Rutherford House Mezzanine
Chair(s): Rachel Blagojevic Massey University, Steven Houben TU Eindhoven, Rafael Kuffner University of Leeds, Jason Leigh Laboratory for Advanced Visualization and Applications, University of Hawai‘i at Mānoa, Can Liu City University of Hong Kong, Daniel Medeiros University of Glasgow, Aaron J. Quigley University of New South Wales, Anne Roudaut University of Bristol
17:30
12m
Talk
Video Analysis of Hand Gestures for Distinguishing Patients with Carpal Tunnel Syndrome
Posters
Ryota Matsui Keio University, Takuya Ibara Tokyo Medical and Dental University, Kazuya Tsukamoto Tokyo Medical and Dental University, Takafumi Koyama Tokyo Medical and Dental University, Koji Fujita Tokyo Medical and Dental University, Yuta Sugiura Keio University
DOI File Attached
17:42
12m
Talk
Evaluation of Grasp Posture Detection Method using Corneal Reflection Images through a Crowdsourced Experiment
Posters
Xiang Zhang Keio University, Kaori Ikematsu Yahoo Japan Corporation, Kunihiro Kato Tokyo University of Technology, Yuta Sugiura Keio University
DOI File Attached
17:55
12m
Talk
Virtual Tabletops (VTT) for Role-Playing Games (RPG) and Do-It-Yourself (DYI) Interactive Surfaces as Examples of Vernacular Design
Posters
Jan K. Argasiński Jagiellonian University
DOI File Attached
18:07
12m
Talk
Swipe-and-Tap Functional Programming
Posters
Michael Homer Victoria University of Wellington, A: Craig Anslow Victoria University of Wellington
DOI File Attached
18:20
12m
Talk
Impact on the Quality of Interpersonal Relationships by Proximity using the Ventriloquism Effect in a Virtual Environment
Posters
Azusa Yamazaki University of Tsukuba, Naoto Wakatsuki University of Tsukuba, Koichi Mizutani University of Tsukuba, Yukihiko Okada University of Tsukuba, Keiichi Zempo University of Tsukuba
DOI Media Attached File Attached
18:32
12m
Talk
Retzzles: Engaging Users towards Retention through Touchscreen Puzzles
Posters
Nikola Kovačević University of Primorska, Maheshya Weerasinghe University of Primorska; University of St Andrews, Jordan Aiko Deja University of Primorska; De La Salle University
DOI Media Attached File Attached
18:45
12m
Talk
GesPlayer: Using Augmented Gestures to Empower Video Players
Posters
Xiang Li University of Cambridge, Yuzheng Chen Xi’an Jiaotong-Liverpool University, Xiaohang Tang University of Liverpool
DOI File Attached
18:57
12m
Talk
Perceived Affordances in Programmable Matter
Doctoral Symposium
Khyati Priya IIT Bombay
DOI File Attached
19:10
12m
Talk
Piano Learning and Improvisation through Adaptive Visualisation and Digital Augmentation
Doctoral Symposium
Jordan Aiko Deja University of Primorska; De La Salle University
DOI File Attached
19:22
12m
Talk
Social VR for Socially Isolated Adolescents with Significant Illnesses
Doctoral Symposium
Udapola Balage Hansi Shashiprabha Udapola Victoria University of Wellington; University of Kelaniya
DOI File Attached
19:35
12m
Talk
XR for Improving Cardiac Electrophysiology Training
Doctoral Symposium
Nisal Manisha Udawatta Kankanamge Don Victoria University of Wellington; University of Kelaniya
DOI File Attached
19:47
12m
Poster
Spatialphonic360: Accuracy of the Arbitrary Sound Image Presentation using Surrounding Parametric Speakers
Posters
Noko Kuratomo University of Tsukuba, Hiroki Uchida University of Tsukuba, Tadashi Ebihara University of Tsukuba, Naoto Wakatsuki University of Tsukuba, Koichi Mizutani University of Tsukuba, Keiichi Zempo University of Tsukuba
DOI Media Attached File Attached