Aerochord: um hiperinstrumento musical controlado por gestos

Abstract

This work presents the development and evaluation of Aerochord, a hand-gesture-controlled musical instrument that uses a standard camera to transform movements into digital sounds. The goal is to make musical expression more accessible, both for people without experience with instruments and for people with reduced mobility. Initially, a literature review on human-computer interaction and technologies applied to music was conducted, followed by an analysis of existing solutions. This investigation showed that there are still difficulties in combining accessibility, response speed, and musical performance quality in a single system. Based on these results, the requirements for Aerochord were defined, including real-time hand movement recognition, gesture-to-sound mapping, and communication with musical software using the MIDI 2.0 standard, maintaining compatibility with legacy versions when necessary. The system was developed in C++ using the JUCE framework, with a structure designed to reduce delays and ensure that sounds naturally follow the user's movements. The tests performed demonstrated a response time below the perceptible limit for most people, low consumption of computational resources, and ease of use, even for participants without musical training. The results confirm the technical and practical feasibility of the proposal and point out possibilities for evolution, such as support for more complex performances, automatic adaptation to user gestures, and integration with immersive environments. It is expected that Aerochord will contribute to the fields of human-computer interaction and music technology by offering an accessible, responsive, and expressive instrument. [resumo fornecido pelo autor]