A new app developed by a team of researchers is changing the way we experience music. This app allows users to have unprecedented control over tempo, dynamics, and style.
According to TechXplore, the app opens up endless possibilities for musicians and music enthusiasts by using voice and gestures to interact with music.
Ilya Borovik, a PhD student, and his co-author developed the innovative app to make music accessible to everyone, regardless of their musical background or physical capabilities. The app was detailed in the eBook “Augmenting Human Intellect.”
The app allows users to customize compositions using their voice, facial expressions, or gestures. It includes an AI model trained on various piano compositions and allows users to interact with the model using their smartphone’s camera and microphone.
While the project is still evolving, the research team plans to enhance the user-model communication and expand the composition database. They aim to incorporate orchestral music into the app’s repertoire in the future.
Borovik stated that the goal is to provide control over the model to the user, allowing for unique renditions of compositions.
This innovative app is revolutionizing the way people experience and interact with music, with exciting implications for musicians and music enthusiasts.
