Melchiorre, A. B., Penz, D., Ganhör, C., Lesota, O., Fragoso, V., Friztl, F., Parada-Cabaleiro, E., Schubert, F., & Schedl, M. (2022). EmoMTB: Emotion-aware Music Tower Blocks. In ICMR ’22: Proceedings of the 2022 International Conference on Multimedia Retrieval (pp. 206–210). https://doi.org/10.1145/3512527.3531351
ICMR '22: Proceedings of the 2022 International Conference on Multimedia Retrieval
-
Date (published):
Jun-2022
-
Event name:
ACM International Conference on Multimedia Retrieval
en
Event date:
27-Jun-2022 - 30-Jun-2022
-
Event place:
United States of America (the)
-
Number of Pages:
5
-
Peer reviewed:
Yes
-
Keywords:
clustering; emotion recognition; intelligent user interface; music exploration
en
Abstract:
We introduce Emotion-aware Music Tower Blocks (EmoMTB), an audiovisual interface to explore large music collections. It creates a musical landscape, by adopting the metaphor of a city, where similar songs are grouped into the same building and nearby buildings form neighborhoods of particular genres. In order to personalize the user experience, an underlying classifier monitors textual user-generated content, by predicting their emotional state and adapting the audiovisual elements of the interface accordingly. EmoMTB enables users to explore different musical styles either within their comfort zone or outside of it. Besides, tailoring the results of the recommender engine to match the affective state of the user, EmoMTB offers a unique way to discover and enjoy music. EmoMTB supports exploring a collection of circa half a million streamed songs using a regular smartphone as a control interface to navigate in the landscape.
