Harmonizing Emotions in Multimedia

Speaker:
Prof. Min-Chun Hu (Department of Computer Science, National Tsing Hua University)
Film artworks, with their rich blend of visuals and soundtracks, adeptly translate the emotional visions of directors and creators, making them ideal stimuli in numerous studies aimed at evoking emotions. This talk introduces an approach to creating an affective common embedding space for music and videos, inspired by the essence of film artworks. This method not only bridges the heterogeneity gap between these mediums but also recommends suitable music for videos and vice versa, thereby amplifying the emotional resonance in multimedia. Additionally, we have crafted an interactive game designed to make the labeling of affective states more engaging. The game fosters interactions between participants, forming a dynamic loop.
#nthu #affective