메타버스 대화의 몰입감 증진을 위한 대화 감정 기반 실시간 배경음악 시스템 구현

초록

To enhance immersive experiences for metaverse environements, background music is often used. However, the backgroun d music is mostly pre-matched and repeated which might occur a distractive experience to users as it does not align well with rapidly changing user-interactive contents. Thus, we implemented a system to provide a more immersive metaverse conversation experience by 1) developing a regre ssion neural network that extracts emotions from an utterance using KEMDy20, the Korean multimodal emotion dataset 2) s electing music corresponding to the extracted emotions from an utterance by the DEAM dataset where music is tagged with arousal-valence levels 3) combining it with a virtual space where users can have a real-time conversation with avatars.

키워드