This webPage

For my current research and final project in course MULTIMEDIA ANALYSIS AND INDEXING , emotion-based media player show will be discussed and constructed here.

ABSTRACT

Nowadays, the media player software is often featured with some visual effects when listening to music. But most of them are always meaningless patterns to the musical content. A novel method is exhibited here to show a fancy media player show, integrating auditory and visual perception. Database of 400 nature photos and 200 clips from soundtracks with emotion labels is constructed by near five hundreds of users through web. A complete music is temporally analyzed and segmented into specific labels according to suitable emotion phrase by multi-label SVM (support vector machine). Images with the same emotion are then accompanied to present the show. As music proceeds, color contrast of images is also calculated to align the spectral flux of musical clips frame by frame. Foregoing sequence-matched problem is formulated, and Viterbi algorithm is used for optimization. Results of subjective feedbacks show that extra moved feelings are obtained and evaluated well.