Technical Name Listen to Pictures
Project Operator Cheng Shiu University
Project Host 蘇家輝
Summary
propose a novel audiovisual presentation system, called An Emotion-Aware Multimedia Browsing System, to enrich photo navigation experiences by emotionally associating harmonic music with a given photo collection. The major techniques proposed in this project are: (1) A visual emotion-aware technique base on pattern entropy, (2) A sequential pattern-based musical emotion-aware technique, (3) An effective alignment of photos and music and (4) Integrations and applications of the proposed system. Through the integration of the above techniques, the multimedia mining and browsing system with affectiveness, interactiveness and intelligence can be developed. Moreover, the techniques and systems developed in this project will be transferred to the industry as collaborations. Therefore, this research is expected to produce significant contributions to our country in the fields of multimedia content systems.
Scientific Breakthrough
The major techniques proposed in this project are: (1) A visual emotion-aware technique base on pattern entropy, (2) A sequential pattern-based musical emotion-aware technique, (3) An effective alignment of photos and music and (4) Integrations and applications of the proposed system. Through the integration of the above techniques, the multimedia mining and browsing system with affectiveness, interactiveness and intelligence can be developed.
Industrial Applicability
The proposed techniques can be will be transferred to the industry of the multimedia content systems.
Keyword Audiovisual presentation system cross-media affective content analysis emotion-aware alignment transfer learning image emotion music emotion picture frame Artificial Intelligence
other people also saw