BioStories: Dynamic Multimedia Environments Based on Real-Time Audience Emotion Assessment

• Type: Article in International Conference Proceedings Book
• Date: 2011

Authors

vinhas, v (Author) FEUP; oliveira, e (Author) FEUP; reis, lp (Author) FEUP

Conference proceedings International

Title: ICEIS

Pages: 512-525

Enterprise Information Systems - 12th International Conference, ICEIS 2010, Funchal, Madeira, Portugal, June 8-12, 2010, Revised Selected Papers

Indexing

ISI Web of Knowledge - 2 Citations

Scopus - 3 Citations

Scientific classification

FOS: Natural sciences > Computer and information sciences

Other information

Authenticus ID: P-002-XFM

DOI: 10.1007/978-3-642-19802-1_35

Abstract (EN): BioStories is the outcome of a four-year research project focused in uniting affective and ubiquitous computing with context aware multimedia environments real-time generation. Its initial premise was based in the possibility of performing real-time automatic emotion assessment trough online biometric channels monitoring and use this information to design on-the-fly dynamic multimedia storylines emotionally adapted, so that end users would unconsciously be determining the story graph. The emotion assessment process was based on biometric channels dynamic fusion such as EEG, GSR, respiration rate and volume, skin temperature and heart rate on top of Russell's circumplex model of affect. BioStories' broad scope also allowed for some spin-off projects namely mouse control through EMG that resulted in a tested technology for alternative/inclusive interfaces. Exhaustive experiments showed 86% of success rate for emotion assessment, IC(95%)(p)approximate to(0.81, 0.90), in a dynamic tridimensional virtual environment with an immersiveness user score of 4.3 out of 5. The success of the proposed approach allows the vision of its appliance in several domains such as virtual entertainment, videogames and cinema as well as direct marketing, digital TV and domotic appliances.

Language: English

Type (Professor's evaluation): Scientific

No. of pages: 14