Emotional Attentive ECA


This ECA component is a real-time 3D female agent (called GRETA) which supports interaction with a user trough a rich palette of verbal and non-verbal behaviours.

Communicative intentions of the speaker are rendered by talking and simultaneously showing facial expressions, gestures, gaze, and head movements. GRETA has different ways to interact with a user: she can talk and simultaneously show facial expressions, gestures, gaze, and head movements. Version the emotional states of the agent can be defined using PAD dimensional model of emotions. Animation of the agent is possible with real data coming from motion capture and pre-registered audio files.
This type of ECAs can be adapted to fit into the role of an educational tutor, a learning assistant, a conversational mate or a virtual companion and could also be implicated in the creation of virtual characters for video and serious games.

Availability of the component: Reference contact are Catherine Pelachaud and Radoslaw Niewiadomski  of Telecom Paristech
Notes: The component is publicly available under GPL. Greta Real-time 2009 works on Windows XP. The source code is available for Visual Studio 2005. The component (executables and source code) can be downloaded from here. The following additional free software are required: Psyclone software ; Text to Speech Synthesiser TTS 3.6 ; DirectX9c ; Microsoft Visual C++ 2005 SP1 Redistributable Package. The real-time version of Greta can be tested by using a simple Java program called interface available here.
Complete documentation about GRETA is available and a discussion forum is open to debate and support questions. Some examples can be downloaded.

Besides functional tests, extensive experimentation of the component in CALLAS is done in Proof-of-Concepts applications:
AVLaughterCycle: An audiovisual laughing machine Abstract

Suggested reading are the following articles and papers, plus reference to the component usage in CALLAS Newsletter4.

Watch the video of GRETA here.

Participation to experimental evaluation is welcome: specific aspects are  smiling ECA and  emotional expressions.
Last Updated on Friday, 02 July 2010 10:54