Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Migrated to Confluence 5.3

...

  • core\rapport\audio-laun - This is an audio detection app which listens to audio on the microphone, looking for key signals, like loudness, backchannel feedback, etc.  Whatever it detects, it sends out vhmsgs.

  • core\rapport\gesturedetection - This is an app that communicates with Watson and based on the data received, detects if there's a head nod, head shake and other features.  It sends out vhmsgs for features that it detects.
  • core\Watson - This Watson is the vision system that uses a webcam or a firewire stereo webcam
  • core\rapport\response - This is an app that receives the vhmsgs from 'audio-laun' and 'gesturedetection' and based on rules in the given config file, sends out vhmsgs to control the behavior of the character.
  • core\rapport\soundwoz - This is a helper app that you can use to test out 'response' to make sure it's working correctly and the rules are set up properly.

Quick facts:

  • Location: core\rapport
  • Main paper: Jonathan Gratch, Ning Wang, Jillian Gerten, Edward Fast and Robin Duffy. Creating Rapport with Virtual Agents. 7th International Conference on Intelligent Virtual Agents, Paris, France 2007

...

vrProcEnd messages do not get sent out on exit. This causes components to remain orange in the launcher

FAQ

See the Main FAQ. Please use the Google Groups emailing list for unlisted questions.