Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • core\rapport\audio-laun - This is an audio detection app which listens to audio on the microphone, looking for key signals, like loudness, backchannel feedback, etc.  Whatever it detects, it sends out vhmsgs.
  • core\rapport\gesturedetection - This is an app that communicates with Watson and based on the data received, detects if there's a head nod, head shake and other features.  It sends out vhmsgs for features that it detects.
  • core\Watson - This is the vision system that uses a webcam or a firewire stereo webcam
  • core\rapport\response - This is an app that receives the vhmsgs from 'audio-laun' and 'gesturedetection' and based on rules in the given config file, sends out vhmsgs to control the behavior of the character.
  • core\rapport\soundwoz - This is a helper app that you can use to test out 'response' to make sure it's working correctly and the rules are set up properly.

Quick facts:

  • Location: core core\rapport
  • Main paper: Jonathan Gratch, Ning Wang, Jillian Gerten, Edward Fast and Robin Duffy. Creating Rapport with Virtual Agents. 7th International Conference on Intelligent Virtual Agents, Paris, France 2007

Users

Running

...

  1. Make sure you have a microphone and webcam properly set up
  2. From the Launcher, run:
    1. Rapport Audio
    2. Rapport Gesture Detection
    3. Rapport Response
    4. Rapport Soundwoz
    5. Unity Renderer
  3. On the soundwoz, hit the 'Start Rapport' button

...