| Table of Contents | ||
|---|---|---|
|
...
Quick facts:
- Location: /core/AcquireSpeech. acquirespeech
- Language: Java
- Distribution: Source
Platform(s): Multi-platform
...
Acquirespeech launches by default when you press, 'Launch' under the 'Run It All' group in the Virtual Humans Launcher.
To launch AcquireSpeech manually, expand the Launcher options with the 'Advanced' button, then press 'Launch' next to 'Speech Recognition' in the 'Input/Output' tab. This will launch both the Pocket Sphinx speech server PocketSphinx Wrapper and AcquireSpeech. There is a slight delay to allow Pocket Sphinx PocketSphinx to load before AcquireSpeech connects to it.
...
AcquireSpeech is configured to automatically select your default audio input on start, and so will usually not require manual configuration. It can be configured by either a configuration file or the Settings Tab.
Speaking to a Character
The Recorder tab is the primary interface for AcquireSpeech. From here, you can start a session, monitor you microphone level, and trigger recording using the press to talk "'Speak" ' button.
To start an AcquireSpeech session, hit the green 'Start Session' button in the upper right, or Ctrl+r. Once the session is started, the large 'Speak' button in the top of the tab will brighten and become interactive. When depressed, the 'Speak' button turns bright green.
...
To stop a session, such as when you've finished a Toolkit session, or wish to change Settings, hit the red, 'Stop Session' button.
Recording with AcquireSpeech
...
Configuring AcquireSpeech
- The General Settings Settings include the time to record before, and after, the "Speak" button is pressed; default is .25 seconds. This allows AcquireSpeech to capture the entire spoken utterance bracketed by silence or background noise without requiring any special action from the user.
- VHMSG Settings covers how AcquireSpeech interacts with other components. For most users, the Server and Scope will be filled in automatically with the values "localhost" and "DEFAULT_SCOPE", respectively. It is not recommended you change these values without referring to the expanded documentation.
- Microphone Settings are the bottom block, and cover the sound setup for AcquireSpeech. The Microphone check box at the top should be checked, indicating a microphone should be used. The sound input can be changed with the drop down box, but the default setting should work for most users. If AcquireSpeech isn't hearing you, try a different input or microphone. If no options are presented in the drop down, please ensure your microphone is connected and working properly in your OS's configuration tool.
- Show recognition results toggles display of the recognition feedback from Pocket Sphinx, or whichever recognition server is connected, underneath the "'Speak" ' button in the Recording Tab. "'Default speaker" ' is used to connect to NPCEditor, and is capable of supporting supports multiple speakers. See the configuration file section of this manualThe speaker here should match the 'Agent Name' in the "Smartbody" account in 'People' > 'Accounts' of NPCEditor.
- Record Session and Record Utterances toggle recording of the user's speech. The session recording is of everything said into the microphone from when an AcquireSpeech session is started, while the utterances are separate split recordings of from when the "'Speak" ' button is depressed.
Developers
Message API
Receives
vrAllCall
Broadcasts AcquireSpeech VHMsg ID. It is set to asr.
vrKillComponent (all | asr)
Stops AcquireSpeech. If the recording is running, AcquireSpeech will attempt to shut it down gracefully.
acquireSpeech action action description in xml
Tell AcquireSpeech to perform the specified action. The action xml schema can be found insrc/java/acquirespeech.xsd. It takes two attributes:
1. targetComponentID defines the component to apply this action to. If the ID is missing, the action is applied to the overall model structure
2. command defines the action command. See the list of action commands for the complete reference.
...
AcquireSpeech sends out events transmitting recognition result and notifications about the state of recording
vrSpeech
see vrSpeech documentation
acquireSpeech startedListening inputComponentID sessionID utteranceID recordingTimeInMilliseconds
This message is sent when an utterance recording starts.
acquireSpeech stoppedListening inputComponentID sessionID utteranceID recordingTimeInMilliseconds
This message is sent when an utterance recording stops.
acquireSpeech info message
This message is sent when a group component selection is changed.
acquireSpeech startedSession inputComponentID sessionID timeInMilliseconds
This message is sent when a session recording starts.
acquireSpeech stoppedSession inputComponentID sessionID timeInMilliseconds
This message is sent when a session recording stops.
...