...
- W,A,S,D - camera movement. Q & E - camera up/down
- J - mouse visibility toggle - mouse look mode
- L - toggles the fake recognizer text box
- O - toggles the user's recognized text
- M - toggles speech recognition mode. When on, click and hold and talk in the mic. Release to quit talking.
- X - reset camera
- Z - show debug statistics
- I - Toggles sbm character subtitles
- P - Toggle entire GUI
- Alt-enter - toggle windowed / fullscreen
- Escape - quit
Accessing the Command Console
Use the ~ key to bring up the console.
...
Using the Console
...
Using SmartBody Bonebus Mode
Bonebus mode uses Smartbody as a separate process instead of integrated within Unity. This is useful if you have Unity Free since Smartbody uses Unity Plugins which is a Pro only feature.
...
...
Click 'Bonebus Init Scene' and the Characters will re-initialize in bonebus mode
If Unity will not Play because you have Unity Free, then click the SmartbodyManager gameobject and disable it before playing.
Developers
Loading VHToolkit Scene
- Open Unity
- File->Open Project (this may already be done for you if this is the first time you've launched Unity)
- On the Open Project tab, click the Open Other button.
- Navigate to the VHToolkit Unity Project here: <VHToolkit>\core\vhtoolkitUnity
- Click Select Folder
- In the Project column, double click on vhtoolkitScene.
- Click Play
Creating your own Project using the VHToolkit Unity Package
- Open Unity
- File->New Project
- You need 2 Unity Packages to start with. You'll find all packages here: <VHToolkit>\bin\vhtoolkitUnity. Copy them to <your project>\Assets.
- First, is the vhAssets package. This contains common scripts and libraries used in various Virtual Humans applications. There is a different .unitypackage file for each platform.
- vhAssetsPackage.unityPackage (Windows)
- vhAssetsPackageOSX.unityPackage
- vhAssetsPackageIOS.unityPackage
- vhAssetsPackageAndroid.unityPackage
- Second, is the vhAssets Test Scene. This contains assets and scripts that will initialize a very basic test scene environment. This file is: vhAssetsTestScenePackage.unityPackage
- Copy the 2 Unity Packages to this new project.
- In Unity, in the 'Project' column, double click on the 2 Unity Packages.
- Open Scenes->vhAssetsTestScene
- Click Play. The virtual human should be animating in an idle pose. Hit 'C' to show a debug menu. You should be able to control him via the buttons on the debug menu.
Creating your own Virtual Human
Creating your own Virtual Human has different meanings to different groups. Some people want to use the existing characters that we supply, but only change certain features like giving them a different voice, or a different colored shirt. Others groups want to use a different character, but the character was created using a standard character package that we already support (Mixamo, etc). Others want to use a completely different character with a unique skeleton, etc. These instructions will attempt to explain the different features and how to customize based on your needs.
The easiest way to use your own Virtual Human is to create a Unity Project using the included .unitypackages as a starting point. From here, you can add/change features on the default character, or bring in your own and customize using the existing character for reference.
Smartbody initialization
- SmartbodyInit class (Attached to SmartbodyManager gameobject)
- asset paths
- joint mapping
- mapped skeletons/motions
...
- Empty gameobject named 'SoundNode' attached as a child of the character's gameobject
- Attach a Sound Source script to the SoundNode gameobject
- Manually position the SoundNode gameobject where you want the character's speech to originate (eg, his mouth)
Using the Console
Hit the ~ key to bring up the console. Here you can see some debug information. Type 'help' for all available commands.
...
- q - quit
- play_intro - Play intro sequence
- vhmsg ... - Send vhmsg out to system. 'vhmsg sbm ...' for sending a smartbody command
- setresolution x y - Set resolution to 'x' x 'y'. Example 'setresolution 1024 768'
- toggle_fullscreen - toggle windowed / fullscreen
Message API
Receives:
- vrAllCall
- vrKillComponentMessages
- PlaySound
Sends:
Known Issues
- ...
FAQ
See Main FAQ for frequently asked questions regarding the installer. Please use the Google Groups emailing list for unlisted questions.