Skip to content

Latest commit

 

History

History
70 lines (53 loc) · 4.07 KB

README.md

File metadata and controls

70 lines (53 loc) · 4.07 KB

PUPPET installation

Requirements

Vive headset and a minimum of one active controller. Optionally additional vive controllers and vive trackers can also be added and used.

Build and install (windows)

  1. Download MuJoCo
  2. Add environment variable "MUJOCOPATH" in the System Properties to point to the downloaded path.
  3. Open x64 Native Tools Command Prompt from visual studios.
  4. Type SET MUJOCOPATH to verify that the path is correctly set and visible.
  5. Navigate to build/ folder.
  6. Check makefile to ensure all paths are corrent.
  7. Type nmake to build and install the project. It will compile two programs puppet.exe and playlog.exe.
  8. Use nmake clean if you need to clean the project installation. Note it doesn't clear recorded logs.

Usage

  1. puppet.exe is used for emersive visualization and interaction with the mujoco worlds.
  2. playlog.exe is can be used to replay recorded logs and dump raw video (Key F9 to start stop video recording) (pixel_format rgb24).

Navigate to build/ folder. Type puppet.exe or playlog.exe (without any arguments) for respective usage instructions.

Note1: Logs are dumped in mujoco's .mjl format. Refer Mujoco documenation for details.
Note2: You can use ffmpeg to convert the raw video. Ensure that the video resolution and fps matches with the settings used while dumping raw video.

ffmpeg -f rawvideo -pixel_format rgb24 -video_size 800x800 -framerate 60 -i rgb.out -vf "vflip" video.mp4

Bindings

Controller

Controller bindings

Controller have two modes

  1. Orient: Move and reposition the world with respect to the user

    • trigger - Engage repositioning
    • up/F8 - Toggle mocap1
    • down/F7 - Toggle mocap0
    • right/F6 - Toggle log saving
    • left/backspace - Reset the world (optionally save logs, if recorded)

  2. Operate: TeleOperate the scene via controller/ trackers/ external devices

    • Step1 - Use the up/down pad button to select the body of interest
    • Step2 - Use the side button to toggle between purturbation and no purturbation
    • Setp3 - Use the trigger to apply special purturbation
    • Step4 - Use the left pad button to reset the world

Keyboard

In addiiton to the usual Mujoco key bindings following Puppet specific bindings are available.

  • F6 - Dump logs toggle
  • F7 - Bind controller0 toggle
  • F8 - Bind controller1 toggle
  • F9 - Video recording toggle (only in playlog.exe)

Special cases

Controller/Mocap configuration

A xml with a mocap body called "mocap0/mocap1" gets associated with controller0/controller1 by default and places the controller in the "vTOOL_PULL" mode.

Fetch

While the vive driver is general purpose, There are fetch-gripper specific utilities that are provided if the xml loaded has two actuators with following names: "r_gripper_finger_joint" and "l_gripper_finger_joint"

Trouble shooting

  1. Vive tracker not detected? - you need to add Vive Tracker into SteamVR. Rightclick on one of the existing controller’s icon and click “Pair Controller” in the pop-up menu. Press the Power button on Vive Tracker for 2 seconds, and then release it to enter the paring mode. Note that if you have two Vive controllers already, then you will need to plug the dongle into the dongle cradle to PC’s USB port. More details can be found here Vive Tracker developer guide
  2. Vive-chaperone is in your view? - Vive doesn't allow you to fully disable the chaperon from the scene. However the chaperone can be removed from the view by tuning its alpha value to zero. Restart steaemVR for the new settings to take effect.
C:\Program Files (x86)\Steam\config\steamvr.vrsettings\collisionBounds: "CollisionBoundsColorGammaA" : 0