java

Rhino Speech-to-Intent Engine Demos

Made in Vancouver, Canada by Picovoice

This package contains Java command-line demos for processing real-time audio (i.e. microphone) and audio files using Rhino Speech-to-Intent engine.

Rhino

Rhino is Picovoice's Speech-to-Intent engine. It directly infers intent from spoken commands within a given context of interest, in real-time. For example, given a spoken command "Can I have a small double-shot espresso with a lot of sugar and some milk", Rhino infers that the user wants to order a drink with these specifications:

{
  "type": "espresso",
  "size": "small",
  "numberOfShots": "2",
  "sugar": "a lot",
  "milk": "some"
}

Rhino is:

• using deep neural networks trained in real-world environments.
• compact and computationally-efficient, making it perfect for IoT.
• self-service. Developers and designers can train custom models using Picovoice Console.

Compatibility

• Java 8+
• Runs on Linux (x86_64), macOS (x86_64) and Windows (x86_64)

Installation

You can get the latest Java demo executable JARs here.

If you wish, you can build the demos from source by opening the project with the IntelliJ IDE. Select "Build > Build Project" to build the two demo classes or "Build > Build Artifacts" to create the executable JARs.

Usage

NOTE: the working directory for all dotnet commands is:

rhino/demo/java/bin

File Demo

The file demo uses Rhino to get an inference result from an audio file. This demo is mainly useful for quantitative performance benchmarking against a corpus of audio data. Note that only the relevant spoken command should be present in the file and no other speech. There also needs to be at least one second of silence at the end of the file.

java -jar rhino-file-demo.jar -i ${AUDIO_PATH} -c ${CONTEXT_PATH}

Microphone Demo

The microphone demo opens an audio stream from a microphone and performs inference on spoken commands:

java -jar rhino-mic-demo.jar -c ${CONTEXT_PATH}

It is possible that the default audio input device is not the one you wish to use. There are a couple of debugging facilities baked into the demo application to solve this. First, type the following into the console:

java -jar rhino-mic-demo.jar -sd

It provides information about various audio input devices on the box. On a Windows PC, this is the output:

Available input devices:

    Device 0: Microphone Array (Realtek(R) Au
    Device 1: Microphone Headset USB	

You can use the device index to specify which microphone to use for the demo. For instance, if you want to use the Headset microphone in the above example, you can invoke the demo application as below:

java -jar rhino-mic-demo.jar -c ${CONTEXT_PATH} -di 1

If the problem persists we suggest storing the recorded audio into a file for inspection. This can be achieved with:

java -jar rhino-mic-demo.jar -c ${CONTEXT_PATH} -di 1 -o ./test.wav

If after listening to stored file there is no apparent problem detected please open an issue.