Voice activated keyboard and mouse commands

I recently picked up an occulus rift and found that even with my super whiz bang joystick etc. I had trouble doing 'things' that needed the keyboard and mouse, I would find it much easier to just say whatever I wanted - so with a few days off over xmas and a desire to write something in c#, I thought - why not! - so here we are.

Once you start the application, it should look like the image to the left and its as easy as saying "Computer", the computer will plays a small wave file of my choosing to let me know its listening, I then say "Stop engines" it then hits the 0 thrust in the game I am playing and says "Engines stopped"

By the way, I have tried to keep this as simple as possible, so there is no installer etc. just unpack it and in theory it should run, I am used to being able to compile up exe that dont require any other dependencies, so forgive me if it throws a hissy fit, I am guessing it will need .net 4 or 4.5?.

Unpacked the exe should be about 84^ishk and it will create a small xml file "C:\Users\[your name here]\Documents\chat2me.xml" for storing settings, actions etc.

ps. sorry I dont have a fancy logo / heading etc. nor does the application have a fancy logo, I am a code guy, not a designer - if you feel like making me an icon / logo etc. drop me an message (include your email address if you want me to respond, otherwise have at it!)

If you need a hand getting your localised language set up, head over to Language packs or Change your language or keyboard specifically the section on "Add a language" and "Download and install a language pack"

Log / Thoughts / Rants etc.

Under the file menu, click the "settings" option, then in the first edit box, type a word that when said, your computer will start listening to you.

You can also select a small wav file that is played when the computer begins listening, this helps when using a head mounted display or you cant see Chat-to.

Lastly, depending on your country and installed voice recognition regions, you can pick your language/region here, I assume by default most English speaking regions come default with en-US.

Click the right mouse button while hovering over the tree view and a menu will appear allowing you to do multiple functions, select "New Category" and a Category Creation window will appear.

Type in the name for your new category, eg. "Engine Commands" as we will use this to house all commands relating to the engines. (this will not effect your voice commands in any way, so call it what you like).

Right click the category you wish to add an action to and click the "New Action List" option.

Using the "When I hear" text box, enter the voice command you wish to say to trigger this action list.

By dragging on what looks like a keyboard key onto the area to the right of it will produce a keyboard entry and a dialog will appear.

• Pressed - This will emulate a single key press, this will also create 2 entries in the action list, 1 down action and 1 up action, you can move them up and down by dragging them with the mouse.


• Typed - This will emulate a group of keys being pressed and released as if you are typing each letter 1 at a time.

By dragging on what looks like a mouse onto the area to the right of it will produce a mouse entry and a dialog will appear.

• Location - Clicking the "Find location" button will give you 10 seconds (with verbal and visual queues) to move your mouse to the location you wish to capture, for most cases, its not the moving your mouse to the desired location but the location itself, you can also manually type the X and Y co-ords if you know them.


• Button - This will emulate a mouse button by adding 1 down and 1 up action, you can move them up and down by dragging them with the mouse.

By dragging on what looks like a speaker onto the area to the right of it will produce an audio entry and a dialog will appear.

Selecting the "..." button to the right of the text box, it will bring up a file browser which you can then browse to your desired wav file and select, to preview the sound, click the small speaker icon to the right of the ... button

Use this function for audible queues that your actions have been taken.

By dragging on what looks like lips onto the area to the right of it will produce an voice entry and a dialog will appear.

• Say - Enter the desired text you wish to hear in this box.
• Voice - Select the installed voice you wish to speak this message from this drop down list.
• Rate - The speed at which you wish to hear the "Say" text spoken.
• Volume - Adjust the volume you wish to hear this spoken.

Once you have changed all your settings, you can use the "Listen" button to preview the action.

Use this function for audible queues that your actions have been taken.

By dragging on what looks like a stopwatch onto the area to the right of it will produce an delay entry and a dialog will appear.

• Timed - Either enter a number (in milliseconds) directly into the text box, or drag the slider to your desired amount, keep in mind, 1 second is 1000milliseconds, this will support up to 1 minute, but if you need more than that, you can just add more delays.


• Window - This will cause the system to wait until the desired window has been found then bring the window to the foreground and focus on it.


• Stop if window is active - This will cause the entire action to stop if the window is found, this is handy when trying to speak to the wife and the app thinks you are asking it to run the application again.

By clicking the right mouse button, an action can be edited, please note - both keyboard and mouse 'down' and 'up' commands cant be edited as there is nothing to actually edit.

You can move actions up and down just by dragging them.