Voice activated keyboard and mouse commands

(and its totally free)

Settings |  Category |  Action |  Keyboard |  Mouse |  Audio |  Voice |  Delay / Stop |  Editing Actions |  Moving Actions |  Download

Step 1. - In the beginning

I recently picked up an occulus rift and found that even with my super whiz bang joystick etc. I had trouble doing 'things' that needed the keyboard and mouse, I would find it much easier to just say whatever I wanted - so with a few days off over xmas and a desire to write something in c#, I thought - why not! - so here we are.

Once you start the application, it should look like the image to the left and its as easy as saying "Computer", the computer will plays a small wave file of my choosing to let me know its listening, I then say "Stop engines" it then hits the 0 thrust in the game I am playing and says "Engines stopped"

By the way, I have tried to keep this as simple as possible, so there is no installer etc. just unpack it and in theory it should run, I am used to being able to compile up exe that dont require any other dependencies, so forgive me if it throws a hissy fit, I am guessing it will need .net 4 or 4.5?.

Unpacked the exe should be about 84ishk and it will create a small xml file "C:\Users\[your name here]\Documents\chat2me.xml" for storing settings, actions etc.

ps. sorry I dont have a fancy logo / heading etc. nor does the application have a fancy logo, I am a code guy, not a designer - if you feel like making me an icon / logo etc. drop me an message (include your email address if you want me to respond, otherwise have at it!)

If you need a hand getting your localised language set up, head over to Language packs or Change your language or keyboard specifically the section on "Add a language" and "Download and install a language pack"

Feedback?

Log / Thoughts / Rants etc.

2015.02.10 - heh, so now I am legit!, my Comodo cert finally came through and I have signed the code, so now its just a matter of time before my name is finally truted by the whole smartscreen this, yeah its not just a matter of me signing stuff, now microsoft has to learn to trust my sig.

2015.02.06 - So I decided to get myself a code sign cert anyway, I mean I am a software engineer so it kinda makes sense right? I dont always ONLY release stuff for the company I work for, so anyways - I gotta tell you, trying to get a code sign cert is rediclous - so far its cost me almost 500 bucks and 4 weeks of trying to prove who I am, who the lawyer I am using is, time zone delays etc. - can you imagine a 11 - 12 year old just getting into dev and this happens. yeah, this is why people dont get into software dev any more - thats why the Raspberry PI is seriously important!

2015.01.30 - Added "Stop if this window is active" to the Delay options, this cause the script to stop alltogether if the window is found.

2015.01.18 - Added "Window" as a Delay option, this will ensure the target window is running and to the foreground.

2015.01.16.4.11 - So it turns out that devs cant just stick something online and say "Try this out" any more, 3rd parties cant make money from that sort of behaviour, Microsoft wont get to say "We have 1 more app in our online store that makes us 1 app closer to being better than the apple store" and people who sell EV code certificates for hundreds of dollars will miss out on that, so the downside to that is, you are going to be warned that the exe is going to deep fry your computer if you run it, and I understand if you dont want to touch it after that, I mean the screen goes dark and a huge blue bar comes up in your face, and everyone has associated blue with being the grim reaper when it comes to computers - for those of you who want to press on - you can just do the following - hit the "More info" button, its going to say "We dont know who wrote it, but its your call" then just hit "Run anyway" - as I said, its totally your call, I havent installed any virus etc. but I am not going to pay 200 bucks for something that I wrote for myself. (and they wonder why we are losing software engineers etc. if kids cant go 'this is going to be awesome when I give it to Bob!!' whats the point? I mean saying to a kid at 12 - when you get older, you can make heaps of blah blah if you do this, they have no real concept of money, I am sure people who do things like flappy bird arent saying, "Man, I would love to play a game where I touch a button and something goes up then some fake gravity makes it go down!! I have totally lost my mind as its the defintion of crazy", its "I would love to see other people get annoyed with something so petty")

2015.01.16 - Realised I had forgotten to add a dialog for "I will play this wave when I start listening", I also made the text in the Command List box a smidge larger (10px vs 8.5px)

2015.01.14 - I guess you could call this release 1


Top |  Settings |  Category |  Action |  Keyboard |  Mouse |  Audio |  Voice |  Delay / Stop |  Editing Actions |  Moving Actions |  Download

Step 2. - Initial Settings

 

Under the file menu, click the "settings" option, then in the first edit box, type a word that when said, your computer will start listening to you.

You can also select a small wav file that is played when the computer begins listening, this helps when using a head mounted display or you cant see Chat-to.

Lastly, depending on your country and installed voice recognition regions, you can pick your language/region here, I assume by default most English speaking regions come default with en-US.


Top |  Settings |  Category |  Action |  Keyboard |  Mouse |  Audio |  Voice |  Delay / Stop |  Editing Actions |  Moving Actions |  Download

Step 3. - Creating a Category

 

Click the right mouse button while hovering over the tree view and a menu will appear allowing you to do multiple functions, select "New Category" and a Category Creation window will appear.

Type in the name for your new category, eg. "Engine Commands" as we will use this to house all commands relating to the engines. (this will not effect your voice commands in any way, so call it what you like).


Top |  Settings |  Category |  Action |  Keyboard |  Mouse |  Audio |  Voice |  Delay / Stop |  Editing Actions |  Moving Actions |  Download

Step 4. - Adding an Action

 

Right click the category you wish to add an action to and click the "New Action List" option.

Using the "When I hear" text box, enter the voice command you wish to say to trigger this action list.


Top |  Settings |  Category |  Action |  Keyboard |  Mouse |  Audio |  Voice |  Delay / Stop |  Editing Actions |  Moving Actions |  Download

Step 5. - Adding Keyboard

 

By dragging on what looks like a keyboard key onto the area to the right of it will produce a keyboard entry and a dialog will appear.

  • Pressed - This will emulate a single key press, this will also create 2 entries in the action list, 1 down action and 1 up action, you can move them up and down by dragging them with the mouse.

  • Typed - This will emulate a group of keys being pressed and released as if you are typing each letter 1 at a time.

Top |  Settings |  Category |  Action |  Keyboard |  Mouse |  Audio |  Voice |  Delay / Stop |  Editing Actions |  Moving Actions |  Download

Step 6. - Adding Mouse

 

By dragging on what looks like a mouse onto the area to the right of it will produce a mouse entry and a dialog will appear.

  • Location - Clicking the "Find location" button will give you 10 seconds (with verbal and visual queues) to move your mouse to the location you wish to capture, for most cases, its not the moving your mouse to the desired location but the location itself, you can also manually type the X and Y co-ords if you know them.

  • Button - This will emulate a mouse button by adding 1 down and 1 up action, you can move them up and down by dragging them with the mouse.

Top |  Settings |  Category |  Action |  Keyboard |  Mouse |  Audio |  Voice |  Delay / Stop |  Editing Actions |  Moving Actions |  Download

Step 7. - Adding Audio

 

By dragging on what looks like a speaker onto the area to the right of it will produce an audio entry and a dialog will appear.

Selecting the "..." button to the right of the text box, it will bring up a file browser which you can then browse to your desired wav file and select, to preview the sound, click the small speaker icon to the right of the ... button

Use this function for audible queues that your actions have been taken.


Top |  Settings |  Category |  Action |  Keyboard |  Mouse |  Audio |  Voice |  Delay / Stop |  Editing Actions |  Moving Actions |  Download

Step 8. - Adding Voice

 

By dragging on what looks like lips onto the area to the right of it will produce an voice entry and a dialog will appear.

  • Say - Enter the desired text you wish to hear in this box.
  • Voice - Select the installed voice you wish to speak this message from this drop down list.
  • Rate - The speed at which you wish to hear the "Say" text spoken.
  • Volume - Adjust the volume you wish to hear this spoken.

Once you have changed all your settings, you can use the "Listen" button to preview the action.

Use this function for audible queues that your actions have been taken.


Top |  Settings |  Category |  Action |  Keyboard |  Mouse |  Audio |  Voice |  Delay / Stop |  Editing Actions |  Moving Actions |  Download

Step 9. - Adding a Delay

 

By dragging on what looks like a stopwatch onto the area to the right of it will produce an delay entry and a dialog will appear.

  • Timed - Either enter a number (in milliseconds) directly into the text box, or drag the slider to your desired amount, keep in mind, 1 second is 1000milliseconds, this will support up to 1 minute, but if you need more than that, you can just add more delays.

  • Window - This will cause the system to wait until the desired window has been found then bring the window to the foreground and focus on it.

  • Stop if window is active - This will cause the entire action to stop if the window is found, this is handy when trying to speak to the wife and the app thinks you are asking it to run the application again.

Top |  Settings |  Category |  Action |  Keyboard |  Mouse |  Audio |  Voice |  Delay / Stop |  Editing Actions |  Moving Actions |  Download

Step 10. - Editing Actions

 

By clicking the right mouse button, an action can be edited, please note - both keyboard and mouse 'down' and 'up' commands cant be edited as there is nothing to actually edit.


Top |  Settings |  Category |  Action |  Keyboard |  Mouse |  Audio |  Voice |  Delay / Stop |  Editing Actions |  Moving Actions |  Download

Step 11. - Moving Actions

 

You can move actions up and down just by dragging them.


Top |  Settings |  Category |  Action |  Keyboard |  Mouse |  Audio |  Voice |  Delay / Stop |  Editing Actions |  Moving Actions |  Download

Step 12.

 

There are no more steps - this is my elite set up as of finishing this app.



Top |  Settings |  Category |  Action |  Keyboard |  Mouse |  Audio |  Voice |  Delay / Stop |  Editing Actions |  Moving Actions |  Download