www.homeseer.com    
 

Go Back   HomeSeer Message Board > Gaming Related Plug-ins > Gaming Related Discussion > Kinect (3P)

Kinect (3P) Discussions related to the Kinect plugin for HS3.

Reply
 
Thread Tools Display Modes
  #61  
Old December 25th, 2014, 02:04 AM
kenrad's Avatar
kenrad kenrad is offline
Seer Master
 
Join Date: Sep 2012
Location: Shawano,WI
Posts: 831
I have been working on trying to get my kinect VR setup to trigger russound zones based what kinect heard the voice command that way it can turn on and off the zones based on where the voice command came from. would it be possible to add an event trigger that if any voice command is recognized run an event

Thanks Ken
__________________
HSPRO,HS3PRO, BLsecurity, , MCSxap, HSTouch Android, UltraGCIR, CM15a, USBUIRT, BLUSBUIRT, WIFIRGB, BLAB8SS, BLcontrol, BLGData, BLLAN,BLOccupied, BLRadar, BLVolume, iTunesDAAP, UltraGCIR3, Airplayspeak, BLalarm, BLbackup, BLLED, BLrandom, BLReminders, BLRF, BL Speech, Hyperion, IFTTT, KINECT, XBMC, MCSprinkers PRO, PHLocation, ULtrapioneer, Ultralog, ultraweatherbug, Z,troller, GC-100, GC WIFICC, GC-WIFI SERIAL, Nitrogen logic depth camera controllers,
Reply With Quote
  #62  
Old December 25th, 2014, 06:04 AM
spud's Avatar
spud spud is offline
Moderator
 
Join Date: Jan 2012
Location: Canada
Posts: 4,644
Quote:
Originally Posted by surovich View Post
1. Can you add a global set of variables that can be picked up from any Kinect, similar to what you do now for each instance, but in a script its getting old to check for each variable in each instance since its a shared script.
in the config page (for instances which have a name) there is a setting called "Use Global Vars Specifics to Instance", untick this and it will always use the variables KinectVar0, KinectVar1, ... whatever the instance is

Quote:
Originally Posted by surovich View Post
2. Can you get the remote plugin to know the speaker client name (if running on the Kinect system), or let us add it as a passed parameters when we launch the plugin. This way I can direct the output back to single speaker.

3. Right now when I create an event with a Kinect phrase, it replies to all speakers - so in that drop down, I think it would be great to see a selection for "All Kinect's" for recognition, and a speaker client drop down for replies "Speaker 1" "Speaker 2" or "All Speaker Clients"
I could let you assign a speaker to an instance in the config page, and let you get that information through a scripting call, but I'm not sure that would help you because to call a scripting function from one plugin instance you still have to know the name of this instance...
Reply With Quote
  #63  
Old December 25th, 2014, 06:16 AM
spud's Avatar
spud spud is offline
Moderator
 
Join Date: Jan 2012
Location: Canada
Posts: 4,644
Quote:
Originally Posted by kenrad View Post
I have been working on trying to get my kinect VR setup to trigger russound zones based what kinect heard the voice command that way it can turn on and off the zones based on where the voice command came from. would it be possible to add an event trigger that if any voice command is recognized run an event

Thanks Ken
not sure I understand, do you mean you want a trigger like "Any phrase was recognized" which would fire when any other "A phrase was recognized" trigger also fires?
Reply With Quote
  #64  
Old December 25th, 2014, 01:34 PM
kenrad's Avatar
kenrad kenrad is offline
Seer Master
 
Join Date: Sep 2012
Location: Shawano,WI
Posts: 831
Yeah when and phrase is triggered. That way if a voice command is recognized from that instance the event will run. This would allow me to turn on russound zones for tts response in the selected area
Reply With Quote
  #65  
Old December 25th, 2014, 01:58 PM
kenrad's Avatar
kenrad kenrad is offline
Seer Master
 
Join Date: Sep 2012
Location: Shawano,WI
Posts: 831
SPud,

to make this a little more clear, a trigger that would fire when any phrase was recognized so for instance if I have and event that runs when the phrase turn on the light is heard it also trigger the event that any phrase recognized so no matter what phrase was recognized the event would run this would allow the speaker zones to be triggered for tts response every time the kinect vr recognized a phrase and you could have tts confirmation with out changing zones in other parts of the house.
Reply With Quote
  #66  
Old March 5th, 2015, 10:22 AM
hjk hjk is offline
Seer Deluxe
 
Join Date: Jun 2010
Location: Texas
Posts: 200
WAV file output

I saw somewhere that there was a feature request to save a WAV file of the spoken capture, for uploading via API to a voice recognition service.

OR - and perhaps an intermediate step - get the raw text from the Kinect SDK recognition engine.

My application is to do things with the raw text that I didn't previously define in a recognition string. Maybe do it as a sub-grammar. For example, let's say:

I define an event, "Computer, let's schedule something." Action: load grammar "Scheduling".

I speak, "Schedule a new event called Guests for 8pm on Saturday." Obviously, I can't pre-define what this will be. But maybe the sub-grammar phrase is "Schedule a new event," and executes a script. The script can pull the raw string from a Global Var maybe, or from a plugin call. Then either I can try to parse it in my script, or maybe I send this to a Google API for execution.

Just some ideas. Without your code and with no knowledge of the Kinect SDK, I have no idea how hard this ask is to implement.

Still one of the most useful(/cool/sexy) plugins ever for me!

hjk
---
Reply With Quote
  #67  
Old March 5th, 2015, 12:21 PM
spud's Avatar
spud spud is offline
Moderator
 
Join Date: Jan 2012
Location: Canada
Posts: 4,644
Quote:
Originally Posted by hjk View Post
I saw somewhere that there was a feature request to save a WAV file of the spoken capture, for uploading via API to a voice recognition service.

OR - and perhaps an intermediate step - get the raw text from the Kinect SDK recognition engine.

My application is to do things with the raw text that I didn't previously define in a recognition string. Maybe do it as a sub-grammar. For example, let's say:

I define an event, "Computer, let's schedule something." Action: load grammar "Scheduling".

I speak, "Schedule a new event called Guests for 8pm on Saturday." Obviously, I can't pre-define what this will be. But maybe the sub-grammar phrase is "Schedule a new event," and executes a script. The script can pull the raw string from a Global Var maybe, or from a plugin call. Then either I can try to parse it in my script, or maybe I send this to a Google API for execution.

Just some ideas. Without your code and with no knowledge of the Kinect SDK, I have no idea how hard this ask is to implement.

Still one of the most useful(/cool/sexy) plugins ever for me!

hjk
---
I can let you add wildcard (*) at the end of a voice command, and then save to a wav file this part of the command.

so for example you would set up a voice command trigger like "Schedule a new event, *" then when you speak "Schedule a new event called Guests for 8pm on Saturday." you would get a wav file containing "called Guests for 8pm on Saturday"

Then you could do whatever you want with this wav file, like calling an online voice recognition service.
Reply With Quote
  #68  
Old March 5th, 2015, 01:11 PM
hjk hjk is offline
Seer Deluxe
 
Join Date: Jun 2010
Location: Texas
Posts: 200
SPUD! That would be amazing! Taking it a stretch further (not for me specifically, but maybe for others who might request) -- could you include an option/API call/alternate WAV with the whole text, in addition to this wildcard capability?
Reply With Quote
  #69  
Old March 6th, 2015, 10:50 AM
JimBob's Avatar
JimBob JimBob is offline
Seer Master
 
Join Date: Mar 2002
Location: UK
Posts: 806
On the events page, would it be possible to state the instance of the Kinect plugin involved in the trigger?

I have two remote plugin instances. When I go into the event details, the trigger just shows up as:
Kinect: A phrase was recognized
Phrase = Blah Blah

Would it be possible to show it as:
Instance: Living Room
Kinect: A phrase was recognized
Phrase = Blah Blah

I can see the instance involved only by going into edit mode for the trigger.

Thanks.
Reply With Quote
  #70  
Old March 6th, 2015, 11:18 AM
spud's Avatar
spud spud is offline
Moderator
 
Join Date: Jan 2012
Location: Canada
Posts: 4,644
Quote:
Originally Posted by JimBob View Post
On the events page, would it be possible to state the instance of the Kinect plugin involved in the trigger?

I have two remote plugin instances. When I go into the event details, the trigger just shows up as:
Kinect: A phrase was recognized
Phrase = Blah Blah

Would it be possible to show it as:
Instance: Living Room
Kinect: A phrase was recognized
Phrase = Blah Blah

I can see the instance involved only by going into edit mode for the trigger.

Thanks.
yes, will do
Reply With Quote
  #71  
Old March 6th, 2015, 11:25 AM
JimBob's Avatar
JimBob JimBob is offline
Seer Master
 
Join Date: Mar 2002
Location: UK
Posts: 806
Quote:
Originally Posted by spud View Post
yes, will do
Super, cheers spud
Reply With Quote
  #72  
Old March 11th, 2015, 03:59 PM
spud's Avatar
spud spud is offline
Moderator
 
Join Date: Jan 2012
Location: Canada
Posts: 4,644
Quote:
Originally Posted by JimBob View Post
On the events page, would it be possible to state the instance of the Kinect plugin involved in the trigger?

I have two remote plugin instances. When I go into the event details, the trigger just shows up as:
Kinect: A phrase was recognized
Phrase = Blah Blah

Would it be possible to show it as:
Instance: Living Room
Kinect: A phrase was recognized
Phrase = Blah Blah

I can see the instance involved only by going into edit mode for the trigger.

Thanks.
done in version 3.0.0.28
Reply With Quote
  #73  
Old March 11th, 2015, 04:12 PM
JimBob's Avatar
JimBob JimBob is offline
Seer Master
 
Join Date: Mar 2002
Location: UK
Posts: 806
Superb. Working a treat.

Many thanks,
John
Reply With Quote
  #74  
Old March 11th, 2015, 04:13 PM
spud's Avatar
spud spud is offline
Moderator
 
Join Date: Jan 2012
Location: Canada
Posts: 4,644
in version 3.0.0.28, I have added support for wildcard in "A phrase was recognized" triggers

so you can now specify one or several * anywhere in the phrase to be recognized, and the recognition engine will accept any words or group of words instead of the *. Moreover the plugin will record as wav files the wilcard words you spoke.
the files are saved as Wave/Kinect<instance_name>Wildcard<wildcard_index>.wav
for example if the instance name is "LivingRoom" and you only have one wildcard in the phrase, the file is saved as Wave/KinectLivingRoomWildcard0.wav

screenshot below shows a simple example
if you say "Kinect, my name is spud"
HS will answer back "Hello spud. Nice to meet you! "
the "spud" part being your own recorded voice

Name:  wildcard.jpg
Views: 199
Size:  59.0 KB

in the same version I have also added the possibility to record any recognized phrase as a wav file, to do that you need to tick the "Save Recognized Phrase as Wav File" checkbox in the config page

Last edited by spud; March 11th, 2015 at 04:43 PM.
Reply With Quote
  #75  
Old March 11th, 2015, 04:23 PM
JimBob's Avatar
JimBob JimBob is offline
Seer Master
 
Join Date: Mar 2002
Location: UK
Posts: 806
Just to confirm the camera mirror issue has been resolved ok.

I like the idea of the console log timestamps too.

I'm now thinking of applications for using the wildcard ;-)

Great plugin spud.
Reply With Quote
  #76  
Old April 9th, 2015, 09:29 PM
surovich
Guest
 
Posts: n/a
Awesome Add on Spud! Now that I have only a 55 Hour work week average now, I can play some more....
Reply With Quote
  #77  
Old April 17th, 2015, 07:21 PM
Mr_Resistor Mr_Resistor is offline
Seer Deluxe
 
Join Date: Jan 2010
Location: San Francisco Bay Area
Posts: 339
Any update on Connect v2 / XBox One Kinect w/ PC kit

Is there any update on support of Connect v2 or Xbox One Kinect with PC adapter doohickey? Did I miss an update? Is it supported? Will it be Soon? Getting the itch to punch up the "Holy CRAP that's COOL" factor and this seemed like just the thing.
Reply With Quote
  #78  
Old April 18th, 2015, 02:56 PM
spud's Avatar
spud spud is offline
Moderator
 
Join Date: Jan 2012
Location: Canada
Posts: 4,644
Quote:
Originally Posted by jfryhling View Post
Is there any update on support of Connect v2 or Xbox One Kinect with PC adapter doohickey? Did I miss an update? Is it supported? Will it be Soon? Getting the itch to punch up the "Holy CRAP that's COOL" factor and this seemed like just the thing.
Kinect 2 is not supported yet. Microsoft did not make it easy as the Kinect 2 needs a new SDK which is not backwards compatible with Kinect 1.
Anyway I still plan to support it, but it won't be before at least July.
Reply With Quote
  #79  
Old May 18th, 2015, 03:52 PM
clafa clafa is offline
Seer Deluxe
 
Join Date: May 2015
Location: Atlanta
Posts: 132
Kinect Pliugin integration with Google App API

Spud,

I am new to the home automation scene, and I just bought a S6Pro to use your plugin for the Kinect! Thanks for your work on the plugin.

It would be GREAT to have the kinect plugin pass a 'command' to the Google App, so we could 'ask' any question and have Google provide the answer.

https://cloud.google.com/appengine/downloads

Thanks for your hard work.
Chris
Reply With Quote
  #80  
Old May 23rd, 2015, 05:56 PM
hjk hjk is offline
Seer Deluxe
 
Join Date: Jun 2010
Location: Texas
Posts: 200
Could we bubble Kinect VR events with low confidence?

Hi Spud,

So the built-in VR does the infernal "I don't understand" message when it can't resolve a VR statement.

When I talk to the computer, I'd like it to let me know when VR failed... something like this:

If a phrase was spoken and confidence is between .8 and .89, then speak/play sound.

How possible is this? I don't necessarily need to know WHAT was spoken; i.e., the possible phrase, although that might be cool, just that SOMETHING was registered as CLOSE, but no cigar.

Whacha think?

Thanks!!

hjk
---
Reply With Quote
Reply

Bookmarks

Tags
features, kinect

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
EnvisaLink DSC Plug-in - Feature requests spud Envisalink DSC Plugin (3P) 107 December 16th, 2017 04:08 PM
Vista Alarm Plug-in Feature Requests mnsandler Vista Alarm Plug-in (3P) 69 November 9th, 2017 02:45 PM
Kodi/XBMC Plug-in - Feature Requests spud Kodi/XBMC Plug-In (3P) 257 November 3rd, 2017 03:55 PM
Feature Requests for the Mark Sandler Insteon PLM Plug-In mnsandler Insteon Plug-in (Mark Sandler) 322 July 23rd, 2017 02:14 PM
Kinect Plug-in Features spud HomeSeer General Discussion Area 30 November 8th, 2016 06:46 PM


All times are GMT -4. The time now is 06:10 PM.


Copyright HomeSeer Technologies, LLC