Kinect Plug-in Features

[spud]

I'm working on a kinect plugin for HS3.
So far it can detect how many people there is in a specific zone of the room (see screenshots below), and it can do some basic gesture and posture recognition.

I would like to hear what would be the most desired features for such a kinect plugin?

[S-F]

Wow. This could be really big.

I would like to see the ability to recognize people.

[langenet]

What hardware does this require?

[Pete]

A good VR working interface would also be nice.

I would probably use it to manage the multimedia stuff in the family room; simple stuff; then again even a hand gesture would be better than using the remote....

I never have utilized Homeseer VR but did play with TTS stuff in the 80's and 90's; today though I have it shut off in two vehicles because it was annoying me.

Kind of what CastleOS is doing would be nice...

http://www.castleos.com/

[enigmatheatre]

wow I cant wait for this. If you need a Beta tester then I am here to help.

I would love this to do VR , gesture and posture recognition.

Keep up what looks like great work.

Greig.

[huggy_d1]

I don't own a kinect device, but if I could put one in the master bedroom and it could tell we're all asleep, ignore all cat activity, and turn off the lights either by VR, gesture, or 5 minutes after we fall asleep, and dim to 20% if we get up from the bed, that would be pretty awesome.

I can do some of this now with motion sensors and VR and some trickery, but really, the entire reason I started home automation was to do what I just stated above.... The rest of the stuff that I've added over the years, that's jsut gravy (icing on the cake).

If the kinect can wirelessly be connected to the HS server, would this be strictly HS2 or HS3 or would it be multi-version capable?

[spud]

If the kinect can wirelessly be connected to the HS server, would this be strictly HS2 or HS3 or would it be multi-version capable?

it would be a HS3 plugin only.

The kinect needs to be connected to a win7 or win8 machine on which the plugin would be installed. HS3 supports remote plugin, so the kinect machine is not necessarily the HS server.

[spud]

What hardware does this require?

it requires a Microsoft Kinect. There are two version of these

• Kinect for Xbox 360
• Kinect for Windows

They are almost the same hardware, but Kinect for Windows supports additional features (like near mode) but is more expensive.


Kinect for Xbox 360 is not officially supported to work connected to a PC, and the kinect runtime will not work with this version.

From Kinect FAQ

The Kinect for Xbox 360 sensor was built for and tested with the Xbox 360 only, not with any other platform, which is why it is not licensed for general commercial use, supported, or under warranty when used on any other platform.

That being said, the kinect SDK supports kinect for Xbox 360 for "development purposes".

This is the version I have to develop this plugin and it works great. I just get a warning in visual studio:

The Kinect sensor plugged into your computer is for use on the Xbox 360.
You may continue using your Xbox 360 Kinect sensor on your computer for development purposes.
Microsoft does not guarantee full compatibility for Kinect for Windows applications and the Xbox 360 Kinect Sensor.

[enigmatheatre]

Will this support more than one connect?
Will this support multiple plugins on different computers with connects attached?

[spud]

Will this support more than one connect?
Will this support multiple plugins on different computers with connects attached?

yes the plugin will support multiple instances in multiple processes mode, but right now this mode is a little buggy in HS3; I have a bugzilla ticket that needs to be addressed for this to work correctly.

[Jebus]

I have the xbox 360 version of kinect . I thought I had to go to the PC version to utilize this with HS. I started some code but time does not allow it. I would be more than happy to beta test. My main HS2 box is win 7.

I had the VR and Cam working with HS 2 and thats as far as I have got it. It has an array noise cancelling mic setup which did work very well with HS.
VR and people recognition would be high on the list.
Ability to lock system until admin is recognized.
Sitting or standing recognition could be utilized uniquely too.
Pet recognition?
I'm willing to "donate" to help to bring this to fruition.

[Rick Tinker]

Good job Spud! I am interested in this as well - not that I don't already have a ton of things going on and plug-ins to upgrade, but I will definitely be following this... gonna go check out the price on the Kinect now!

[S-F]

I don't own a kinect device, but if I could put one in the master bedroom and it could tell we're all asleep, ignore all cat activity, and turn off the lights either by VR, gesture, or 5 minutes after we fall asleep, and dim to 20% if we get up from the bed, that would be pretty awesome.

I imagine it would be a stretch for the Kinect to detect people in bed reliably. It if could though.................

[spud]

Good VR seems to be the most wanted, so that's what I'm going to work on next. Once it's done I will post a Beta version of the plugin.

I'm willing to "donate" to help to bring this to fruition.

I accept Bitcoin donations, my address is 1KhksuMBY3syCxP3hh6ZWdz9kXjAmCjYQ8
If you don't know what is Bitcoin, google it and read about it, it's very innovative and interesting stuff.

[Blade]

I had started a kinect plugin for HS3 back at the beginning of the year but have not had time to work on it.
Good to see it being worked on. Not sure if I will finish mine. Too many other plugins to update and add to right now