Ultimate Löve Toy (kinect + mindstorm nxt 2.0)

Showcase your libraries, tools and other projects that help your fellow love users.
Post Reply
User avatar
hagish
Citizen
Posts: 85
Joined: Thu May 01, 2008 12:51 pm
Contact:

Ultimate Löve Toy (kinect + mindstorm nxt 2.0)

Post by hagish »

I just finished the first milestone in building the ultimate love toy.
I added kinect and mindstorm nxt 2.0 support into love (both native löve modules).

Code: https://bitbucket.org/hagish/love-kinect-mindstorm

It's based on the current love tip (rude/love at bitbucket). At the moment the code is linux only, but it should be possible to port it to other systems.
Kinect support is based on libfreenect and nxt2 on a win/linux lib (i don't have a clue if there is mac support).

Current kinect features:
* Cam image
* Depth image
* Set LED status

Current mindstorm nxt 2.0 features:
* Connect via Bluetooth
* Control 1-3 motors
* Receive sensor information

The attachment contains the löve no-game screen with the 2 kinect cam images. And if this would be a video ;) you could see that the planet rotates if you hold sensor button 1 and stops if you release it.

I'll add some documentation and stuff and then I'll upload it to bitbucket.
---
Attachments
Screenshot
Screenshot
ultimate-love-toy.png (832.99 KiB) Viewed 4362 times
Last edited by hagish on Sun Jun 26, 2011 2:52 pm, edited 1 time in total.
User avatar
middlerun
Citizen
Posts: 64
Joined: Tue Nov 25, 2008 4:31 am
Location: Sydney, Australia
Contact:

Re: Ultimate Löve Toy (kinect + mindstorm nxt 2.0)

Post by middlerun »

Kinect in Löve! :awesome: My ultimate dream...

Is it possible to get skeleton data from the Kinect into Löve? That would open up some amazing possibilities.
User avatar
Robin
The Omniscient
Posts: 6506
Joined: Fri Feb 20, 2009 4:29 pm
Location: The Netherlands
Contact:

Re: Ultimate Löve Toy (kinect + mindstorm nxt 2.0)

Post by Robin »

That would be very awesome!
Help us help you: attach a .love.
User avatar
hagish
Citizen
Posts: 85
Joined: Thu May 01, 2008 12:51 pm
Contact:

Re: Ultimate Löve Toy (kinect + mindstorm nxt 2.0)

Post by hagish »

Currently there is no skeleton detectoin because libfreenect does not provide this data. I'm not sure if there is a free lib that can do it.
One could integrate OpenNI and PrimeSense for skeleton detection. But PrimeSense is not free in an open-source way (as far as I remember).
User avatar
vrld
Party member
Posts: 917
Joined: Sun Apr 04, 2010 9:14 pm
Location: Germany
Contact:

Re: Ultimate Löve Toy (kinect + mindstorm nxt 2.0)

Post by vrld »

Awesome! Do we have access to the camera and depth image as in ImageData?
middlerun wrote:Is it possible to get skeleton data from the Kinect into Löve?
The skeleton data is not calculated on the kinect itself, but done in software. All you can get from the kinect is a camera image (actually two), a depth image and sound from a microphone array. Libraries like OpenNI and the Microsoft SDK use the depth image and rather complicated algorithms to get skeleton data.
I have come here to chew bubblegum and kick ass... and I'm all out of bubblegum.

hump | HC | SUIT | moonshine
User avatar
hagish
Citizen
Posts: 85
Joined: Thu May 01, 2008 12:51 pm
Contact:

Re: Ultimate Löve Toy (kinect + mindstorm nxt 2.0)

Post by hagish »

Yes there is a getDepthAtXy : number, getDepthImage : ImageData and getRgbImage : ImageData.
User avatar
hagish
Citizen
Posts: 85
Joined: Thu May 01, 2008 12:51 pm
Contact:

Re: Ultimate Löve Toy (kinect + mindstorm nxt 2.0)

Post by hagish »

I just cleaned up my commit history and pushed the current version: https://bitbucket.org/hagish/love-kinect-mindstorm
User avatar
Lafolie
Inner party member
Posts: 809
Joined: Tue Apr 05, 2011 2:59 pm
Location: SR388
Contact:

Re: Ultimate Löve Toy (kinect + mindstorm nxt 2.0)

Post by Lafolie »

Most impressive. Image
Do you recognise when the world won't stop for you? Or when the days don't care what you've got to do? When the weight's too tough to lift up, what do you? Don't let them choose for you, that's on you.
Post Reply

Who is online

Users browsing this forum: No registered users and 52 guests