Ultimate Löve Toy (kinect + mindstorm nxt 2.0)

Showcase your libraries, tools and other projects that help your fellow love users.
User avatar
hagish
Citizen
Posts: 85
Joined: Thu May 01, 2008 12:51 pm
Contact:

Ultimate Löve Toy (kinect + mindstorm nxt 2.0)

Postby hagish » Thu Jun 23, 2011 11:03 pm

I just finished the first milestone in building the ultimate love toy.
I added kinect and mindstorm nxt 2.0 support into love (both native löve modules).

Code: https://bitbucket.org/hagish/love-kinect-mindstorm

It's based on the current love tip (rude/love at bitbucket). At the moment the code is linux only, but it should be possible to port it to other systems.
Kinect support is based on libfreenect and nxt2 on a win/linux lib (i don't have a clue if there is mac support).

Current kinect features:
* Cam image
* Depth image
* Set LED status

Current mindstorm nxt 2.0 features:
* Connect via Bluetooth
* Control 1-3 motors
* Receive sensor information

The attachment contains the löve no-game screen with the 2 kinect cam images. And if this would be a video ;) you could see that the planet rotates if you hold sensor button 1 and stops if you release it.

I'll add some documentation and stuff and then I'll upload it to bitbucket.
---
Attachments
ultimate-love-toy.png
Screenshot
ultimate-love-toy.png (832.99 KiB) Viewed 1515 times
Last edited by hagish on Sun Jun 26, 2011 2:52 pm, edited 1 time in total.

User avatar
middlerun
Citizen
Posts: 64
Joined: Tue Nov 25, 2008 4:31 am
Location: Sydney, Australia
Contact:

Re: Ultimate Löve Toy (kinect + mindstorm nxt 2.0)

Postby middlerun » Fri Jun 24, 2011 1:46 am

Kinect in Löve! :awesome: My ultimate dream...

Is it possible to get skeleton data from the Kinect into Löve? That would open up some amazing possibilities.

User avatar
Robin
The Omniscient
Posts: 6496
Joined: Fri Feb 20, 2009 4:29 pm
Location: The Netherlands
Contact:

Re: Ultimate Löve Toy (kinect + mindstorm nxt 2.0)

Postby Robin » Fri Jun 24, 2011 7:12 am

That would be very awesome!
Help us help you: attach a .love.

User avatar
hagish
Citizen
Posts: 85
Joined: Thu May 01, 2008 12:51 pm
Contact:

Re: Ultimate Löve Toy (kinect + mindstorm nxt 2.0)

Postby hagish » Fri Jun 24, 2011 10:03 am

Currently there is no skeleton detectoin because libfreenect does not provide this data. I'm not sure if there is a free lib that can do it.
One could integrate OpenNI and PrimeSense for skeleton detection. But PrimeSense is not free in an open-source way (as far as I remember).

User avatar
vrld
Party member
Posts: 909
Joined: Sun Apr 04, 2010 9:14 pm
Location: Germany
Contact:

Re: Ultimate Löve Toy (kinect + mindstorm nxt 2.0)

Postby vrld » Fri Jun 24, 2011 10:12 am

Awesome! Do we have access to the camera and depth image as in ImageData?

middlerun wrote:Is it possible to get skeleton data from the Kinect into Löve?
The skeleton data is not calculated on the kinect itself, but done in software. All you can get from the kinect is a camera image (actually two), a depth image and sound from a microphone array. Libraries like OpenNI and the Microsoft SDK use the depth image and rather complicated algorithms to get skeleton data.
I have come here to chew bubblegum and kick ass... and I'm all out of bubblegum.

hump | HC | SUIT | shine

User avatar
hagish
Citizen
Posts: 85
Joined: Thu May 01, 2008 12:51 pm
Contact:

Re: Ultimate Löve Toy (kinect + mindstorm nxt 2.0)

Postby hagish » Fri Jun 24, 2011 11:40 am

Yes there is a getDepthAtXy : number, getDepthImage : ImageData and getRgbImage : ImageData.

User avatar
hagish
Citizen
Posts: 85
Joined: Thu May 01, 2008 12:51 pm
Contact:

Re: Ultimate Löve Toy (kinect + mindstorm nxt 2.0)

Postby hagish » Sun Jun 26, 2011 2:52 pm

I just cleaned up my commit history and pushed the current version: https://bitbucket.org/hagish/love-kinect-mindstorm

User avatar
Lafolie
Inner party member
Posts: 795
Joined: Tue Apr 05, 2011 2:59 pm
Location: SR388
Contact:

Re: Ultimate Löve Toy (kinect + mindstorm nxt 2.0)

Postby Lafolie » Wed Jul 13, 2011 8:18 pm

Most impressive. Image
Do you recognise when the world won't stop for you? Or when the days don't care what you've got to do? When the weight's too tough to lift up, what do you? Don't let them choose for you, that's on you.


Return to “Libraries and Tools”

Who is online

Users browsing this forum: No registered users and 2 guests