Ultimate Löve Toy (kinect + mindstorm nxt 2.0)

Showcase your games and demos, and discuss ongoing projects.

Ultimate Löve Toy (kinect + mindstorm nxt 2.0)

Postby hagish on Thu Jun 23, 2011 11:03 pm

I just finished the first milestone in building the ultimate love toy.
I added kinect and mindstorm nxt 2.0 support into love (both native löve modules).

Code: https://bitbucket.org/hagish/love-kinect-mindstorm

It's based on the current love tip (rude/love at bitbucket). At the moment the code is linux only, but it should be possible to port it to other systems.
Kinect support is based on libfreenect and nxt2 on a win/linux lib (i don't have a clue if there is mac support).

Current kinect features:
* Cam image
* Depth image
* Set LED status

Current mindstorm nxt 2.0 features:
* Connect via Bluetooth
* Control 1-3 motors
* Receive sensor information

The attachment contains the löve no-game screen with the 2 kinect cam images. And if this would be a video ;) you could see that the planet rotates if you hold sensor button 1 and stops if you release it.

I'll add some documentation and stuff and then I'll upload it to bitbucket.
---
Attachments
ultimate-love-toy.png
Screenshot
ultimate-love-toy.png (832.99 KiB) Viewed 977 times
Last edited by hagish on Sun Jun 26, 2011 2:52 pm, edited 1 time in total.
User avatar
hagish
Citizen
 
Posts: 85
Joined: Thu May 01, 2008 12:51 pm

Re: Ultimate Löve Toy (kinect + mindstorm nxt 2.0)

Postby middlerun on Fri Jun 24, 2011 1:46 am

Kinect in Löve! :awesome: My ultimate dream...

Is it possible to get skeleton data from the Kinect into Löve? That would open up some amazing possibilities.
User avatar
middlerun
Citizen
 
Posts: 64
Joined: Tue Nov 25, 2008 4:31 am
Location: Sydney, Australia

Re: Ultimate Löve Toy (kinect + mindstorm nxt 2.0)

Postby Robin on Fri Jun 24, 2011 7:12 am

That would be very awesome!
Help us help you: attach a .love.
User avatar
Robin
The Omniscient
 
Posts: 6179
Joined: Fri Feb 20, 2009 4:29 pm
Location: The Netherlands

Re: Ultimate Löve Toy (kinect + mindstorm nxt 2.0)

Postby hagish on Fri Jun 24, 2011 10:03 am

Currently there is no skeleton detectoin because libfreenect does not provide this data. I'm not sure if there is a free lib that can do it.
One could integrate OpenNI and PrimeSense for skeleton detection. But PrimeSense is not free in an open-source way (as far as I remember).
User avatar
hagish
Citizen
 
Posts: 85
Joined: Thu May 01, 2008 12:51 pm

Re: Ultimate Löve Toy (kinect + mindstorm nxt 2.0)

Postby vrld on Fri Jun 24, 2011 10:12 am

Awesome! Do we have access to the camera and depth image as in ImageData?

middlerun wrote:Is it possible to get skeleton data from the Kinect into Löve?
The skeleton data is not calculated on the kinect itself, but done in software. All you can get from the kinect is a camera image (actually two), a depth image and sound from a microphone array. Libraries like OpenNI and the Microsoft SDK use the depth image and rather complicated algorithms to get skeleton data.
When I was a kid I used to pray every night for a new bicycle. Then I realised God doesn’t work that way, so I stole one and prayed for forgiveness.
hump Helper Utilities for Massive Productivity | HardonCollider Collision detection | Quickie Easy GUI Library
User avatar
vrld
Party member
 
Posts: 835
Joined: Sun Apr 04, 2010 9:14 pm
Location: Germany

Re: Ultimate Löve Toy (kinect + mindstorm nxt 2.0)

Postby hagish on Fri Jun 24, 2011 11:40 am

Yes there is a getDepthAtXy : number, getDepthImage : ImageData and getRgbImage : ImageData.
User avatar
hagish
Citizen
 
Posts: 85
Joined: Thu May 01, 2008 12:51 pm

Re: Ultimate Löve Toy (kinect + mindstorm nxt 2.0)

Postby hagish on Sun Jun 26, 2011 2:52 pm

I just cleaned up my commit history and pushed the current version: https://bitbucket.org/hagish/love-kinect-mindstorm
User avatar
hagish
Citizen
 
Posts: 85
Joined: Thu May 01, 2008 12:51 pm

Re: Ultimate Löve Toy (kinect + mindstorm nxt 2.0)

Postby Lafolie on Wed Jul 13, 2011 8:18 pm

Most impressive. Image
Do you recognise when the world won't stop for you? Or when the days don't care what you've got to do? When the weight's too tough to lift up, what do you? Don't let them choose for you, that's on you.
User avatar
Lafolie
Inner party member
 
Posts: 786
Joined: Tue Apr 05, 2011 2:59 pm
Location: SR388


Return to Projects and Demos

Who is online

Users browsing this forum: BozoDel, CrackedP0t, McDunkinY and 6 guests