Comments on: Augmented Reality Virtual Keyboard using HTML 5 video

By: antimatter15

antimatter15 — Wed, 30 Jun 2010 19:12:08 +0000

That’s awesome! I started a project somewhat like that last year which I ported to JS/Canvas+. Instead of using color tracking, my system requires the camera to be mounted at an angle (which makes the surface appear “shinier”, it reflects more light, and I don’t know the math to prove it but it’s true). So I have the thing scan from right to left vertically until it sees something finger-like and then looks to the immediate right and calculates whether or not it looks like there’s a reflection, since the real z-axis position is half of the percieved distance between the real and virtual image.

It also implements a nice matrix perspective transform thing which you might find useful :)

http://antimatter15.com/wp/2009/08/shinytouchjs/

(My site may be down, I’m in the process of switching hosts so the DNS may not have fully propagated)

By: Nick Lothian

Nick Lothian — Thu, 17 Jun 2010 23:18:16 +0000

It’s a recording of it working realtime.There is a working, real time demo at http://demo.nicklothian.com/keypad/

By: ferdy182

ferdy182 — Thu, 17 Jun 2010 21:10:10 +0000

But, this is not in real time, is it? it’s a recorded video..

By: Nick Lothian

Nick Lothian — Thu, 19 Nov 2009 23:14:44 +0000

@Ed – yes, good idea.

@Anees – it shouldn’t – it relies on color matching rather than position. I can’t say I’ve tried it, though.

By: Ed Spencer

Ed Spencer — Thu, 19 Nov 2009 21:15:13 +0000

Nice work, though the embedded video seems too wide for the page and gets clipped behind the left nav (on FF3.5 anyway).

Would be even better if you’d chuck it up on Github so people can fork it :)

By: Anees Uddin

Anees Uddin — Thu, 19 Nov 2009 12:02:03 +0000

Does the camera need to be static for that to remain workable?