I almost don't see why this can't be realtime. I imagine from here, all you need to do is throw more computing power at it? It's very cool. Imagine this plus a head-mounted pico-projector - any scrap of paper or wall could become an interface. Very excited about this technology.