Art+Tech Demo:Virtual Reality Iron Man UI

By on January 27, 2014

The Cave: Chillin’ with J.A.R.V.I.S in Virtual Reality

[youtube id=”YkYOcsDMjQs” width=”600″ height=”350″]

Ever wanted to know what it would be like to control J.A.R.V.I.S. like Iron Man? So did we. So we made a Virtual Reality demo for the Oculus. Try it out and let us know!

We’re really excited about creating cinematic interactive narratives for virtual reality. Over the past year, we have been doing a lot of research and development on our process for creating hyper-realistic 3D scans of people. We ultimately want to get to the point of being able to do a 4D performance capture.

But that’s not just it. Our goal is to make it easy so that everyone can go out and quickly capture 3D content for their own VR experiences, whether it’s downtown Paris or a performance capture of some actors. I think once you’ve experienced the power of hyper-realistic performance capture and VR, it’s hard to go back.

So, here’s our first demo that we created for the rift that includes a UI inspired by Iron Man and a 3D human capture of one of our friends. It’s a proof of concept so it took us ~3 weeks to hack together with previously built assets but we think it still looks pretty badass.

Our Key Concept Tests:

  • 3D Holographic UI in VR
  • Realistic 3D Scans of people
  • How to port our existing art production pipeline

Also, stay tuned as we’ve bene prepping these last weeks to start publicly sharing a lot of our little experiments we’ve been doing internally over the last 4 months!

Let me know what you guys think in the comments or you can hit me up on twitter (@ikrimae or @knlstudio)

Download Details:


The usual Oculus Rift bindings:

‘W,S’ – Move forward/back
‘A,D’ – Move left/right
‘Q,R’ – Turn the camera left/right

Feel free to share and redistribute, just give us credit. We don’t have a license for all of the content here, so we can’t use our normal license to allow people to remix things but hopefully in the future, we’ll release stuff that others can use.
Creative Commons License
The Cave by Kite & Lightning is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

  1. Reply


    January 30, 2014


  2. Reply

    Jay Weston

    January 30, 2014

    This is now my number 1 favourite Rift Demo – amazing sense of scale, depth, UI, etc. I had an unreal sense of immersion and was unbelievably pissed off I couldn’t drive the car! Can’t wait to see the next demos!

  3. Reply


    January 30, 2014

    WOW, guys. This is unbelievably well done. The zooming effect on the city, then to your character model blows pretty much every other Rift demo I’ve seen out of the water in terms of finesse. The computer console and the way it all follows the motion of your head is near perfect. Really excited to see more of your work!

  4. Reply


    January 31, 2014

    This is hands-down one of the most impressive and unique Rift experiences I’ve seen. The holographics interface is extremely immersive. I can’t wait to see what kinds of new interactive material you guys generate. I’m definitely a customer in waiting.

  5. Reply


    February 3, 2014

    osx pleaseeee!!!!!

    • Reply


      February 3, 2014

      Hey Rami,
      Would you be willing to test for us? Need to see mac performance before we release it out

      • Reply


        February 19, 2014

        I would be interested in testing out a mac build of this.

  6. Reply


    February 3, 2014

    I just made a pretty delighted noise when I saw an interface element I designed jump right into my face. Thanks for buying and using it! And yes, this is hands down my favourite Rift experience, too. I only wish there was more of it.

    • Reply


      February 3, 2014

      The internet’s amazing, isn’t it? Glad you saw this!

  7. Reply


    February 17, 2014

    Great work guys – I’m not able to view this on the Rift at the moment, but lots of what you’re doing looks familiar from my own R&D (a lot more stylish though!). How are you handling the challenge/s of fully animated human ‘actor’ meshes? This is our own (very minor 😉 stumbling block at the moment.

    • Reply


      February 20, 2014

      We’re building out our own pipeline for the facial animation part. It does get a bit tricky but for the rest of the body, we’re using regular skinned meshes.

  8. Reply


    April 23, 2014

    Great job ! OSX pleeeease from France 🙂

  9. Reply


    August 7, 2014

    Have DK2 support ?

    This will be awesome !

  10. Reply


    October 3, 2014

    Hey guys, a heads up that the Dropbox link is not working. Also, as Holblin asked, is this DK2-optimized? Would LOVE to try this out! Senza Peso was incredible.

  11. Reply


    April 14, 2015

    I read that you were going to make this dk2 compatible. Any E.T.A. on that?

  12. Reply

    Patrice Robitaille

    May 24, 2015

    The dropbox link in this article is not longer active. 404 Error.


This site uses Akismet to reduce spam. Learn how your comment data is processed.