Live 3D Concerts and Sports?

SpamSandwichSpamSandwich
Posted:
in General Discussion edited January 2014
I predict within just a few years: Live 3D narrowcasts (to movie theaters equpped with 3D projectors and glasses) of special concerts, sporting events and even corporate meetings for companies who can afford it.



http://news.cnet.com/8301-10784_3-99...l?tag=nefd.top

Comments

  • Reply 1 of 2
    nvidia2008nvidia2008 Posts: 9,262member
    Nice. I was thinking about this, when watching Champions League Final football (soccer) (poor Chelsea...) ...



    Let's take it to the next level. 3D glasses, scenes, etc. very good. But I'm thinking, I want realtime 3D motion capture and texturing.



    Imagine at any point in a live or replayed game, you can change the angle as you want to, fly through from the ball out wide to the sidelines.



    This involves realtime terabyte-level motion capture, realtime and cached 3D texture sampling, and a very very high polygon count and radiosity rendering to recreate in real-time the whole stadium down to centimetre-level detail. ... 2015, I would say... Speed Racer, Matrix Trilogy, etc. Think photogrammetry in real-time and recreated on a 2D, 3D or holographic display/ surface.



    So kinda like photogrammetry, LIDAR-esque stuff and motion capture all at exceedingly high resolutions and virtually zero latency.



    http://en.wikipedia.org/wiki/Photogrammetry

    http://en.wikipedia.org/wiki/BUF_Compagnie
  • Reply 2 of 2
    nvidia2008nvidia2008 Posts: 9,262member
    We should be able to do this in a few years with a sport on a fairly small playing field. Tennis would be interesting, but football being the world's sport (soccer to some)... that's a good start.



    The players, (at least 22)(also consider the substitutes) of them, should be a start. As they enter the pitch, they walk through a tunnel. The tunnel actually scans and caches all their textures (face, skin, hair, clothing, boots). Also does some motion analysis. Also, of course, recreates them in super-high-poly-count. It doesn't have to do all this from scratch, it can check the player database and previous captures to compare, refine, and add.



    So then we can re-create all players on the pitch in full 3D. Much like PS3, etc.



    However, the advancement is this: the players are re-textured at several points in the game. For example, a player may spend a few days in a studio to be "captured" for a computer game. I'm talking in 5 years, getting this down to 5 seconds as they walk through a "tunnel" going up to the pitch. So that day, if they had a scar on their cheek, you can see it in the recreated 3D scene.



    Next: real-time motion capture. This is more tricky. Current motion capture involves white ping pong balls attached to suits, etc. A lot of animation cleanup sometimes... though, of course, I am no expert in these areas, just a pundit.



    What we would need, is to advance this to, say, combining all the HD image data from the broadcast TV cameras around the pitch, plus some key HD visual/ infrared/ laser/ etc. cameras around the pitch, so that real-time motion capture of the players, as they are, playing, etc.



    That means if Carlos Tevez does a bicycle kick, with virtually zero latency this is recreated with great motion and polygon accuracy.



    I found this Pele one:





    Imagine this in realtime 3D motion capture without any suits, ping pong balls, etc.



    This will truly make even 1080 60p sports broadcasts look like what black-and-white film looks like to us now.



    Edit: see this link on FIFA Street by EA:

    http://blogs.ign.com/EA-FIFA-Street/2008/01/



    So I'm talking this, real-time during a real competition on a real football pitch.
Sign In or Register to comment.