A closer look at Apple's new ProRes 422 video format

Posted:
in Mac Software edited January 2014
Going into extreme detail, Apple has said its new HD video standard was designed not just to beat opposing formats but to clear bottlenecks -- some of which are stifling for video editors.



Although it touched on ProRes 422 as part of its Final Cut Studio 2 announcement, Apple later offered a more detailed explanation of why the format was created and its real advantages to film crews.



The software developer observes that one of its key trump cards, compressing full-quality HD to manageable file sizes, isn't new. In fact, the company notes that in some cases the variable bit rate encoding of ProRes -- which tosses away data in simpler frames -- isn't as purely efficient in crunching data as with other standards. The new RED One camera, for example, compresses a 4000-pixel wide or "4K" video image into a 200 megabit per second stream. By contrast, a high-quality 1920x1080 ProRes clip (roughly a quarter the size of the 4K video) is larger at 220Mbps.



But while this fits the storage needs of the camera, the processing overhead required to decode the video during editing can be crushing to all but the best systems -- a problem for video editors who may need to preview one or more clips at once. It leaves little room for adding effects and seldom scales down smoothly.



This is where ProRes 422 excels, says Apple.







Despite compressing HD footage to a size smaller than raw standard definition video, the codec's demands on the CPU and disk speed are light enough that a MacBook Pro can play editing-grade video in full HD resolution. This lets pros test out their editing work in the field without a desktop computer or a large amount of desktop-class storage, either of which can cripple the budget for smaller or already expensive projects.



Those fortunate enough to work at a Mac Pro are poised to see even more of a benefit, Apple boasts. An improved half-resolution decoding method means that Final Cut Pro 6's unlimited real-time preview sees an exponential increase in the number of active previews: where only a single 1080i, 60Hz video would be visible on an eight-core Mac Pro in uncompressed form, the use of ProRes 422's high quality mode allows four. Dropping the quality to 720p at a film-level 24Hz sees the number of streams jump from three to fourteen on the same system and increases further with the normal 145Mbps ProRes bitrate.







And while already impressive to users of Final Cut Pro 5, this performance boost is explicitly adapted to multi-core systems. ProRes is said to scale almost linearly with the number of cores available to process video, cutting the latency in drawing a finished frame in half every time the available processing power doubles.







Recording is also made easier. A Mac Pro with an HD SDI video card, used for capturing live broadcasts, can automatically transform raw HD into a ProRes 422 clip without losing visual data, optionally sending it back to other hardware at the same quality. Since video is recorded at either normal 8-bit or richer 10-bit color depths regardless of the resolution, video producers can get subtler color gradients without moving to a rarer format or consuming more space. Capturing 10-bit isn't even an option for videographers using Panasonic's DVCPRO-50 or Sony's IMX-50 HD video formats, Apple points out.



Finally, the space and workload savings from the format can be applied whether or not the source footage matches: even when editing pure HDV or XDCAM HD, ProRes can be applied solely to effects layered on top of the source for a smaller overall bitrate, a faster render, and to preserve the quality of the underlying video.



The net effect of all these factors is to make HD editing more ubiquitous, according to Apple. With the sharper resolutions filtering down from feature-length movies to live footage, the company believes that the ability to trim videos with less than ideal equipment is increasingly essential -- and, of course, that its own Mac hardware and Final Cut Studio software should be the first to make this a practical reality.
«13

Comments

  • Reply 1 of 46
    bageljoeybageljoey Posts: 2,004member
    Will this help with my Sony HandyCam?
  • Reply 2 of 46
    dp123dp123 Posts: 17member
    Avid has a similar format at the same bitrates, also 4.2.2. It's an open format. The real question is: is ProRes 4.2.2 just the same format in a different container. These details without a comparison to Avid's format, it's closest competitor, is almost irrelevant.



    Yes, it's good to know Apple has their own that they are providing cheaper. But the comparison to DNxHD is what people really want to know.
  • Reply 3 of 46
    hmurchisonhmurchison Posts: 12,419member
    It's funny Apple doesn't mention ProRes 422's handling of 4K in their whitepaper.
  • Reply 4 of 46
    solipsismsolipsism Posts: 25,726member
    How will help those cam versions of newly released movies floating around on torrent sites?
  • Reply 5 of 46
    mugwumpmugwump Posts: 233member
    Question: How does this codec compare to uncompressed footage? Is it truly "lossless"?
  • Reply 6 of 46
    Quote:
    Originally Posted by mugwump View Post


    Question: How does this codec compare to uncompressed footage? Is it truly "lossless"?



    Does it say anywhere thats its a lossless codec?

    Why are people assuming thats its lossless



    plus lossless is lossless. there isn't anything like "truly" lossless.

    Is a Supersonic Jet truly Supersonic.
  • Reply 7 of 46
    jeffdmjeffdm Posts: 12,951member
    Quote:
    Originally Posted by hmurchison View Post


    It's funny Apple doesn't mention ProRes 422's handling of 4K in their whitepaper.



    I couldn't open that whitepaper, the site just gives me a very fancy version of a 404.



    I can't find anything anywhere on Apple's site that says that they support 4k at all. There is one booth at the Apple exhibit that says something to the effect of "2k Red ProRes 422". If FCS2 can do 4k, I don't understand why they wouldn't mention that somewhere.
  • Reply 8 of 46
    melgrossmelgross Posts: 33,510member
    Quote:
    Originally Posted by mugwump View Post


    Question: How does this codec compare to uncompressed footage? Is it truly "lossless"?



    No, it's not lossless.



    Quote:

    the company notes that in some cases the variable bit rate encoding of ProRes -- which tosses away data in simpler frames --



  • Reply 9 of 46
    paprochypaprochy Posts: 129member
    Quote:
    Originally Posted by MySchizoBuddy View Post


    Does it say anywhere thats its a lossless codec?

    Why are people assuming thats its lossless



    plus lossless is lossless. there isn't anything like "truly" lossless.

    Is a Supersonic Jet truly Supersonic.



    Yes and Yes.



    It means what it says. A supersonic jet, really is supersonic, in other words, it flies faster than the speed of sound.



    Lossless compression is just that, something that compresses an image without destroying any image data. For example LZW compression in TIFF, it shrinks the filesize but no essential data about the image is lost leaving the image looking exactly as it did when it was RAW or Vector.



    I'm not saying that ProRes422 is lossless. I just don't agree with your analogy. Makes no sense.
  • Reply 10 of 46
    eckingecking Posts: 1,588member
    This has me drooling but I personally don't need it! lol
  • Reply 11 of 46
    chuckerchucker Posts: 5,089member
    Quote:
    Originally Posted by ecking View Post


    This has me drooling but I personally don't need it! lol



    LAWL!
  • Reply 12 of 46
    chuckerchucker Posts: 5,089member
    Quote:
    Originally Posted by MySchizoBuddy View Post


    plus lossless is lossless. there isn't anything like "truly" lossless.



    The distinction between lossless compression and lossy compression is actually very clear, unambiguous and simple.



    If you take uncompressed data (e.g., TIFF, WAV, AIFF), compress it losslessly (e.g., PNG, TIFF-LZW, AIFC, ALAC, FLAC), then decompress it again, the image/audio data will be 100% perfectly identical to the original data.



    If you, however, use a lossy compression (e.g., JPEG, HD Photo, MP3, AAC, WMA), then decompress, the data will be significantly different. Most parts taken out won't be as noticeable to us humans, but the differences are measurable, and worse, each successive conversion loses you even more data.
  • Reply 13 of 46
    palegolaspalegolas Posts: 1,361member
    Quote:
    Originally Posted by Chucker View Post


    ... If you, however, use a lossy compression (e.g., JPEG, HD Photo, MP3, AAC, WMA), then decompress, the data will be significantly different. Most parts taken out won't be as noticeable to us humans, but the differences are measurable, and worse, each successive conversion loses you even more data.



    The problem is that if you want to do color adjustments (levels, curves, contrast, color balance etc) on compressed material most of the time you will spot the compression straight away. Brightening up a dark area that is compressed surely brings up visible compression artefacts. But doing the same on uncompressed material could provide a good result, depending on the source of the footage. Of course the best would be to have RAW footage or 16 bit footage. I don't even know if that's available. But refining a RAW still photo is like magic compared to refining a high quality TIFF image.



    I usually work with 95% compressed Photo JPEG codec though. I think it's good enough. The fixed bit rate codecs usually doesn't cut it for me since I'm most of the time working with drawn animation.. I'm excited that ProRes is VBR.



    But people and insiders and sources.. WE NEED PICTURES OF PRORES, not specs.. Anyone could present specs, but if it doesn't look and perform good (like Pixlet.. horrible horrible Pixlet) then it's just bogus.
  • Reply 14 of 46
    MacProMacPro Posts: 19,718member
    I wonder if Apple have any new streaming capabilities up their sleeves or can 422 encoded material be used for that also? Is this in any way a replacement for H.264? We all know iTunes has to start offering at least 720p one day soon and ideally be watchable as it downloads on a modern broadband connection.
  • Reply 15 of 46
    MacProMacPro Posts: 19,718member
    Quote:
    Originally Posted by palegolas View Post


    The problem is that if you want to do color adjustments (levels, curves, contrast, color balance etc) on compressed material most of the time you will spot the compression straight away. Brightening up a dark area that is compressed surely brings up visible compression artefacts. But doing the same on uncompressed material could provide a good result, depending on the source of the footage. Of course the best would be to have RAW footage or 16 bit footage. I don't even know if that's available. But refining a RAW still photo is like magic compared to refining a high quality TIFF image.



    I usually work with 95% compressed Photo JPEG codec though. I think it's good enough. The fixed bit rate codecs usually doesn't cut it for me since I'm most of the time working with drawn animation.. I'm excited that ProRes is VBR.



    But people and insiders and sources.. WE NEED PICTURES OF PRORES, not specs.. Anyone could present specs, but if it doesn't look and perform good (like Pixlet.. horrible horrible Pixlet) then it's just bogus.



    Given RED are on board with 422 at 4K and with the new Color application in FCPro Suite too, I have to believe Apple know what they are doing regarding your concerns and it is going to blow our socks off. Think about this, it is only a very short while ago experts discussed the merits of high end BetaCam SP or DigiBeta and all that at 640 x 480 We have come a long way in a very short time ... what a ride !
  • Reply 16 of 46
    aplnubaplnub Posts: 2,605member
    Sounds to me that Apple is nipping at the heels of AVID for more and more market share. Editing on a MBP sounds very tempting for those in-the-field shots 30 miles from no-wheresville Canada.



    Probably not any real innovation here, as mentioned above, more just about making progress toward bettering the video editing process at a way cheaper cost. That has to get a few people's attention.
  • Reply 17 of 46
    vinney57vinney57 Posts: 1,162member
    ProRes422 is 'visually lossless'. Which basically means you can't see any difference when using the HQ (10 bit) codec. It remains to be seen what this means in practice but there wouldn't be a lot of point if it didn't work. Its clear that it is to be used through the entire VFX and colour timing chain and then converted, if required, back to 10bit HD via software or hardware (AJA).



    Apple mentioned 4k but didn't push it for a number of reasons. I suspect support at this time is minimal and that frankly nobody is actually asking for it. Its a necessary buzzword but its not a real requirement just yet. I know 'Color' doesn't support 4K and Motion 3 probably doesn't either.



    There is a misconception about the RED compression. RED have achieved great compression ratios (Graham Natrass is a genius) because they are using wavelet compression on the RAW info from their Bayer style chip. This data is not usable in this form, it has to be converted to another format (any QT codec) using the software that they supply. Apple are going to be offering a native REDCODE codec (real time RED RAW Bayer de-mosaicing) for Final Cut Pro but it is not ready yet, and I suspect that this was the only justification the Apple had for mentioning 4k at all! There are no 4k monitors and only one projector (Sony).



    When all those RED cameras hit the streets over the next year, 4k RAW compressed will be an ideal acquisition and archive format with 2k being an excellent and practical desktop workflow.
  • Reply 18 of 46
    pascal007pascal007 Posts: 118member
    Quote:
    Originally Posted by palegolas View Post


    But people and insiders and sources.. WE NEED PICTURES OF PRORES, not specs.. Anyone could present specs, but if it doesn't look and perform good (like Pixlet.. horrible horrible Pixlet) then it's just bogus.



    That's interesting. I thought about Pixlet when Apple presented ProRes 422 and I kept wondering why didn't Pixlet take off. When it was presented, Pixlet was supposed to be so promising... For some reason, it probably wasn't, but I don't have the expertise to understand why.



    Would you care to expand on what made Pixlet so horrible ?
  • Reply 19 of 46
    palegolaspalegolas Posts: 1,361member
    Quote:
    Originally Posted by Pascal007 View Post


    That's interesting. I thought about Pixlet when Apple presented ProRes 422 and I kept wondering why didn't Pixlet take off. When it was presented, Pixlet was supposed to be so promising... For some reason, it probably wasn't, but I don't have the expertise to understand why.



    Would you care to expand on what made Pixlet so horrible ?



    Horrible Pixlet was my initial reaction.. perhaps I should have just put it disappointing Pixlet, or Pixlet the sad story.



    Pixlet was presented somewhat like ProRes, like "The codec that provides studio grade HD quality at SD bitrates" or something like that. But it didn't. The advantage over JPEG compression is that it preserves dark and bright colors much better, I give them that. But they should never have released it. Should have kept working on it until they reached ProRes (supposing ProRes is good.) They really never followed up on Pixlet. I know updating a codec isn't a good idea, but I actually was waiting for them to update it, since it was only available for QuickTime users anyway.



    Pixlet is too CPU heavy. Just impossible to work in realtime with Pixlet. And then it uses a strange compression method that has especially animation look pretty bad around lines and areas with high contrasts. It almost looks like bulky plastic around the edges. Strange. It is possible to select compression level, but as soon as you go below 100% the "bulky plastic" effect takes off. And if you're using 100% it looks good on photographic material, regular filmed material, but you could as well reduce the CPU usage with 75% and cut the bitrate nearly in half with kind of the same result with the Photo JPEG codec.



    I tested a lot of codecs when Pixlet was launched. Tested it for HD editing with bitrate, quality and usability in mind. I thought that if JPEG 2000 wasn't so heavy on the processor it would have been the best choise (supporting alpha and low bitrate with very good color and picture quality and all), but it always comes down to the regular Photo JPEG codec. High hopes for ProRes 422 to be what Pixlet should have been.
  • Reply 20 of 46
    I'm wondering how long it will take to see this technology integrated into a consumer device such as the Apple TV. Live HD Recording and compression, seems good to me!
Sign In or Register to comment.