iPhone 7 and Apple's next Retina Display frontier: Wide Color

Posted:
in iPhone edited July 2016
In 2010, Steve Jobs introduced a new leap forward in display resolution for iPhone 4 that passed up the rest of the industry to deliver pixels virtually invisible to the human eye. For iPhone 7, Apple appears to be making a similar leap in the realm of "Retina Color."

Wide Color
Without a Wide Color display, this box only appears to be solid orange


Apple's new work on Wide Color results in lush, vibrant greens and vivid reds that today's basic screens can't even reproduce. After seeing Wide Color at work--it's currently available on new iMacs and the newest 9.7 inch iPad Pro--regular displays look flat and lifeless in comparison, much the same way that iPhone 4's debut of the Retina Display created a new "no going back" milestone in users' expectations for modern mobile electronics.

The image above, created by Apple's WebKit team, appears to be just an orange square on standard RGB displays. However, from a device capable of supporting the DCI-P3 Wide Color Gamut, you can see a logo. The before and after display of Wide Color images is even more impressive when viewing vibrant landscape images.

This year, it appears Apple is set to again change expectations in the realm of the colors that users see--and can capture--every day on their iPhones, despite very little being talked about color accuracy and reproduction among mobile device vendors outside of Apple.

It is, however, an emerging focus among HDTV vendors, who see Wide Color as an essential component of High Dynamic Range TVs. Wide Color not just a hardware issue; it connects to production, distribution and capture.

In the realm of TV, Wide Color is an industry effort. On mobile devices, it will require integration between software developers and hardware makers. The fact that Apple has already introduced Macs and iPads supporting Wide Color underlines its unique ability to deliver new technology in ways that matter, something that broadly licensed platforms--particularly value engineered platforms like Google's Android--have struggled with.


Wide Color is part of what TV vendors are branding as "High Dynamic Range"


This all happened before



Prior to Jobs' launch of iPhone 4, a variety of Android phones--such as the Motorola Atrix--were already being hyped for introducing higher resolution screens: the Atrix boasted 960x540 pixels versus the original iPhone's 480x320.

There was some fudging involved to achieve that higher resolution: the Atrix and other 2010-era Androids commonly used PenTile AMOLED, a cheaper display technology that claimed a high pixel resolution despite actually supplying a third less sub pixels (by arranging more greens and fewer reds and blues). As a result, reviews described Motorola's Atrix as having "inaccurate colors and poor viewing angles, not to mention practically unreadable text at its furthest zoom."

Additionally, rather than using the extra resolution to enhance the quality of the display, Android makers simply followed what PC makers had been doing with extra pixels: stretching out the 'desktop' to expand across a larger display, or scaling down the UI to fit more content on the same screen.

On PCs, higher resolution displays had typically been tied to the advancement of incrementally larger PC monitors. On mobile devices however, adding more pixels tied to a larger screen were resulting in bigger phones--with obvious disadvantages. Further, higher resolutions were also making tap targets smaller and scaling down text to the point where it became more difficult to read.Apple's iPhone 4 Retina Display harnessed technical progress in a new direction

Apple's iPhone 4 Retina Display harnessed technical progress in a new direction: it kept the user interface at the same scale and increased the pixel count four-fold, resulting in very crisp text and precise detail of everything on the screen, rendering pixels virtually invisible.

In hindsight, Apple's strategy for resolution leap was obvious. However, it wasn't immediately copied. Samsung's original Galaxy Note "fablet" debuted a year after iPhone 4, but rather than similarly introducing a high quality, retina-like display, it continued to use a subpixel-fudging, cost-effective PenTile screen on a larger device, hoping users would be impressed with pixel numbers rather than caring about how pixels or color on the screen actually looked.

As Rasmus Larsen noted at the time for FlatPanelsHD, "a PenTile OLED panel was recently introduced with the Samsung Galaxy Note, and we were not impressed. In real world PenTile means loss of details and sharpness, as well as a bluish/greenish tint around letters (depending on the background color)."

The site also called out Google's Samsung-built Galaxy Nexus, noting that "the HD Super AMOLED display in the new Galaxy Nexus is not as awesome as it sounds--unfortunately. And the reason that people do not call it a Retina Display should seem much more obvious to you now that you know the underlying technical architecture."

In the years since, Apple brought its Retina Display to iPad and to its Mac lineup. TV makers have similarly advanced HDTV sets to support "4K," making their displays four fold sharper in pixels rather than just larger. And of course, the smartphone industry now generally follows Apple in making sharper, not just larger, displays as well.

Wide Color: the new Retina Display of gamut



Once iPhone pixel density achieved Retina Display status, Apple didn't change it again until it introduced larger screen sizes. As Android vendors have learned the hard way, arbitrarily squeezing in "even more pixels" just for bragging rights results in a new problem: a huge increase in display processing tasks that slows everything down.

While iPhone 4's Retina Display involved less than a half million pixels, today's largest iPhone 6/6s Plus has to wrangle over 2 million pixels. Higher end Androids--such as Samsung's Galaxy line--pack in nearly 3.7 million pixels into a similar screen size, but have historically opted to use a less powerful Application Processor, resulting in poor performance.

Rather than following Samsung in an underpowered, overspecced resolution numbers race, Apple has been working to improve future displays in ways that will actually matter to its users. One primary result is Wide Color, a new initiative to expand the color gamut of the display to cover more of visible color spectrum captured by digital cameras.

That not only requires new display hardware, but also requires sophisticated color management software. Apple first delivered Wide Color support in the 5K iMac. This year, it expanded support to the new 9.7 inch iPad Pro.


iPad Pro


Apple's new support for the DCI-P3 Wide Color Gamut results in an expanded ability to reproduce more accurate color than the existing "Standard RGB" can. The prevailing sRGB can't reproduce the most vibrant, vivid colors we can see. Interestingly, many cameras capture RAW color data that simply doesn't show up on today's sRGB displays.

The work Apple has done to support Wide Color in both hardware and software on its 5K iMac is really an expansion of its ColorSync color management software that already existed on Macs.

However, bringing Wide Color to iPad Pro involved creating new software support for advanced color management in iOS, with backward compatibility to enable the existing library of App Store titles to continue to work, and new frameworks for developers to adopt to work with new 16-bit per color, Wide Color images.

The result of Apple's work on Wide Color on iPad Pro was hailed by Ray Soneira of DisplayMate back in March. He described it as offering the highest absolute color accuracy, the lowest screen reflectance for any mobile display, the highest peak brightness for any full-size tablet for any picture level, the highest contrast rating in ambient light and the smallest color variation with viewing angle.

Soneira was impressed enough to predict that Apple could implement the same Wide Color gamut and anti-reflection coating of iPad Pro on iPhone 7, noting that this would improve its screen performance and readability in bright ambient light.

iPhone 7 display: True Tone & Wide Color



Apple pretty obviously didn't complete all its work on Wide Color just for one new model of iPad. Bringing support for Wide Color to iOS involved changes to UIKit, Core Animation, Core Graphics, Core Image, ImageIO, SceneKit, SpriteKit and WebKit--a major undertaking spanning much of the company's software groups.

Given the attention Apple devoted to Wide Color at WWDC, it seems quite clear that Apple will also bring Wide Color, and likely a True Tone display (like the new iPad Pro, below), to iPhone 7, resulting in more vibrant and accurate color display--in apps, on the web, and even for users' existing photos--that buyers will consider a significant advance and a reason for upgrading.


True Tone display on the new iPad Pro


Both True Tone and Wide Color require extensive hardware and software integration to work. Like support for Retina Display, it also requires some attention from third party developers to make sure that the new changes are supported in their apps. That indicates that Google and its hardware partners will have a difficult path ahead in trying to close the color gap.

Thinking outside the dots



Today, Android phone vendors hoping to stand out in a crowded market face a number of issues. Phone fragmentation--often related to the use of cheapest possible components--results in compatibility problems and makes it more difficult for Google, its hardware partners and mobile carriers to roll out new features or patch existing flaws.

As noted by Phil Nickinson of Android Central, Samsung's Galaxy S7--often talked about in the media as the equivalent to Apple's iPhone 6s--is actually a brand name applied to "31 separate versions of the Galaxy S7" that Samsung sells worldwide. Nickinson was writing about Android phone compatibility with Android Auto, Google's version of CarPlay; regarding the 31 slightly different Galaxy S7 models, he noted that "Some work. And some don't."

#CarPlay vs AAuto: "there are 31 separate versions of the Samsung Galaxy S7 (worldwide). Some work. And some don't" https://t.co/nqZ7c6BBGu

-- Daniel Eran Dilger (@DanielEran)


Samsung has also focused its attention on selling waterproofing claims that literally don't hold water. Joanna Stern of the Wall Street Journal attempted to carry that water herself in a piece that recommended phone buyers hold off on iPhones but not wait for a new Galaxy S7, specifically citing "waterproofing" as a key reason for buying a high end Samsung.

However, both Square Trade and Consumer Reports have called out Samsung for inflating its claims of water resistance after testing multiple Galaxy S7 models that all failed to actually survive the dunk tank.

Apple's ability to introduce finished technologies that work as advertised and meaningfully improve users' experience is also assisted by its global network of retail stores, where users can experience leaps like 2010's Retina Display--and this year's leap to Wide Color--for themselves.
«134

Comments

  • Reply 1 of 64
    ...am I the only one who sees that box as being red? Viewing it on my iPhone 6...
    redraider11andrewj5790jay-tlostkiwi1983calitopper24hoursbdkennedy1002rhoninAvieshek
  • Reply 2 of 64
    fastasleepfastasleep Posts: 2,419member
    ...am I the only one who sees that box as being red? Viewing it on my iPhone 6...
    It's blue.
    baconstangSpamSandwichfotoformatJanNLnetmagemike1pscooter63jackansiAvieshek
  • Reply 3 of 64
    ...am I the only one who sees that box as being red? Viewing it on my iPhone 6...
    I, too, see it as red on both my iPhone 6s and iPad Pro (9.7). 

    As the article pointed out, I am able to see the logo on my iPad.
    williamlondonindyfxmike1topper24hours
  • Reply 4 of 64
    I could not see the logo with the default "iMac" Display profile on my late 2014 5K iMac. Several other profiles revealed the logo. I left it on "Display P3" for now.
  • Reply 5 of 64
    netroxnetrox Posts: 706member
    I am seeing red box too... not orange.
    jay-tSpamSandwichDeelroncalitopper24hoursrhoninjackansiAvieshek
  • Reply 6 of 64
    SidneyDSidneyD Posts: 1member
    Red, not orange! Interesting to see the logo on my iPad, though. 
    lostkiwiwilliamlondoncalitopper24hours
  • Reply 7 of 64
    mac_128mac_128 Posts: 3,376member
    SidneyD said:
    Red, not orange! Interesting to see the logo on my iPad, though. 
    I see a red box with a logo on my iPad 3!! Can't really say I get what's so special about this? 

    The color red is more of a bright fire engine red which tends toward orange, but not that I would call orange per se. 
  • Reply 8 of 64
    netroxnetrox Posts: 706member
    Honestly, I evaluated the color differences on iMac 5K with P3 on and I can see the logo... and the color difference seems to be just a matter of tweaking the image to have higher saturation. I don't even find them appealing - looks a bit artificial to me, especially the oranges and reds. They look over-saturated.
  • Reply 9 of 64
    Why is it that there are two different variations of that box? I see both a solid red  box and the one with a logo, hued in a deeper red. (Viewed on an iPhone 6).
    edited July 2016
  • Reply 10 of 64
    EsquireCatsEsquireCats Posts: 484member
    Depending on your display and settings you will get different results for what you see. The image is a 16-bit per channel RGB (PNG format image.) I tend to dislike this approach as a gradient shows the differences better.
  • Reply 11 of 64
    baconstangbaconstang Posts: 536member
    On my '15 5K, the box looks pretty red with the "iMac" or "Display P3" profiles and no logo.
    The "Wide Gamut" profile makes it much more orange and the logo appears.  Although my "Abstract" desktop looks much flatter and not as vibrant.
    I'll go look at some photos.
  • Reply 12 of 64
    foggyhillfoggyhill Posts: 4,767member
    My Samsung note 3 from 2013 displays the logo just fine. Really love the new things apple is working on! 
    Accuracy is important too BUD; or didn't you read about that too.
    Samsung phones, especially 2013, are wildly inaccurate essentially in their wide gamut OLED state.
    lostkiwiDeelronbaconstangcaliargonaut
  • Reply 13 of 64



    True Tone display on the new iPad Pro

    I love how the True Tone display affects the color of the case too.
    iqatedoargonautAvieshek
  • Reply 14 of 64
    foggyhillfoggyhill Posts: 4,767member



    True Tone display on the new iPad Pro

    I love how the True Tone display affects the color of the case too.
    It's the ambient lighting that changes from bluish too yellowish, that changes the color of the case, a change that the camera should capture correctly if its white point is correctly calibrated.
    baconstang1983caliericthehalfbeeEsquireCatsnetmagetopper24hoursnolamacguypscooter63palomine
  • Reply 15 of 64
    twoslicktwoslick Posts: 17member
    Windows 10 with Chrome on a Dell U2410 monitor: I can see the logo. Switch to IE, and no logo.
  • Reply 16 of 64
    k2kwk2kw Posts: 1,648member
    ...am I the only one who sees that box as being red? Viewing it on my iPhone 6...

    Seriously it does sound like wonderful technology, but it also sounds like a hard technology to communicate the difference unless someone sees it in person.

    Hopefully the iP7 will have several upgrades like this.    Apple had an 8 MP camera for many years when other's had higher resolution, but Apple always had good reviews for its quality because they continually improved it.

    It does makes me wonder when they will increase the resolution of their screen though.   Could be 2018 when the iP8 comes out?


  • Reply 17 of 64
    foggyhillfoggyhill Posts: 4,767member
    Duub said:
    My Samsung note 3 from 2013 displays the logo just fine. Really love the new things apple is working on! 
    The logo shows up perfectly clear on my Note 2 - coming up on 4 years old this autumn.
    The large gamut of OLED would show it, DOESN:T MEAN YOUR SEEING THE RIGHT COLORS, THE RIGHT INTENSITY, ETC.

    Did you just register to say this crap?
    jamieaDeelronbaconstang1983williamlondoncaliericthehalfbeenetmagepscooter63Dan Andersen
  • Reply 18 of 64
    foggyhillfoggyhill Posts: 4,767member
    k2kw said:
    ...am I the only one who sees that box as being red? Viewing it on my iPhone 6...

    Seriously it does sound like wonderful technology, but it also sounds like a hard technology to communicate the difference unless someone sees it in person.

    Hopefully the iP7 will have several upgrades like this.    Apple had an 8 MP camera for many years when other's had higher resolution, but Apple always had good reviews for its quality because they continually improved it.

    It does makes me wonder when they will increase the resolution of their screen though.   Could be 2018 when the iP8 comes out?


    There is very little to gain in increasing resolution on the 6s+  (most lab tests on resolution and eyesight are done with static white on black printed material under good lighting, which has near infinite contrast). That's a very far cry from what any phone screen is capable of.
    The S7 has a barely higher rez once you factor pentile. The A10 could surely go higher, but to what end? You get a slightly better static diagonals on black on white material if you get to 500ppi, anything that moves probably doesn't need a higher resolution than 400ppi, but a higher refresh rate would be great.
    The 6s probably should get a higher resolution. The problem here is the fear of fragmentation from Apple. Making their life complicated impacts the ecosystem and it is one of Apple's main advantage.
    baconstang
  • Reply 19 of 64


    OK, something must be up with that square image, it's pretty disheartening.

    I can see it on both my Galaxy devices but not on my iPhones.

    From left to right: Galaxy S5, S4, iPhone 5c, iPhone 6.

    Hmm, maybe this has to do with OLED displays.
    edited July 2016 singularityrevenantrhoninjackansi
  • Reply 20 of 64
    foggyhill said:
    Duub said:
    The logo shows up perfectly clear on my Note 2 - coming up on 4 years old this autumn.
    The large gamut of OLED would show it, DOESN:T MEAN YOUR SEEING THE RIGHT COLORS, THE RIGHT INTENSITY, ETC.

    Did you just register to say this crap?

    No but it's a valid point to bring it up since the image is used as an example.

    Calm down, btw.
    edited July 2016 iqatedorevenantrhoninargonaut
Sign In or Register to comment.