Apple Shares Behind the Scenes Look at How the Portrait Lighting Feature Was Created

Apple this evening uploaded a new "Portrait Lighting" video to its YouTube channel, which is designed to give a behind the scenes look at how the Portrait Lighting effects on the iPhone X were created.

Take a look behind the iPhone X and discover the process we went through to create Portrait Lighting. Combining timeless lighting principles with advanced machine learning, we created an iPhone that takes studio-quality portraits without the studio.
In the video, Apple explains that it worked with global image makers and some of the world's best photographers to combine timeless lighting principles with machine learning techniques.

The result was the Portrait Lighting feature available in Portrait Mode on the iPhone X and the iPhone 8 Plus. On iPhone X, Portrait Lighting is available for both the front and rear facing cameras thanks to the TrueDepth camera system, while on iPhone 8 Plus, it's available for shots captured with the rear camera.

Apple's Portrait Lighting feature is designed to use sophisticated algorithms to calculate how your facial features interact with light, creating unique lighting effects.

There are several Portrait mode lighting presets, including Natural Light, Studio Light (lights up your face), Contour Light (adds dramatic shadows), Stage Light (spotlights your face against a dark background), and Stage Light Mono (Stage Light, but in black and white).

Apple has also highlighted Portrait Lighting in several past video ads showing off iPhone X features.

Related Roundup: iPhone X
Buyer's Guide: iPhone X (Buy Now)

Discuss this article in our forums

Apple Studied Paintings and Shined Light on People to Perfect New Portrait Lighting Feature

iPhone 8 Plus and iPhone X feature advanced cameras with a new Portrait Lighting feature that uses sophisticated algorithms to calculate how your facial features interact with light. That data is used to create lighting effects, such as Natural Light, Studio Light, Contour Light, and Stage Light.

In a new interview with BuzzFeed News reporter John Paczkowski, Apple says it studied the work of portrait photographers such as Richard Avedon, Annie Leibovitz, and Johannes Vermeer, a seventeenth-century Dutch painter, to learn how others have used lighting throughout history.

"We didn't just study portrait photography. We went all the way back to paint," said Apple's marketing chief Phil Schiller.

"If you look at the Dutch Masters and compare them to the paintings that were being done in Asia, stylistically they're different," said Johnnie Manzari, a designer on Apple's Human Interface Team. "So we asked why are they different? And what elements of those styles can we recreate with software?"

Apple said it took what it learned, went into its studio, and spent countless hours shining light on people from different angles.

"We spent a lot of time shining light on people and moving them around — a lot of time," Manzari added. "We had some engineers trying to understand the contours of a face and how we could apply lighting to them through software, and we had other silicon engineers just working to make the process super-fast. We really did a lot of work."

Schiller acknowledged that Apple aims to make a professional camera, ranked the best among smartphones in a recent review, but he added that the company also cares about what it can contribute to photography as a whole.

"We're in a time where the greatest advances in camera technology are happening as much in the software as in the hardware," Schiller said. "And that obviously plays to Apple's strengths over traditional camera companies."

Apple's software advancements allow anyone to simply pick up an iPhone and capture a high-quality photo, eliminating the learning curve that can come with a high-end DSLR camera from the likes of Canon or Nikon.

"It's all seamless; the camera just does what it needs to," said Schiller. "The software knows how to take care of it for you. There are no settings."

Both the iPhone 8 Plus and iPhone X rear cameras been advanced with larger, faster dual-lens sensors, new color filters, and deeper pixels. iPhone X also has optical image stabilization for both the wide-angle and telephoto lenses, the latter of which has a larger ƒ/2.4 aperture that lets more light in.

Read More: How Apple Built An iPhone Camera That Makes Everyone A Professional Photographer

Discuss this article in our forums