Facebook studying AI that opens closed eyes in photos

Kyle Chua

This is AI generated summarization, which may have errors. For context, always refer to the full article.

Facebook studying AI that opens closed eyes in photos
The AI uses photos of a person found in Facebook as reference to replace closed eyes with open ones

MANILA, Philippines – Have you ever spotted yourself with your eyes closed having been caught mid-blink in group photos posted on social media? Facebook’s new AI research may just have the eye-opening solution to this problem.

While the dawn of Photoshop has provided users with tools to enhance or edit out undesirable features, the complex details of human eyes have always been difficult to change realistically.

What Facebook does is use a Generative Adversarial Network (GAN), a machine learning system comprised of two neural networks that “contend” with each other. What this essentially means is that one part of the system recognizes faces while the other replicates the image based on what was recognized, drawing from a huge database of people’s photos.

Facebook’s researchers uses countless photos of people with eyes both opened and closed uploaded in their platform as reference data for the GAN system. This allows the GAN to learn what eyes should go on what person including its shape, color, and other subtle details.

The results were reportedly realistic enough to fool the people they showed it to. Supposedly, there are no signs of stitching or color mismatch for the person’s skin. See for yourself:

COMPARISONS. Shown are comparisons between the commercial state of the
art eye opening algorithm in Adobe Photoshop Elements (column C) and Facebook's proposed ExGAN technique (column D). The original images are shown in columns A and B. Photo from Facebook

It still fails in some situations when a person’s eyes are partially covered by hair or other objects but, these problems are said to be fixable.

This tool once fully developed should make it easy for people to fix photos where they were snapped blinking, saving them the time and effort from using more complicated editing software programs. – Rappler.com

Add a comment

Sort by

There are no comments yet. Add your comment to start the conversation.

Summarize this article with AI

How does this make you feel?

Loading
Download the Rappler App!