Facebook's artificial intelligence learns to see thanks to Instagram hashtags

MANILA, Philppines – Facebook on Wednesday, May 2, disclosed an artificial intelligence (AI) experiment that used Instagram to augment the machine learning algorithms. The effort into artificial intelligence training was revealed on the second day of Facebook's F8 Conference.

Facebook director of AI and machine learning Srinivas Narayanan said the company built a scalable system that used 3.5 billion public Instagram photos in thousands of hashtagged categories to improve the machine learning algorithm's ability to categorize images for itself. 

Wired, in its report, added the artificial intelligence training which used 3.5 billion Instagram photos took over the processing power of 336 high-powered graphics processors across 42 servers for 3 weeks. 

The AI, or at least a version of the AI that was trained on 1 billion images, set a new record in a test called ImageNet.

TOPPING IMAGENET. Srinivas Narayanan, Facebook's director of AI and machine learning, explains how Facebook's AI topped a image recognition and categorization test. Screenshot from Facebook livestream.

TOPPING IMAGENET. Srinivas Narayanan, Facebook's director of AI and machine learning, explains how Facebook's AI topped a image recognition and categorization test. Screenshot from Facebook livestream.

The ImageNet test tasks software to assign photos to 1,000 categories, and according to Facebook, the algorithms which learned from 1 billion instagram photos correctly identified 85.4% of the photos, topping the test. Google's closest score so far is at 83.1%.

Facebook said the system they used to train artificial intelligence using Instagram data can be adapted to address other problems.

According to Wired's report, Manohar Paluri, who leads Facebook’s applied computer vision group, said it could be used to identify objectionable or illegal content or describe images to people who are visually impaired.  Rappler.com

 

Victor Barreiro Jr.

Victor Barreiro Jr is part of Rappler's Central Desk. An avid patron of role-playing games and science fiction and fantasy shows, he also yearns to do good in the world, and hopes his work with Rappler helps to increase the good that's out there.

image