When Facebook’s chief technology officer Mike Schroepfer took the stage at the Web Summit technology conference in Lisbon on Tuesday showing off a way to put filters over videos, you’d be forgiven for thinking it’s a minor product update.
But Schroepfer’s demonstration was actually a way to show the social media giant’s breakthrough in technology.
The “style transfer” feature allows you to stylize videos to look like Van Gogh paintings. Traditionally this would be difficult, requiring both that the video to be sent to data centers for processing and a fast internet connection. It would also have a slight lag.
But Facebook has managed to pack AI into its app, which allows people to add filters to their videos in real-time, meaning that computing tasks that once required large data centers can now be done on the mobile device.
“This is one application of AI on the device, it’s one of the first. But the real breakthrough here is being able to train and build models on a big server…and deploy them directly to your pocket so you can run them in real time wherever you are. That is the exciting future of AI,” Schroepfer said during a keynote speech.
This so-called “deep learning” system is called Caffe2Go, and it is what makes stylized videos in the app possible.
“By condensing the size of the AI model used to process images and videos by 100x, we’re able to run various deep neural networks with high efficiency on both iOS and Android,” Facebook wrote in a blog post.
You can read the other half of the article on CNBC here: http://cnb.cx/2fBKvKO