Skip to footer

Facebook unveils AI-powered feature to help the blind use its site

The social media giant is advancing its algorithms with face recognition text-to-audio software.

|
Eric Risberg/AP
Engineer Matt King, who is blind, demonstrates facial recognition technology via a teleconference at Facebook headquarters in Menlo Park, Calif. on Dec. 18, 2017.
  • By Ryan Nakashima Associated Press

| Menlo Park, Calif.

When Matt King first got on Facebook eight years ago, the blind engineer had to weigh whether it was worth spending an entire Saturday morning checking whether a friend of his was actually in his friend list. Such were the tools at the time for the visually impaired – almost nonexistent.

Today, thanks to text-to-audio software, it just takes a few seconds for him to accomplish the same task. And because of a new face recognition service the social network is rolling out Tuesday, he can now learn which friends are in photos, even those who haven't been tagged by another user.

The facial recognition technology, which uses artificially intelligent algorithms, doesn't appear to have changed much since Facebook began using it in 2010 to suggest the identities of people in photos. But after incorporating feedback from billions of user interactions, Facebook felt confident enough to push its use into new territory.

"What we're doing with AI is making it possible for anybody to enjoy the experience," says Mr. King, who lost his sight in college due to a degenerative eye disease and now works at Facebook as an accessibility specialist. In addition to the improved facial recognition, Facebook has in recent years also automated descriptions of what's happening in a photo. (Those remain relatively primitive, as they're limited to only about 100 or so concepts and roughly a dozen action verbs.)

For the sighted, the new facial recognition settings will also help crack down on imposters. Starting Tuesday, Facebook will notify you if someone has uploaded your face as their profile picture. And just in time for holiday parties, you can also be notified if someone in your friend network has posted a compromising picture of you without explicitly tagging you.

That check is not perfect. If you don't want a karaoke picture of yourself online, for example, you can't veto the resulting photos posted by your friends, although you can ask them to take it down. Serious violations or disputes can be flagged to Facebook staff, which they will review according to their community standards.

Facebook lets the person posting a photo have the final say this way in order to deal with situations like public speaking events, where the speaker shouldn't have control over what's shared.

For the visually impaired, the company is also working on identifying text in manipulated photos like memes, though its technique isn't quite ready for primetime. Even small accuracy problems can ruin the punchline, according to Facebook accessibility director Jeff Wieland.

For Janni Lehrer-Stein, a volunteer who advises Facebook, the new facial recognition capability will help her enjoy more of her daughter's recent graduation photos. Ms. Lehrer-Stein had lost her sight by the time she was 46, and has long used audio-to-text software on Facebook. Knowing who is in each photo makes a big difference, says the 60something mother of three.

The technology gives her enough information to "engage" in special family moments captured in photos, she says. "Even though I can't see them."

This story was reported by The Associated Press. 

You've read  of  free articles. Subscribe to continue.
Real news can be honest, hopeful, credible, constructive.
What is the Monitor difference? Tackling the tough headlines – with humanity. Listening to sources – with respect. Seeing the story that others are missing by reporting what so often gets overlooked: the values that connect us. That’s Monitor reporting – news that changes how you see the world.
editor@csmonitor.com
Subscribe
Mark Sappenfield
Editor

Dear Reader,

About a year ago, I happened upon this statement about the Monitor in the Harvard Business Review – under the charming heading of “do things that don’t interest you”:

“Many things that end up” being meaningful, writes social scientist Joseph Grenny, “have come from conference workshops, articles, or online videos that began as a chore and ended with an insight. My work in Kenya, for example, was heavily influenced by a Christian Science Monitor article I had forced myself to read 10 years earlier. Sometimes, we call things ‘boring’ simply because they lie outside the box we are currently in.”

If you were to come up with a punchline to a joke about the Monitor, that would probably be it. We’re seen as being global, fair, insightful, and perhaps a bit too earnest. We’re the bran muffin of journalism.

But you know what? We change lives. And I’m going to argue that we change lives precisely because we force open that too-small box that most human beings think they live in.

The Monitor is a peculiar little publication that’s hard for the world to figure out. We’re run by a church, but we’re not only for church members and we’re not about converting people. We’re known as being fair even as the world becomes as polarized as at any time since the newspaper’s founding in 1908.

We have a mission beyond circulation, we want to bridge divides. We’re about kicking down the door of thought everywhere and saying, “You are bigger and more capable than you realize. And we can prove it.”

If you’re looking for bran muffin journalism, you can subscribe to the Monitor for $15. You’ll get the Monitor Weekly magazine, the Monitor Daily email, and unlimited access to CSMonitor.com.

Subscribe to insightful journalism

QR Code to Facebook unveils AI-powered feature to help the blind use its site
Read this article in
https://www.csmonitor.com/Technology/2017/1220/Facebook-unveils-AI-powered-feature-to-help-the-blind-use-its-site
QR Code to Subscription page
Start your subscription today
https://www.csmonitor.com/subscribe