Tuesday, November 24, 2020
Home Lead Story Blind Facebook employee is developing tech for sightless

Blind Facebook employee is developing tech for sightless

At Facebook, he works on features to help people with disabilities use the platform.

  • A blind Facebook employee is developing AI to make social network for sightless fun
  • He is developing AI which will verbalise images and videos
  • This technology will enable alt-text for images and videos

A blind Facebook employee is developing a technology that will use Artificial Intelligence (AI) to verbalise the content of an image or video and enable the visually impaired to “see” and determine appropriate content for people and advertisers.

Facebook engineer Matt King is leading a project that is making solutions for visually impaired people on the platform that could eventually be used to identify images and videos that violate Facebook’s terms of use or that advertisers want to avoid.

Also Read : Facebook might bring Stories on desktop 

This feature will verbalise images and videos for the visually impaired. Image Source: Reuters
This feature will verbalise images and videos for the visually impaired. Image Source: Reuters

“More than two billion photos are shared across Facebook every single day. That’s a situation where a machine-based solution adds a lot more value than a human-based solution ever could,” CNBC quoted King as saying late on Saturday.

King, who was born with a degenerative eye disease called retinitis pigmentosa, lost his vision by the time he got his degree and started working at IBM with the tech giant’s accessibility projects.

He worked on a screen reader to help visually impaired people “see” what is on their screens either through audio cues or a braille device. IBM eventually developed the first screen reader for a graphical interface.

He worked with the accessibility team till Facebook hired him from IBM in 2015.

The man behind this development is Matt King.
The man behind this development is Matt King.

At Facebook, he works on features to help people with disabilities use the platform, like adding captions to videos or coming up with ways to navigate the site using only audio cues.

“Anybody who has any kind of disability can benefit from Facebook. They can develop beneficial connections and understand their disability doesn’t have to define them, to limit them,” King said.

Also Read : Facebook Profit Escalates with No Major Impact from Russia and it’s Advertisements

One of his main projects is “automated alt-text,” which describes audibly what is in Facebook images.

When automated alt-text was launched in April 2016, it was only available in five languages on the iOS app. Today it is available in over 29 languages on Facebook on the web, iOS and Android.

Facebook is available in more than 29 languages across the world. Pixabay
Facebook is available in more than 29 languages across the world. Pixabay

“The things people post most frequently kind of has a limited vocabulary associated with it,” the Facebook engineer said.

“It makes it possible for us to have one of those situations where if you can tackle 20 per cent of the solution, it tackles 80 per cent of the problem. It’s getting that last 20 per cent which is a lot of work, but we’re getting there,” he said.

In December 2017, Facebook pushed an automatic alt-text update that used facial recognition to help visually impaired people find out who is in photos. IANS

STAY CONNECTED

19,120FansLike
362FollowersFollow
1,782FollowersFollow

Most Popular

History Of Muslim Rule In India: The Music And Architecture

The end of Muslim rule in India was as spasmodic as its beginning. It took five hundred years for its establishment (712-1206) and one...

Snapchat Releases Spotlight, To Pay Top Creators

Taking on TikTok, Popular photo-messaging platform Snapchat on Monday officially released Spotlight where Snapchatters will also have the opportunity to earn as they do...

Care For COVID+ Mothers and Newborn Babies

Many COVID-19 positive pregnant women experience mild symptoms of cold or flu. However, pregnant women who are older, overweight, or have pre-existing medical conditions...

MP Govt To Produce Clean Fuel From Stubble Burnt

The Madhya Pradesh government has proposed a plan to set up an industrial unit producing fuel from stubble burnt by the farmers in the...

Felling of 315 Trees When Air Quality is Worse in Delhi

The Delhi High Court on Monday sought a response from the AAP government and others over a petition against an order for felling of...

Cyber Frauds May Increase in India in 2021: Kaspersky

With more users getting connected to the Internet and entering the digital payments ecosystem, cyber fraud incidents may go up in 2021, a researcher...

UP Marks Record in Production And Sales of Sanitizers

The Yogi Adityanath government in Uttar Pradesh has used the 'opportunity in adversity' concept to create a record of sorts in the production and...

Greater Risks of STI in People Above 45

Researchers have found that people above 45s are at a higher risk of contracting sexually transmitted infections (STIs) than ever before because of society's...

Recent Comments