Tuesday, May 11, 2021
Home Lead Story Blind Facebook employee is developing tech for sightless

Blind Facebook employee is developing tech for sightless

At Facebook, he works on features to help people with disabilities use the platform.

  • A blind Facebook employee is developing AI to make social network for sightless fun
  • He is developing AI which will verbalise images and videos
  • This technology will enable alt-text for images and videos

A blind Facebook employee is developing a technology that will use Artificial Intelligence (AI) to verbalise the content of an image or video and enable the visually impaired to “see” and determine appropriate content for people and advertisers.

Facebook engineer Matt King is leading a project that is making solutions for visually impaired people on the platform that could eventually be used to identify images and videos that violate Facebook’s terms of use or that advertisers want to avoid.

Also Read : Facebook might bring Stories on desktop 

This feature will verbalise images and videos for the visually impaired. Image Source: Reuters
This feature will verbalise images and videos for the visually impaired. Image Source: Reuters

“More than two billion photos are shared across Facebook every single day. That’s a situation where a machine-based solution adds a lot more value than a human-based solution ever could,” CNBC quoted King as saying late on Saturday.

King, who was born with a degenerative eye disease called retinitis pigmentosa, lost his vision by the time he got his degree and started working at IBM with the tech giant’s accessibility projects.

He worked on a screen reader to help visually impaired people “see” what is on their screens either through audio cues or a braille device. IBM eventually developed the first screen reader for a graphical interface.

He worked with the accessibility team till Facebook hired him from IBM in 2015.

The man behind this development is Matt King.
The man behind this development is Matt King.

At Facebook, he works on features to help people with disabilities use the platform, like adding captions to videos or coming up with ways to navigate the site using only audio cues.

“Anybody who has any kind of disability can benefit from Facebook. They can develop beneficial connections and understand their disability doesn’t have to define them, to limit them,” King said.

Also Read : Facebook Profit Escalates with No Major Impact from Russia and it’s Advertisements

One of his main projects is “automated alt-text,” which describes audibly what is in Facebook images.

When automated alt-text was launched in April 2016, it was only available in five languages on the iOS app. Today it is available in over 29 languages on Facebook on the web, iOS and Android.

Facebook is available in more than 29 languages across the world. Pixabay
Facebook is available in more than 29 languages across the world. Pixabay

“The things people post most frequently kind of has a limited vocabulary associated with it,” the Facebook engineer said.

“It makes it possible for us to have one of those situations where if you can tackle 20 per cent of the solution, it tackles 80 per cent of the problem. It’s getting that last 20 per cent which is a lot of work, but we’re getting there,” he said.

In December 2017, Facebook pushed an automatic alt-text update that used facial recognition to help visually impaired people find out who is in photos. IANS

STAY CONNECTED

19,511FansLike
362FollowersFollow
1,773FollowersFollow

Most Popular

Himachal Locals Stand Guard Against The Pandemic

With Himachal Pradesh Chief Minister Jai Ram Thakur continuing to motivate the panchayat heads to play a crucial role to trace and quarantine all...

Study Shows Obesity Increases Risk Of Covid Infection

People with increasing body mass index (BMI) may be at the risk of testing positive for SARS-CoV-2, the virus which causes Covid-19 finds a...

Common Myths About Adult Immunisation Busted

While vaccinations remain the most effective prevention strategy to maintain immunity for a prolonged period, adult immunization remains neglected. Adult immunization myths prevail as...

UN Experts: Islamic State Committed Genocide Against Yazidis

Karim Khan, head of a UN team investigating the Islamic State (IS) crimes in Iraq, said that there is "clear and convincing evidence" that...

Is Taiwan’s Silicon Shield Enough To Protect It From Chinese Aggression?

The global shortage of semiconductors, or microchips — the “brains” in all electronic devices, has heightened the geopolitical significance of Taiwan and its chip-making...

Samsung Develops CXL-Based DRAM Memory Tech For Data Centres

Samsung Electronics said on Tuesday it has developed a new DRAM memory technology based on the Compute Express Link (CXL) interconnect standard that can...

The Right Way to Wield Influence: Influencer Masoom Minawala Mehta

"Presence on social media also commands a certain responsibility", says fashion influencer Masoom Minawala Mehta There is such a cloud around the term "influencers"; in...

Puducherry Becomes ‘Har Ghar Jal’ Union Territory

Puducherry has become a ‘Har Ghar Jal' Union Territory (UT) by ensuring that every rural home in the UT gets a household tap connection. With...

Recent Comments