Wednesday, August 5, 2020
Home Lead Story Researchers Teaching Artificial Intelligence to Connect Senses Like Vision and Touch

Researchers Teaching Artificial Intelligence to Connect Senses Like Vision and Touch

The new AI-based system can create realistic tactile signals from visual inputs

A team of researchers at the Massachusetts Institute of Technology (MIT) have come up with a predictive Artificial Intelligence (AI) that can learn to see by touching and to feel by seeing.

While our sense of touch gives us capabilities to feel the physical world, our eyes help us understand the full picture of these tactile signals.

Robots, however, that have been programmed to see or feel can’t use these signals quite as interchangeably.

The new AI-based system can create realistic tactile signals from visual inputs, and predict which object and what part is being touched directly from those tactile inputs.

Teaching, Artificial Intelligence, Researchers
) A team of researchers at the Massachusetts Institute of Technology (MIT) have come up with a predictive Artificial Intelligence (AI). Pixabay

In the future, this could help with a more harmonious relationship between vision and robotics, especially for object recognition, grasping, better scene understanding and helping with seamless human-robot integration in an assistive or manufacturing setting.

“By looking at the scene, our model can imagine the feeling of touching a flat surface or a sharp edge”, said Yunzhu Li, PhD student and lead author from MIT’s Computer Science and Artificial Intelligence Laboratory (CSAIL).

“By blindly touching around, our model can predict the interaction with the environment purely from tactile feelings,” Li added.

The team used a KUKA robot arm with a special tactile sensor called GelSight, designed by another group at MIT.

Also Read- G20 Environment Ministers Agree to Tackle Marine Plastic Waste

Using a simple web camera, the team recorded nearly 200 objects, such as tools, household products, fabrics, and more, being touched more than 12,000 times.

Breaking those 12,000 video clips down into static frames, the team compiled “VisGel,” a dataset of more than three million visual/tactile-paired images.

“Bringing these two senses (vision and touch) together could empower the robot and reduce the data we might need for tasks involving manipulating and grasping objects,” said Li.

The current dataset only has examples of interactions in a controlled environment.

Teaching, Artificial Intelligence, Researchers
While our sense of touch gives us capabilities to feel the physical world, our eyes help us understand the full picture of these tactile signals. Pixabay

The team hopes to improve this by collecting data in more unstructured areas, or by using a new MIT-designed tactile glove, to better increase the size and diversity of the dataset.

“This is the first method that can convincingly translate between visual and touch signals”, said Andrew Owens, a post-doc at the University of California at Berkeley.

Also Read- Scholarship Scam: How Officials, Institutions, Banks Deprive Poor Students to Pursue Basic Education?

The team is set to present the findings next week at the “Conference on Computer Vision and Pattern Recognition” in Long Beach, California. (IANS)

STAY CONNECTED

18,959FansLike
362FollowersFollow
1,782FollowersFollow

Most Popular

Vaani Kapoor Would Love to do a Biopic on Kalpana Chawla

Actress Vaani Kapoor would love to do a biopic and says it would be an absolute honour for her to play astronaut Kalpana Chawala...

Sonali Bendre: Lockdown Has Given Me No Alternative But to Become Tech Savvy

Actress Sonali Bendre Behl says the lockdown has given her no alternative but to become tech savvy. She adds that is happy to learn...

Sonu Sood: The Real Life Hero

By Venkatachari Jagannathan Sonu Sood, for the Tamil movie viewers, has until now been the actor who played the villain in "Kallazhagar" and several others....

Shoppers can Follow These Tips to Spend Worry Free Days at Malls

By N. Lothungbeni Humtsoe Malls are open and as the footfall starts to pick up, the only one who can ensure your safety on a...

Bacterial Infections May Elevate Risk of Heart Disease in Individuals With Diabetes

Researchers have found that bacterial infections may elevate the risk of coronary heart disease in individuals with type 1 diabetes. For the findings, published in...

Tips to Help you Combat Oral Health Issues

By Puja Gupta Foul breath can be a very embarrassing, putting one in an uncomfortable position. With a little bit of care, this common condition...

WhatsApp Launches ‘Search the Web’ Option to Cross-Check Forwarded Messages

WhatsApp has launched a new 'Search the Web' option that will enable users to check information shared to them via a forwarded message. The 'Search...

Early Blood Test Can Detect Baby Brain Damage Just Hours After Birth

Researchers, including one of Indian origin, have found that an early blood test could detect which babies deprived of oxygen at birth are at...

Recent Comments