GelSight sensor lets robots "see" through their hands

<div dir="ltr" style="text-align: left;" trbidi="on"> <h1 id="ar_title" style="background-color: white; clear: both; color: #f36031; font-family: OpenSansLight, 'Helvetica Neue', Arial; font-size: 40px; font-weight: 300; line-height: 46px; margin: 5px 0px 20px; padding: 0px;"> GelSight sensor lets robots "see" through their hands<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEicSFIMMwkP5LjWIo_zLcOl7yXzLVqQ_c7hafD1OhzinA7p2zYQaBCyl0FwW3brMR-ie-ALUKkcb3GMQagRzCt_u_2SRX9u4ba7Im6q9m83YxKjMfAuwUpGPpE274MNNgbJIk3bOwNIBJTq/s1600/gelsightrobots.jpg" imageanchor="1" style="background-color: transparent; margin-left: 1em; margin-right: 1em; text-align: center;"><img border="0" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEicSFIMMwkP5LjWIo_zLcOl7yXzLVqQ_c7hafD1OhzinA7p2zYQaBCyl0FwW3brMR-ie-ALUKkcb3GMQagRzCt_u_2SRX9u4ba7Im6q9m83YxKjMfAuwUpGPpE274MNNgbJIk3bOwNIBJTq/s1600/gelsightrobots.jpg" /></a></h1> <div> <div style="background-color: white; clear: both; color: #333333; font-family: ProximaNova, 'Helvetica Neue', Arial; font-size: 16px; line-height: 22px; margin-bottom: 10px; padding: 0px;"> Three years ago, we first heard about <a href="http://www.gizmag.com/gelsight-painted-rubber-microscopic-images/19485/" style="background-color: transparent; color: #1e8dd7; text-decoration: none;" target="_blank">GelSight</a> – an experimental new system for imaging microscopic objects. At the time, its suggested applications were in fields such as aerospace, forensics, dermatology and biometrics. Now, however, researchers at MIT and Northeastern University have found another use for it. They've incorporated it into an ultra-sensitive tactile sensor for robots.</div> <div style="background-color: white; clear: both; color: #333333; font-family: ProximaNova, 'Helvetica Neue', Arial; font-size: 16px; line-height: 22px; margin-bottom: 10px; padding: 0px;"> First of all, here's how MIT's basic GelSight technology works, as described in our previous article ...</div> <div style="background-color: white; clear: both; color: #333333; font-family: ProximaNova, 'Helvetica Neue', Arial; font-size: 16px; line-height: 22px; margin-bottom: 10px; padding: 0px;"> A slab of clear, synthetic rubber is initially coated on one side with a layer of metallic paint. When the painted side is then pressed against a surface, it deforms to the shape of that surface. Looking through the opposite, unpainted side of the rubber, one can see the minute contours of the surface, pressing up into the paint. Using cameras and computer algorithms, the system is able to turn those contours into 3D images, that capture details less than one micrometer in depth and approximately two micrometers in width.</div> <div style="background-color: white; clear: both; color: #333333; font-family: ProximaNova, 'Helvetica Neue', Arial; font-size: 16px; line-height: 22px; margin-bottom: 10px; padding: 0px;"> The paint is necessary in order to standardize the optical qualities of the surface, so that the system isn't confused by multiple colors or materials.</div> <div class="separator" style="clear: both; text-align: center;"> </div> <div class="separator" style="clear: both; text-align: center;"> <a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhXeY7V5ukti_GK1DG5dgKk6hpoaZB2Y5zcpyT2fBq-p7ETjcDO6uOaLUUkhbSfzxRx52uP61ZM30_iA636Miho1giEw7rU1xyQkDs56afAo7D27Q9ODsmy6kYM7P-RMgnkOSWInVZzo2MO/s1600/gelsightrobots-1+(1).jpg" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhXeY7V5ukti_GK1DG5dgKk6hpoaZB2Y5zcpyT2fBq-p7ETjcDO6uOaLUUkhbSfzxRx52uP61ZM30_iA636Miho1giEw7rU1xyQkDs56afAo7D27Q9ODsmy6kYM7P-RMgnkOSWInVZzo2MO/s1600/gelsightrobots-1+(1).jpg" /></a></div> <div style="background-color: white; clear: both; color: #333333; font-family: ProximaNova, 'Helvetica Neue', Arial; font-size: 16px; line-height: 22px; margin-bottom: 10px; padding: 0px;"> For the recent study, the team installed a GelSight sensor on one of the gripping surfaces of a <a href="http://www.gizmag.com/rethink-robotics-baxter-industrial-robot/24183/" style="background-color: transparent; color: #1e8dd7; text-decoration: none;" target="_blank">Baxter</a> industrial robot's two-pincher gripper. Using its own computer vision system, the robot subsequently identified a USB cable hanging loosely from a hook, and grabbed that cable's plug with its pinchers.</div> <div style="background-color: white; clear: both; color: #333333; font-family: ProximaNova, 'Helvetica Neue', Arial; font-size: 16px; line-height: 22px; margin-bottom: 10px; padding: 0px;"> At that point, it used the GelSight sensor to image the USB symbol embossed on one side of the plug. This allowed it to determine the exact orientation of the plug within its gripper. In order to help it do so with more precision, the cube-shaped sensor utilized four differently-colored LEDs, each one shining into the rubber from a different side. By analyzing the relative intensities of the different light colors on various parts of the USB symbol, the sensor was better able to ascertain the plug's three-dimensional positioning relative to the gripper.</div> <div style="background-color: white; clear: both; color: #333333; font-family: ProximaNova, 'Helvetica Neue', Arial; font-size: 16px; line-height: 22px; margin-bottom: 10px; padding: 0px;"> The robot then proceeded to move the plug end of the cable over to a USB socket, and successfully inserted it. When the sensor was turned off, however, the robot couldn't get the plug in, since it couldn't tell how it was holding it. That's why robots typically need to have objects precisely set in place for them ahead of time, and why GelSight could allow robots to be much more adaptable when manipulating items in chaotic environments.</div> <div style="background-color: white; clear: both; color: #333333; font-family: ProximaNova, 'Helvetica Neue', Arial; font-size: 16px; line-height: 22px; margin-bottom: 10px; padding: 0px;"> According to MIT, the relatively low-resolution GelSight sensor used in the experiments is still about 100 times more sensitive than a human finger. It can be seen in use, in the following video.</div> <div class="separator" style="clear: both; text-align: center;"> <iframe allowfullscreen="allowfullscreen" class="b-hbp-video b-uploaded" frameborder="0" height="266" id="BLOGGER-video-5c2c7a51d77c2a11-10828" mozallowfullscreen="mozallowfullscreen" src="https://www.blogger.com/video.g?token=AD6v5dzEPtv1S5SYZoigJrU96PCbk2B00OWClYMPod0-KFKqTTA4m4u8lvT48XWJKbY6Ly02Zq7jLtLjYqhQRNhOfxphS82zl6YBf0fNCIvR4ob9I4tXV63-b42ap0RrJo7ddi87JpF0&origin=plasticinnovations14.blogspot.com" webkitallowfullscreen="webkitallowfullscreen" width="320"></iframe></div> <div style="background-color: white; clear: both; color: #333333; font-family: ProximaNova, 'Helvetica Neue', Arial; font-size: 16px; line-height: 22px; margin-bottom: 10px; padding: 0px;"> <br /></div> <div style="background-color: white; clear: both; color: #333333; font-family: ProximaNova, 'Helvetica Neue', Arial; font-size: 16px; line-height: 22px; margin-bottom: 10px; padding: 0px;"> <br /></div> </div> </div>

GelSight sensor lets robots "see" through their hands

GelSight sensor lets robots "see" through their hands Three years ago, we first heard about  GelSight  – an experimental new ...

Read more »