ABB Gives Robots “Eyes,” Enhancing Machine Sensing and Perception

ABB Robotics has developed an advanced machine vision system for its OmniCore-powered robots. The new OmniCore EyeMotion package enables compatible robots to "see" when paired with sensors or third-party cameras. The EyeMotion package takes robot vision a step further by adding AI capabilities, making it adaptable to future manufacturing operations and for handling unexpected circumstances.

An OmniCore-powered robot performing picking operations. Image used courtesy of ABB Robotics

Machine Vision for Robotics

Imagine making a peanut butter and jelly sandwich. Simple enough. Now, imagine performing this task blindfolded. Sure, it is still possible, but it is much more difficult and often much messier. By removing vision from the equation, the assembly process relies entirely on tactile cues.

For years, robotic manipulation and assembly of items has been treated this way. Light curtains are used to stop robots and prevent robot-human collisions. Torque sensors are used to ensure that screws are tightened properly. Break-beam sensors are used to detect the placement and alignment of components during assembly.

Machine vision takes the blindfold off, allowing robots to “see” and perform tasks more accurately. However, unlike the human brain, the robot’s processor does not automatically understand what it sees. It must be taught and must adapt to new environments.

OmniCore EyeMotion is hardware-agnostic, meaning it can be paired with any sensor or camera mounted on an OmniCore-powered robot. Image used courtesy of ABB Robotics

OmniCore EyeMotion

Simply adding cameras to a robot will not help the robot to “see.” The heart of a machine vision system is in software, and that is where ABB’s new OmniCore EyeMotion excels. It includes an intuitive user interface featuring drag and drop options for sensors and cameras and an extensive framework for performing 2D and 3D machine vision applications. Camera options include many third-party cameras, meaning that as camera technology improves, replacing a camera enhances production, rather than requiring extensive downtime for reprogramming and redesign.
 

OmniCore EyeMotion integrates with ABB’s RobotStudio software suite for simple setup and quick deployment. Image used courtesy of ABB

RobotStudio Software Integration

According to ABB, OmniCore EyeMotion’s setup, installation, and commissioning can be done quickly, thanks to its full integration with ABB’s RobotStudio software suite. Because this software is simple to configure, it makes the entire system more adaptable and scalable for future manufacturing operations, without needing a full redesign or reprogramming of the robot.

RobotStudio and EyeMotion work together to find optimal, collision-free travel paths. In ABB’s testing, this has reduced cycle times by up to 50%, drastically increasing throughput and reducing mishandled products. Also, by leveraging the power of AI, EyeMotion can detect unexpected events, such as workers that have entered the robot’s space, misaligned or deformed parts, and other such problems, before the robot gets a chance to compound the problem.

Advancing Robot Vision

In modern times, robots are commonly used in manufacturing facilities. ABB Robotics' OmniCore EyeMotion can benefit these robots, whether they use manipulators for gripping, moving, or holding objects, or perform assembly tasks, such as welding, soldering, or running screwdrivers. Retrofitting these robots with OmniCore EyeMotion and cameras/sensors can benefit users in assembly, picking, and packing operations, with the goal of speeding up, simplifying, and enhancing operations.