Vision-driven Robotic Object Manipulation

With deep learning and reinforcement learning, we allow the robot to learn itself. Conducting multiple object manipulation task (e.g., pick-and-place, assemble) using vision sensor can reduce the cost of hardware and integration. The training data is collected in simulation and the algorithm is transferred to real world automatically, so as to reduce the deployment cost. The flexibility of this technique let the robot to handle customized products in intelligent manufacturing factories and logistics sorting for potential multiple categories.

[Video 1: grasping multiple objects]
[Video 2: pushing an object]
[Video 3: flipping an object]
[Video 4: manipulating objects in VR environment]