Research

The goal of the FlexSight project (Flexible and Accurate Recognition and Localization System of Deformable Objects for Pick&Place Robots) is to design a perception system based on an integrated smart camera (the FlexSight sensor, FSS) that is able to recognize and localize several types of deformable objects that can be commonly found in many industrial and logistic applications. We refer to a "deformable object" either as an object that can change its shape due to a stress, or that can be obtained by applying a resize operator along one or more directions.

 

The FSS sensor will integrate all the required sensors (depth sensor, stereo RGB camera, ...) and processing units (CPU+GPU) suitable to run the implemented algorithms and it will be one of the first smart camera that explicitly deals with deformable objects: our system will search over a parameters set that not only includes the class and the position of the object, but also its deformation/rescaling parameters.