3DMan

Manipulation of 3D objects using vision based control techniques

Main researcher: L. Moreno

abrir_puerta_logo

Description

This research line is being performed in collaboration with the LISIF laboratory of the University Pierre & Marie Curie of Paris, as part of an Integrated Action.

The increasing need for remote intervention of man requires the development of robotic systems that are capable performing tasks with total autonomy and high dexterity.
Current remotely controlled applications or those performed by autonomous robotic systems are concentrated at hostile situations such as radioactive environments, sub-sea or space but also can be found in fields closer to everyday life such as manufacturing or security applications. New applications cover chirurgical operations in tele-medicine and extend to assistive activities helping disabled persons. The Robots are then required to resolve operations in environments which may not be adapted, but crowded with mobile and fixed obstacles. The objective therefore is to equip modern robots with the possibility to reach their desired position, identify the target object, grasp it and manipulate it as required according to the task in hand. There is no doubt that there are several robotic systems developed in recent years with similar philosophy; however, the work of integration is still far from reaching. If these robotic systems are called upon to operate in the real world, and consequently to interact actively with an environment which is neither structured nor easy to model, then a greater effort should be made to equip them with vision systems. The problematic is then to develop algorithms and strategies for the grasping and manipulation of 3D objects using visual information, provided by a multi camera system in charge of the perception of the scene.

Since the robot is expected to come in contact with its environment, the force exerted at the end-effector is also of major importance to achieve an optimal interaction. It is therefore clear that a hybrid vision/force/position control is required to achieve a correct interaction with the environment and ensure an optimal manipulation of object by the robotic system.

Entries:
End-User Programming of a Social Robot by Dialog
Robotics and Autonomous Systems. (Online). num. 12 , vol. 59 , pages: 1102 – 1114 , 2011
Javi F. Gorostiza M.A. Salichs
Human-Robot Interfaces for Social Interaction
International Journal of Robotics and Automation. , 2006
A.M. Khamis M.A. Salichs
Human-Robot Interfaces for Social Interaction
International Journal of Robotics and Automation. num. 3 , vol. 22 , pages: 215 – 221 , 2007
A.M. Khamis M.A. Salichs
Sistema De Navegación Por Voz Para Robots Móviles Autónomos
Revista Iberoamericana de Ingeniería Mecánica. num. 1 , vol. 10 , pages: 15 – 31 , 2006
V. Egido R. Barber M.A. Salichs
Remote Interaction with Mobile Robots
Autonomous Robots. num. 3 , vol. 15 , pages: 267 – 281 , 2003
A.M. Khamis M.A. Salichs
Software Architecture for Internet Mobile Robotics
Robotics and Machine Perception. SPIE. num. 1 , vol. 12 , pages: 7 – 11 , 2003
A.M. Khamis M.A. Salichs

Entries:
Teaching Sequences to a Social Robot by Voice Interaction
RO-MAN 09 : 18th IEEE International Symposium on Robot and Human Interactive Communication , 2009, Toyama, Japan
Javi F. Gorostiza M.A. Salichs
Multimodal Human-Robot Interaction Framework for a Personal Robot
RO-MAN 06: The 15th IEEE International Symposium on Robot and Human Interactive Communication, 2006, Hatfield, United Kingdom
E. Delgado A. Corrales R. Rivas R. Pacheco A.M. Khamis Javi F. Gorostiza M. Malfaz R. Barber M.A. Salichs
Using Emotions for Behaviour-Selection Learning
The 17th European Conference on Artificial Intelligence. ECAI 2006, 2006, Riva del Garda, Italy
M. Malfaz M.A. Salichs
Maggie: A Robotic Platform for Human-Robot Social Interaction
IEEE International Conference on Robotics, Automation and Mechatronics (RAM 2006), 2006, Bangkok, Thailand
E. Delgado A. Corrales R. Rivas R. Pacheco A.M. Khamis Javi F. Gorostiza M. Malfaz R. Barber M.A. Salichs
Emotion-Based Learning of Intrinsically Motivated Autonomous Agents living in a Social World
International Conference on Development and Learning 2006. ICDL5, 2006, Bloomington, In, USA
M. Malfaz M.A. Salichs
Learning Behaviour-Selection Algorithms for Autonomous Social Agents living in a Role-Playing Game
Narrative AI and Games, part of AISB'06: Adaptation in Artificial and Biological Systems. University of Bristol, Bristol, England
M. Malfaz M.A. Salichs
Using Emotions on Autonomous Agents. The Role of Happiness, Sadness and Fear
Integrative Approaches to Machine Consciousness, part of AISB'06: Adaptation in Artificial and Biological Systems, Bristol, England
M. Malfaz M.A. Salichs
Autonomous Monitoring And Reaction To Failures In A Topological Navigation System
2nd International Conference on Informatics in Control, Automation and Robotics, 2005, Barcelona, Spain
V. Egido R. Barber M.A. Salichs
A Door Lintel Locator Sensor for Mobile Robot Topological Navigation
IEEE International Workshop on Intelligent Data Acquisition and Advanced Computing Systems: Technology and Applications, 2005, Sofia, Bulgaria
V. Egido R. Barber M.A. Salichs
A new architecture for autonomous robots based on emotions
Fifth IFAC Symposium on Intelligent Autonomous Vehicles, Lisbon, Portugal
M. Malfaz M.A. Salichs
A Framework For Complex Skill Generation
The 5th IFAC Symposium on Intelligent Autonomous Vehicles. Lisboa, 2004, Lisboa, Portugal
M. Rivero R. Barber M.A. Salichs
Design of an Architecture Based on Emotions for an Autonomous Robot
2004 AAAI Spring Symposium, 2004, Stanford, California
M. Malfaz M.A. Salichs
Sistema de Interacción Remota con Robots Móviles basado en Internet I
I Jornadas de Trabajo: Educación en Automática. DocenWeb: Red Temática de Docencia en Control mediante Web, 2004, Alicante, Spain
A.M. Khamis R. Barber M.A. Salichs
An Agent Based Framework For Sequencing Autonomous Robots Skills
The 8th Conference on Intelligent Autonomous Systems, 2004, Amsterdam, The Netherlands
M. Rivero R. Barber M.A. Salichs
The current state of robotics: post or pre-robotics?
3rd IARP Workshop on Service, Assistive and Personal Robots, Madrid, Spain
M.A. Salichs

Entries:
Arquitecturas de Control para Robots
chapter: Arquitectura software de un robot personal pages: 101 – 115. Universidad Polit¶ecnica de Madrid , ISBN: 978-84-7484-196, 2007
A. Corrales R. Rivas R. Barber M.A. Salichs

Previous Project

next project