This chapter introduces a proposal for integrating personal assistant robots with social capacities in smart environments. The personal robot will be a fundamental element for the detection and healthy regulation of the affect of the environment’s inhabitants. A full description of the main features of the proposed personal assistant robot are introduced. Also, the multi-modal emotion detection and emotion regulation modules are fully described. Machine learning techniques are employed for emotion recognition from voice and images and both outputs are merged to achieve the detected emotion.