Abstract
Companion robots are becoming more common in home environments, as such a greater emphasis is required on analysis of human behaviour. An important aspect of human behaviour is emotion, both the ability to express and comprehend. While humans have developed excellent skills in inferring the emotional states of their counterparts via implicit cues such as facial expression and body language, this level of understanding is often neglected in Human Robot Interactions; furthermore, humans are able to empathetically respond to the emotions of others to create a more harmonious and person relationship. This paper is a preliminary proposal of a novel approach for facial emotional detection and appropriate empathetic responses, in conjunction with long term emotion mapping and prediction; the proposed system will be implemented on a social mobile robot, thus allowing a further level of behavioural comprehension to achieve a more human like encounter. The technique will be based on Fuzzy Cognitive Maps, using FACS Action Units as inputs, a high level facial descriptor layer and output of six emotions.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Skinner, B.F.: Science and human behavior. Simon and Schuster (1965)
Haddadin, S., Suppa, M., Fuchs, S., Bodenmüller, T., Albu-Schäffer, A., Hirzinger, G.: Towards the robotic co-worker. In: Robotics Research, pp. 261–282. Springer (2011)
Goetz, J., Kiesler, S., Powers, A.: Matching robot appearance and behavior to tasks to improve human-robot cooperation. In: The 12th IEEE International Workshop on Robot and Human Interactive Communication, Proceedings. ROMAN 2003, pp. 55–60. IEEE (2003)
Nehaniv, C.L., Dautenhahn, K.: Imitation and Social Learning in Robots, Humans and Animals: Behavioural, Social and Communicative Dimensions. Cambridge University Press (2007)
Christopher, G.J., Preethi, S., Beevi, S.J.: Adapting robot behavior for human robot interaction. In: Proceedings of International Conference on Information and Network Technology (ICINT 2011) (2011)
Breazeal, C., Kidd, C.D., Thomaz, A.L., Hoffman, G., Berlin, M.: Effects of nonverbal communication on effciency and robustness in human-robot teamwork. In: 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems, 2005 (IROS 2005), pp. 708–713. IEEE (2005)
Mercer, S.W., Reynolds, W.J.: Empathy and quality of care. Br. J. Gen. Pract. 52(Suppl), S9–12 (2002)
Broekens, J., Heerink, M., Rosendal, H.: Assistive social robots in elderly care: a review. Gerontechnology 8(2), 94–103 (2009)
Ekman, P., Friesen, W.V.: Facial action coding system (1977)
Lucey, P., Cohn, J.F., Kanade, T., Saragih, J., Ambadar, Z., Matthews, I.: The extended cohn-kanade dataset (ck+): a complete dataset for action unit and emotion-speciffed expression. In: 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 94–101. IEEE (2010)
Frank, M., Movellan, J., Bartlett, M., Littleworth, G.: Ru-facs-1 database. Machine Perception Laboratory, UC San Diego, vol. 1 (2012). REFERENCES 9
Ioannou, S.V., Raouzaiou, A.T., Tzouvaras, V.A., Mailis, T.P., Karpouzis, K.C., Kollias, S.D.: Emotion recognition through facial expression analysis based on a neurofuzzy network. Neural Netw. 18(4), 423–435 (2005)
Lucey, S., Ashraf, A.B., Cohn, J.F.: Investigating spontaneous facial action recognition through aam representations of the face. INTECH Open Access Publisher (2007)
Bartlett, M.S., Littlewort, G., Frank, M., Lainscsek, C., Fasel, I., Movellan, J.: Fully automatic facial action recognition in spontaneous behavior. In: 7th International Conference on Automatic Face and Gesture Recognition, 2006. FGR 2006, pp. 223–230. IEEE (2006)
Valstar, M.F., Pantic, M.: Fully automatic recognition of the temporal phases of facial actions. Syst. Man Cybern Part B: Cybern IEEE Trans 42(1), 28–43 (2012)
Kosko, B.: Fuzzy cognitive maps. Int. J. Man- Mach. Stud. 24(1), 65–75 (1986)
Salmeron, J.L.: Fuzzy cognitive maps for artiffcial emotions forecasting. Appl. Soft Comput. 12(12), 3704–3710 (2012)
Akinci, H.M., Yesil, E.: Emotion modeling using fuzzy cognitive maps. In: 2013 IEEE 14th International Symposium on Computational Intelligence and Informatics (CINTI), pp. 49–55. IEEE (2013)
Chakraborty, A., Konar, A., Chakraborty, U.K., Chatterjee, A.: Emotion recognition from facial expressions and its control using fuzzy logic. Syst. Man Cybern. Part A Syst. Humans IEEE Trans. 39(4), 726–743 (2009)
Essa, I.A., Pentland, A.P.: Coding, analysis, interpretation, and recognition of facial expressions. Pattern Anal. Machi. Intell. IEEE Trans. 19(7), 757–763 (1997)
Zeng, Z., Fu, Y., Roisman, G.I., Wen, Z., Hu, Y., Huang, T.S.: Spontaneous emotional facial expression detection. J. Multimedia 1(5), 1–8 (2006)
Acampora, G., Loia, V.: On the temporal granularity in fuzzy cognitive maps. IEEE Trans. Fuzzy Syst. 19(6), 1040–1057 (2011)
Carvalho, J.P., Tom, J.A.: Rule based fuzzy cognitive mapsexpressing time in qualitative system dynamics. In: The 10th IEEE International Conference on Fuzzy Systems, 2001, vol. 1, pp. 280–283. IEEE (2001)
Miao, Y., Liu, Z.-Q., Siew, C.K., Miao, C.Y.: Dynamical cognitive network-an extension of fuzzy cognitive map. IEEE Trans. Fuzzy Syst. 9(5), 760–770 (2001)
Wei, Z., Lu, L., Yanchun, Z.: Using fuzzy cognitive time maps for modeling and evaluating trust dynamics in the virtual enterprises. Expert Syst. Appl. 35(4), 1583–1592 (2008)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
May, A.D., Lotfi, A., Langensiepen, C., Lee, K., Acampora, G. (2017). Human Emotional Understanding for Empathetic Companion Robots. In: Angelov, P., Gegov, A., Jayne, C., Shen, Q. (eds) Advances in Computational Intelligence Systems. Advances in Intelligent Systems and Computing, vol 513. Springer, Cham. https://doi.org/10.1007/978-3-319-46562-3_18
Download citation
DOI: https://doi.org/10.1007/978-3-319-46562-3_18
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-46561-6
Online ISBN: 978-3-319-46562-3
eBook Packages: EngineeringEngineering (R0)