The scope of the Human-Robot Interaction group is research on human-robot interaction that is perceived as natural by single or multiple humans. The group researches how robots are perceived as social interaction partners in different contexts such as industrial production, medicine, public spaces, and in the household. In this area, the group is interested in

  1. developing concepts for intuitive, multimodal control, and programming of robots,
  2. implementing and evaluating natural and socially appropriate feedback from the robot to the human, and
  3. understanding error situations in human-robot interactions.

The group researches how implicit and explicit human input can be integrated into one representation that can be used by autonomous robots to recognise the intentions of the human. Another research focus lies on using augmented reality for industrial robot programming. The question here is how task-related, robot-related, and environment-related robot parameters should be presented to robot programmers in augmented reality setups. The goal in this case is to increase the efficiency and usability of the programming process while decreasing the mental workload of robot programmers. Another line of research is the production of understandable and contextually appropriate robot feedback. In user studies, the group measures how factors like robot personality, robot autonomy levels, and the above mentioned input and output modalities influence the user experience of humans interacting with robots. Finally, the group follows a line of research on the topic of error situations in human-robot interaction. The aim of the research is to analyse human verbal and non-verbal behaviours in the event of errors. The results of this research line will be used to train error recognition modules for robots.

Main Research Topics
The vision of the HRI group is to gain a better understanding of multimodal, natural human-robot interaction, based on standardized, objective measurements of HRI user studies. Specifically, the group researches in the following areas:

  • Human-robot dialogue
  • Robot feedback
  • Teaching of new robot tasks
  • Usage of augmented reality for robot programming and control
  • Error situations in human-robot interactions
Contact: Manuel Giuliani

Research by

News

show more news

Research Activities

Selected Publications

2017

Mirnig, Nicole; Stollnberger, Gerald; Miksch, Markus; Stadler, Susanne; Giuliani, Manuel; Tscheligi, Manfred

To Err Is Robot: How Humans Assess and Act toward an Erroneous Social Robot Journal Article

Frontiers in Robotics and AI, 4 (21), pp. 1–15, 2017.

Abstract | Links | BibTeX

ě, Zden; Kapinus, Michal; ě, V{'i}t; Ě, Pavel Smr; Giuliani, Manuel; Mirnig, Nicole; Stadler, Susanne; Stollnberger, Gerald; Tscheligi, Manfred

Using persona, scenario, and use case to develop a human-robot augmented reality collaborative workspace Inproceedings

Proceedings of the Companion of the 2017 ACM/IEEE International Conference on Human-Robot Interaction, pp. 201–202, ACM, 2017.

BibTeX

Mirnig, Nicole; Perterer, Nicole; Stollnberger, Gerald; Tscheligi, Manfred

Three Strategies for Autonomous Car-to-Pedestrian Communication: A Survival Guide Inproceedings

Proceedings of the Companion of the 2017 ACM/IEEE International Conference on Human-Robot Interaction, pp. 209–210, ACM, 2017.

BibTeX

Mirnig, Nicole; Stollnberger, Gerald; Giuliani, Manuel; Tscheligi, Manfred

Elements of humor: How humans perceive verbal and non-verbal aspects of humorous robot behavior Inproceedings

Proceedings of the Companion of the 2017 ACM/IEEE International Conference on Human-Robot Interaction, pp. 211–212, ACM, 2017.

BibTeX

Stadler, Susanne; Mirnig, Nicole; Giuliani, Manuel; Tscheligi, Manfred; Materna, Zdenek; Kapinus, Michal

Industrial Human-Robot Interaction: Creating Personas for Augmented Reality supported Robot Control and Teaching Inproceedings

Companion of the 2017 ACM/IEEE International Conference on Human-Robot Interaction, pp. 291–292, 2017.

BibTeX

2016

Arent, Krzysztof; Jakubiak, Janusz; Drwiega, Michał; Cholewinski, Mateusz; Stollnberger, Gerald; Giuliani, Manuel; Tscheligi, Manfred; Szczesniak-Stanczyk, Dorota; Janowski, Marcin; Brzozowski, Wojciech; others,

Control of mobile robot for remote medical examination: Design concepts and users' feedback from experimental studies Inproceedings

Proceedings of the International Conference on Human System Interactions (HSI), pp. 76–82, IEEE, 2016.

Links | BibTeX

Mirnig, Nicole; Stadler, Susanne; Stollnberger, Gerald; Giuliani, Manuel; Tscheligi, Manfred

Robot Humor: How Self-Irony and Schadenfreude Influence People's Rating of Robot Likability Inproceedings

Proceedings of the IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN 2016), IEEE, New York, USA, 2016.

BibTeX

Stadler, Susanne; Kain, Kevin; Giuliani, Manuel; Mirnig, Nicole; Stollnberger, Gerald; Tscheligi, Manfred

Augmented Reality for Industrial Robot Programmers: Workload Analysis for Task-based, Augmented Reality-supported Robot Control Inproceedings

Proceedings of the IEEE International Symposium on Robot and Human Interactive Communication, RO-MAN '16, 2016.

BibTeX

Stollnberger, Gerald; Giuliani, Manuel; Mirnig, Nicole; Tscheligi, Manfred; Arent, Krzysztof; Bogdan, Kreczmer; Grzeszczak, Filip; Szczesniak-Stanczyk, Dorota; Radoslaw, Zarczuk; Wysokinski, Andrzej

Designing User Interfaces for Different User Groups: A Three-Way Teleconference System for Doctors, Patients and Assistants Using a Remote Medical Robot Inproceedings

Proceedings of the IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN 2016) (Nominated for Best Design Paper Award), IEEE, New York, USA, 2016.

BibTeX

Stollnberger, Gerald; Christiane, Moser; Giuliani, Manuel; Stadler, Susanne; Tscheligi, Manfred; Szczesniak-Stanczyk, Dorota; Stanczyk, Bartlomiej

User Requirements for a Medical Robotic System: Enabling Doctors to Remotely Conduct Ultrasonography and Physical Examination Inproceedings

Proceedings of the IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN 2016), IEEE, New York, USA, 2016.

BibTeX

2015

Giuliani, Manuel; Mirnig, Nicole; Stollnberger, Gerald; Stadler, Susanne; Buchner, Roland; Tscheligi, Manfred

Systematic Analysis of Video Data from Different Human-Robot Interaction Studies: A Categorisation of Social Signals During Error Situations Journal Article

Frontiers in Psychology, 6 (931), 2015.

Abstract | Links | BibTeX

Weiss, Astrid; Mirnig, Nicole; Bruckenberger, Ulrike; Strasser, Ewald; Tscheligi, Manfred; Wollherr, Dirk; Stanczyk, Bartlomiej

The Interactive Urban Robot: User-centered development and final field trial of a direction requesting robot Journal Article

Paladyn, Journal of Behavioral Robotics, 6 (1), 2015.

BibTeX

Mirnig, Nicole; Giuliani, Manuel; Stollnberger, Gerald; Stadler, Susanne; Buchner, Roland; Tscheligi, Manfred

Impact of Robot Actions on Social Signals and Reaction Times in HRI Error Situations Inproceedings

Tapus, A (Ed.): Social Robotics, pp. 461–471, Springer International Publishing, 2015.

Links | BibTeX

2014

Mirnig, Nicole; Strasser, Ewald; Weiss, Astrid; Kühnlenz, Barbara; Wollherr, Dirk; Tscheligi, Manfred

Can You Read My Face? A Methodological Variation for Assessing Facial Expressions of Robotic Heads Journal Article

International Journal of Social Robotics, 6 (SI Artificial Empathy), pp. 14, 2014, ISSN: 1875-4791.

Links | BibTeX

Mirnig, Nicole; Tscheligi, Manfred

Comprehension, Coherence and Consistency: Essentials of Robot Feedback Incollection

Markowitz, J A (Ed.): Robots that Talk and Listen. Technology and Social Impact, pp. 149–171, Walter de Gruyter GmbH, 2014.

BibTeX

Barattini, Paolo; Virk, Gurvinder S; Mirnig, Nicole; Giannaccini, Maria E; Tapus, Adriana; Bonsignorio, Fabio

Experimenting in HRI for Priming Real-World Setups, Innovations and Products Inproceedings

Sagerer, Michita Imai Gerhard (Ed.): Proceedings of ACM/IEEE International Conference on Human-Robot Interaction, ACM, New York, NY, USA, 2014, ISBN: 978-1450331029.

BibTeX

Giuliani, Manuel; Marschall, Thomas; Tscheligi, Manfred

Applying Topic Recognition to Spoken Language in Human-Robot Interaction Dialogues Inproceedings

Proceedings of the 2014 Workshop on Multimodal, Multi-Party, Real-World Human-Robot Interaction at ICMI 2014, pp. 27–28, ACM, New York, NY, USA, 2014, ISSN: 978-1-4503-0551-8.

Abstract | Links | BibTeX

Mirnig, Nicole; Tan, Yeow K; Chang, Tai W; Chua, Yuan W; Dung, Tran A; Li, Haizhou; Tscheligi, Manfred

Screen Feedback in Human-Robot Interaction: How to Enhance Robot Expressiveness Inproceedings

Proceedings of the 23rd IEEE International Symposium on Robot and Human Interactive Communication, pp. 224–230, 2014.

BibTeX

Rödel, Christina; Stadler, Susanne; Meschtscherjakov, Alexander; Tscheligi, Manfred

Towards Autonomous Cars: The Effect of Autonomy Levels on Acceptance and User Experience Inproceedings

Proceedings of the 6th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, pp. 11-1, ACM, New York, NY, USA, 2014, ISSN: 978-1-4503-3212-5.

BibTeX

Stadler, Susanne; Weiss, Astrid; Tscheligi, Manfred

I Trained this Robot: The Impact of Pre-Experience and Execution Behavior on Robot Teachers Inproceedings

23rd IEEE International Symposium on Robot and Human Interactive Communication, 2014.

BibTeX

Stollnberger, Gerald; Moser, Christiane; Beck, Elke; Zenz, Cornelia; Tscheligi, Manfred; Szczesniak-Stanczyk, Dorota; Janowski, Marcin; Brzozowski, Wojciech; Blaszczyk, Regina L; Mazur, Michał; Wysokinski, Mariusz

Robotic Systems in Health Care Inproceedings

Proceedings of the 7th International Conference on Human System Interaction, pp. 276–281, 2014.

Abstract | Links | BibTeX

Stollnberger, Gerald; Moser, Christiane; Zenz, Cornelia; Tscheligi, Manfred; Szczesniak-Stanczyk, Dorota; Janowski, Marcin; Brzozowski, Wojciech; Wysokinski, Andrzej

Capturing Expected User Experience of Robotic Systems in the Health Care Sector Inproceedings

Proceedings of the ARW2014, pp. 42–46, 2014.

Abstract | BibTeX

2013

Mirnig, Nicole; Weiss, Astrid; Skantze, Gabriel; Moubayed, Samer Al; Gustafson, Joakim; Beskow, Jonas; Granström, Björn; Tscheligi, Manfred

Face-to-Face With a Robot: What do we actually talk about? Journal Article

International Journal of Humanoid Robots, 10 (1), pp. 23, 2013, ISSN: 0219-8436.

Links | BibTeX

Bruckenberger, Ulrike; Weiss, Astrid; Mirnig, Nicole; Strasser, Ewald; Stadler, Susanne; Tscheligi, Manfred

The Good, The Bad, The Weird: Audience Evaluation of a ''Real'' Robot in Relation to Science Fiction and Mass Media Inproceedings

Herrmann, Guido; Pearson, (Ed.): Social Robotics, pp. 301–310, Springer International Publishing, 2013.

Links | BibTeX

Mirnig, Nicole; Tan, Yeow K; Han, Boon S; Li, Haizhou; Tscheligi, Manfred

Screen Feedback: How to Overcome the Expressive Limitations of a Social Robot Inproceedings

Proceedings of the 22nd IEEE International Symposium on Robot and Human Interactive Communication, pp. 348–349, IEEE, Red Hook, NY, USA, 2013, ISSN: 1944-9445.

Links | BibTeX

Mirnig, Nicole

Development of a Taxonomy to Improve Human-robot-interaction Through Multimodal Robot Feedback Inproceedings

CHI '13 Extended Abstracts on Human Factors in Computing Systems, pp. 1945–1948, ACM, New York, NY, USA, 2013, ISSN: 978-1-4503-1952-2.

BibTeX

Stadler, Susanne; Weiss, Astrid; Mirnig, Nicole; Tscheligi, Manfred

Anthropomorphism in the Factory -- A Paradigm Change? Inproceedings

HRI '13: Proceedings of the 8th ACM/IEEE International Conference on Human Robot Interaction, 2013.

BibTeX

Stollnberger, Gerald; Weiss, Astrid; Tscheligi, Manfred

Input Modality and Task Complexity: Do they Relate? Inproceedings

HRI '13: Proceedings of the 8th ACM/IEEE International Conference on Human Robot Interaction, pp. 233–234, 2013.

Links | BibTeX

Stollnberger, Gerald; Weiss, Astrid; Tscheligi, Manfred

''The harder it gets'' : Exploring the Interdependency of Input Modalities and Task Complexity in Human-Robot Collaboration Inproceedings

Proceedings of the 22nd IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN)), pp. 264–269, IEEE, 2013.

Links | BibTeX

2012

Gonsior, Barbara; Landsiedel, Christian; Mirnig, Nicole; Sosnowski, Stefan; Strasser, Ewald; Buss, Martin; Kühnlenz, Kolja; Tscheligi, Manfred; Weiss, Astrid; Wollherr, Dirk; Złotowski, Jakub

Impacts of Multimodal Feedback on Efficiency of Proactive Information Retrieval from Task-Related HRI Journal Article

Journal of Computational Intelligence and Intelligent Informatics (JACIII), 16 (2), pp. 313–326, 2012, ISSN: 1343-0130.

BibTeX

Moubayed, Samer Al; Beskow, Jonas; Blomberg, Mats; Granström, Björn; Gustafson, Joakim; Mirnig, Nicole; Skantze, Gabriel

Talking with Furhat--multi-party interaction with a back-projected robot head Inproceedings

Proceedings of the Swedish Phonetiks Conference, pp. 109–112, University of Gothenburg, Gothenburg, Sweden, 2012, ISBN: 978-91-637-0985-2.

BibTeX

Moubayed, Samer Al; Beskow, Jonas; Granström, Björn; Gustafson, Joakim; Mirnig, Nicole; Skantze, Gabriel; Tscheligi, Manfred

Furhat goes to Robotville: A large-scale multiparty human-robot interaction data collection in a public space Inproceedings

pp. 22–25, online, 2012.

BibTeX

Buchner, Roland; Mirnig, Nicole; Weiss, Astrid; Tscheligi, Manfred

Evaluating in Real Life Robotic Environment -- Bringing together Research and Practice Inproceedings

Proceedings of the 21st IEEE International Symposium on Robot and Human Interactive Communication, pp. 602–607, IEEE, Red Hook, NY, USA, 2012, ISSN: 1944-9445.

BibTeX

Mirnig, Nicole; Gonsior, Barbara; Sosnowski, Stefan; Landsiedel, Christian; Wollherr, Dirk; Weiss, Astrid; Tscheligi, Manfred

Feedback Guidelines for Multimodal Human-Robot Interaction: How Should a Robot Give Feedback When Asking for Directions? Inproceedings

Proceedings of the 21st IEEE International Symposium on Robot and Human Interactive Communication, pp. 533–538, IEEE, Red Hook, NY, USA, 2012, ISSN: 1944-9445.

BibTeX

Mirnig, Nicole; Strasser, Ewald; Weiss, Astrid; Tscheligi, Manfred

Studies in Public Places as a Means to Positively Influence People's Attitude towards Robots Inproceedings

Proceedings of 4th International Conference on Social Robotics, pp. 209–218, Springer, Berlin, Germany, 2012, ISBN: 978-3-642-34102-1.

BibTeX

Stadler, Susanne; Riegler, Stefan; Hinterkörner, Stefan

Bzzzt: When Mobile Phones Feel at Home Inproceedings

CHI '12 Extended Abstracts on Human Factors in Computing Systems, pp. 1297–1302, ACM, New York, NY, USA, 2012, ISSN: 978-1-4503-1016-1.

BibTeX

2011

Mirnig, Nicole; Gonsior, Barbara; Wollherr, Dirk; Weiss, Astrid; Tscheligi, Manfred

Feedback in Human-Robot Interaction: How to Display a Robot's Internal System Status Inproceedings

Proceedings of the 3rd International Conference on Social Robotics, pp. adjunct proceedings, Springer, Berlin, Germany, 2011, ISSN: 0302-9743.

BibTeX

Mirnig, Nicole; Riegler, Stefan; Weiss, Astrid; Tscheligi, Manfred

A case study on the effect of feedback on itinerary requests in human-robot interaction Inproceedings

Proceedings of the 20th IEEE International Symposium on Robot and Human Interactive Communication, pp. 343–349, IEEE, Red Hook, NY, USA, 2011, ISBN: 978-1-4577-1571-6.

BibTeX

Mirnig, Nicole; Weiss, Astrid; Tscheligi, Manfred

A Communication Structure for Human-Robot Itinerary Requests Inproceedings

Proceeding of the 5th ACM/IEEE International Conference on Human-Robot Interaction, pp. 205–206, ACM, New York, NY, USA, 2011.

BibTeX

Weiss, Astrid; Mirnig, Nicole; Buchner, Roland; Förster, Florian; Tscheligi, Manfred

Transferring Human-Human Interaction Studies to HRI Scenarios in Public Space Inproceedings

Proceedings of the 13th IFIP TC13 Conference on Human-Computer Interaction, pp. 230–247, Springer, Heidelberg, Germany, 2011, ISSN: 0302-9743.

BibTeX