Human Robot Collaboration in different forms

In the dynamic environment of human-robot collaboration, a key for boosting the efficiency of human workers is supporting them with context-dependent work instructions.
The instructions should be delivered via communication modalities that suit the actual context.
The other way around, workers should be supported in controlling the robot or another component of the production system by using the most convenient modality, thus adding possibilities and eliminating the limitations of traditional interfaces like push buttons installed at fixed locations.


We have developed a context-dependent multi-modal communication in a collaborative work environment and its implementation in a Human-Machine Interface Controller system.

1. Projector- and camera-based interface: Safety region projected (ceiling mounted projector), and Projected virtual buttons actively monitored by Kinect v2.
2. Introduction of 3D maps of the environment: Recognition of anomalies in the work area using depth information→ highlight, Violating the safety region by hand or fingers stops the robot, Automatic and manual anomalies (by interface) confirmation, and New path planning for obstacle avoidance (To be integrated).

Play video on YouTube (opens in new tab)

Virtual Reality in Human-Robot Collaboration Design

Utilizing VR for Human-Robot Collaboration design.
Whole design chain from plan to movement.
Assessments for Safety, Quality, Ergonomics and Productivity.