Using Google Glass in human-robot swarm interaction

Abstract

We study how a human operator can guide a swarm of robots when transporting a large object through an environment with obstacles.

The operator controls a leader robot that influences the other robots of the swarm. Follower robots push the object only if they have no line of sight of the leader. The leader represents a way point that the object should reach.

By changing its position over time, the operator effectively guides the transporting robots towards the final destination.

The operator uses the Google Glass device to interact with the swarm. Communication is achieved with touch and voice commands. The interaction is supported by a graphical user interface.

Experimental results with 20 physical e-puck robots show that the human-robot interaction allows the swarm to transport the object through a complex environment.

Robot experiments

Collective transport with human interaction