"F.P.S." is a sci-fi VR game with full-body gestures from 2015. The game was developed in the context of courses at the university. Equipped with a head-mounted display and full body tracking, you enter a virtual world and take the role of a soldier who must explore an unknown island. While exploring the island on a floating platform, you fight attacking drones with unique skills of your battle suit, which you trigger by full-body gestures.
Technology: For this game, we tried to achieve maximal immersion and embodiment by implementing full body gesture input using multiple Kinect cameras in combination with a VR head-mounted display. The main technical challenge was to implement the sensor fusion for the multi-sensor setup comprising multiple Kinect camera systems. This system enabled us to design a game that can provide 360 degree full-body gesture input without additional devices that have to be worn by the user.
Gameplay: In the game, you step into the role of a futuristic soldier. The game itself consists of multiple levels. Starting in a virtual environment, an A.I. welcomes you, who introduces you to the story and your battle suit with all the gameplay mechanics. In the next level, you explore a futuristic island on a hovering platform while being under attack by hostile drones, completing your mission on the island.
A core feature of the game is the combat system. We wanted to achieve a feeling of wearing a powerful battle suit that you can control with your body motion. With our tracking system, we can use your posture as input. You aim with your arms and activate abilities using specific hand gestures.