This C++ project was a combination of the OpenCV open computer vision library tools and the DirectX 3D renderer. Made for a student project at the University of Huddersfield.

The final product is an executable file that launches a fully 3D rendered scene complete with textures, normal maps, shaders, lighting, and limited player input for basic fly-around capabilities.

When the program launches, it opens an OpenCV overlay, given you have a webcam plugged in. The OpenCV webcam is designed to detect 3 bright colours; red, green, blue. I used brightly coloured marker pens to demonstrate using this system to control a DirectX game screen to play a hide-and-seek game with ghosts.

You may wave any of the coloured pens to control the game (it prioritises them in order of red -> green -> blue). The pen controls a “torch” which illuminates the screen so you can catch ghosts that spawn in around the screen to gather score.