Face DJ

Face DJ is a face-controlled DJ web application that works in Chrome or Firefox.

The app uses the Tensorflow Facemesh library to accurately detect facial movements and use these data to control music.

I created this app to explore how face-detection technology can be used for controlling/producing music and to provide a more immersive musical experience.

Here's the Live Demo on Glitch.

You need a webcam, headphones, and a microphone to fully use this app. Please try the app in the latest version of Chrome or Firefox. (Safari is currently not supported)

Features

  • Moving your head by X, Y position changes the song pattern.

  • Moving your head by Z position changes the volume.

  • Tilting the head based on the Y-axis controls the panning.

  • Tilting the head based on the X-axis controls the filter cutoff.

  • Opening/closing your mouth controls the filter resonance.

  • Saying something to the microphone plays a vocoder.

For more information, please visit https://github.com/cuinjune/face-dj

© 2020 Zack Lee. All Rights Reserved.