House of Claire
deep fake project

 
2018 Spring
tech: deep fake, Amazon Rekognition, tensorflow, openCV, python 3.7
platform: ubuntu 16.04, i7-7700k, GTX 1080ti

After #metoo movement lot of stars like Kevin Spacey was accused of sexual harassment. I read about people wanting them removed from all of their work. I wondered if using facial recognition and deep fake i would be able to replace problematic individuals from existing films?

1. Find Kevin Spacey.

Using Amazon ReKognition I was able to body track Kevin spacey every 5 frame. Notice Amazon Rekognition was able to track Kevin Spacey was looking away(no face to track).

2. Prepare data for training

I needed to prepare images of Kevin Spacey and Robin Wright. I used openCV to find face and crop them. Also blurred him.

3. Replace Kevin Spacey with Robin Wright

I trained Kevin Spacey and Robing Wright from interview and was ready to deep fake onto whole Season 1 Episode 1 frame ready. I ran a test on short video but this turned out very disturbing. So I did not proceed deep fake anymore.