iPhoneX came out with facial recognition feature and face id. I wanted to know how much data is available in their API. I built custom iOS app to stream facial geometry and camera image to create a mask. Processed it with houdini and I was able to put my boss’s face on to me live!

Turned out API it self doesn’t give out geometry of face but does provide UV for face. Well it wasn’t too hard to get geometric information of the user.

I use the UV and capture image from iPhoneX but textured on my face’s geometry. So not really like the movie face off, just swapping skin.