Face Tracking

The Powers of Katsu

A film about scale, starring graffiti legend Katsu and based on the 1977 classic "Powers of 10" by Charles & Ray Eames. Directed by Nick Poe & Alex Kalman of Red Bucket Films. WIth Troy Lumpkin and The Chunnel.

https://www.youtube.com/watch?v=6UK6_cp5Q6I

Face Tracking

Face Tracker

FaceTracker is a library for deformable face tracking written in C++ using OpenCV 2, authored by Jason Saragih and maintained by Kyle McDonald.
https://github.com/kylemcdonald/FaceTracker
They adapt the original code to work on Android, OpenFrameworks, and Python.
Open Framework: https://github.com/kylemcdonald/ofxFaceTracker

##Face OSC - Stand-alone application that uses FaceTracker - Transmits facial feature data via Open Sound Control - Allows use of the tracking data in other applications that can receive OSC: Processing, Pure Data, Ableton Live, Quartz Composer etc. Download FaceOSC: https://github.com/kylemcdonald/ofxFaceTracker/releases (.zip) Kyle McDonald presenting FaceOSC https://vimeo.com/26098366 http://makematics.com/research/facetracker/ (interview)

###Examples: - Face substitution: https://vimeo.com/29348533 - Smile TV: http://www.creativeapplications.net/maxmsp/smile-tv-works-only-when-you-smile/ - Kyle McDonald : http://createdigitalmusic.com/2011/07/music-with-your-face-artist-kyle-mcdonald-talks-face-tracking-music-making-with-kinect/ - Dance with your face : https://www.youtube.com/watch?v=dplBh_rxoUc - All the Universe is Full of the Lives of Perfect Creatures: https://vimeo.com/35262930

##Let's Go Download FaceOSC: https://github.com/kylemcdonald/ofxFaceTracker/releases (.zip)

###Changing faceOSC settings: Inside the FaceOSC package there is an xml file called settings.xml. Right Click → Show Package Content → data → settings.xml **port**: must be the same in both applications (defaults to 8338) **host**: localhost will send to the same computer otherwise find the correct ip address of the computer you are sending to.

###OSC Messages: - OSC uses an address protocol to identify data sent - Associated with the address are values in sequence - For example, FaceOSC sends a single integer value (0 or 1) with the address: /found

### FaceOSC address specification: ####Always sent - **/found i:** 0 or 1 if a face is currently being tracked ####Sent when a face is being tracked - **/pose/position ff:** center coordinate position of the tracked face in the capture dimensions (camera w & h,default is 640x480) - **/pose/scale f:** size of the tracked face (smaller when farther from the camera) - **/pose/orientation fff:** 3d vector denoting the orientation of the tracked face (looking left, angled, down, etc) - **/gesture/mouth/width f:** left to right of mouth - **/gesture/mouth/height f:** top to bottom of inner mouth - **/gesture/eyebrow/left f:** center of the eye to middle of eyebrow - **/gesture/eyebrow/right f:** center of the eye to middle of eyebrow - **/gesture/eye/left f:** upper inner eye to lower outer eye - **/gesture/eye/right f:** upper inner eye to lower outer eye - **/gesture/jaw f:** nose center to chin center - **/gesture/nostrils f:** left side of nose to right side of nose https://github.com/kylemcdonald/ofxFaceTracker/wiki/Osc-message-specification

###Face OSC Templates https://github.com/CreativeInquiry/FaceOSC-Templates