TrackOSC

Turn your iPhone into a wireless motion-tracking camera: body, hand and face tracking streamed live over OSC to TouchDesigner, Max, Processing and more.

TrackOSC turns your iPhone into a wireless motion-tracking camera. Point it at a person and it streams live tracking data — body poses, hand poses, face landmarks, recognized text, and animals — over your local network as OSC (Open Sound Control) messages, ready for TouchDesigner, Max/MSP, Processing, openFrameworks, Unity, or anything else that speaks OSC.

All processing happens on-device with Apple's Vision framework. No video ever leaves your phone — only numbers.

FEATURES • Live tracking overlays on the camera view: body skeleton, hand skeletons, face box, jawline contour and landmarks, text and animal boxes • Per-detector toggles — run just what you need for the best frame rate • Front or back camera, with a natural selfie mirror (wire data is never mirrored) • Portrait and landscape, with an orientation lock for phones mounted on tripods and rigs • Automatic discovery of receivers on your network via Bonjour — or type any IP and port • Hide-video mode: tracking overlay only, on black — for stage and installation use • A free, notarized macOS receiver and a hackable open-source Processing sketch are available from the project page

COMPATIBILITY TrackOSC speaks exactly the same OSC wire format as VisionOSC and PoseOSC, so existing receivers and patches work unchanged. Coordinates are in pixels, origin top-left, with the frame dimensions in every message.

PRIVACY No accounts, no analytics, no ads. Camera frames are analyzed on the device and discarded; tracking data is sent only to the destination you choose.

TrackOSC is open source: https://github.com/JGL/TrackOSC