Awasqa Kayku

Augmented reality App for image sonification in real-time.

The Awasqa Kayku app delivers an Augmented Reality experience that offers the user the possibility to sonify (turn images and its properties, into sound) its camera feed real-time. Using Computer Vision, contours (shapes) and colors are recognized, which in turn are mapped and expressed as various sounds that change depending on the image and its parts. The contours are then visualized as 3D structures over the camera feed. This app is developed as an artwork from the Tangente Festival in St.Pölten, Austria.