A Visual Programming Language for Live Video Sonification

Diaz-Marino, R. (2008)
A Visual Programming Language for Live Video Sonification. Master's thesis, Department of Computer Science, University of Calgary, Calgary, Alberta, Canada, March.

View Publication and Related Materials

PDF PaperPDF Paper (2008-DiazMarino-MScThesis.pdf)

Abstract

The problem explored in this thesis is how to allow a person to map features from multiple video streams, or parts of those video streams, into an audio space, and how they can then monitor the resulting soundscape. I consider the requirements, user interface and architecture of a system that lets an end-user configure a video-only stream so that it generates an audio soundscape. In particular, I present a programming by demonstration environment called Cambience. Using this system, end users can map visual characteristics collected from video regions onto audio samples, and assemble the audio stream in a way that creates a meaningful soundscape. Cambience is used to mitigate a simple scenario between two distance separated collaborators and a shared resource. The wide range of visual programming elements allow for complex sonification behavior. Informal evaluations of the system show that Cambience has real usefulness with mostly minor considerations

Bibtex entry

@MASTERSTHESIS { 2008-DiazMarino-MScThesis,
CLASS = { THESIS },
AUTHOR = { Diaz-Marino, R. },
TITLE = { A Visual Programming Language for Live Video Sonification },
SCHOOL = { Department of Computer Science, University of Calgary },
ADDRESS = { Calgary, Alberta, Canada },
YEAR = { 2008 },
MONTH = { March },
}