Sonifying the Shape of Human Body Motion using Motiongrams
Keywords:sonomotiongram, motiongram, sonification, music-related motion
The paper presents sonomotiongram, a technique for the creation of auditory displays of human body motion based on motiongrams. A motiongram is a visual display of motion, based on frame differencing and reduction of a regular video recording. The resultant motiongram shows the spatial shape of the motion as it unfolds in time, somewhat similar to the way in which spectrograms visualise the shape of (musical) sound. The visual similarity of motiongrams and spectrograms is the conceptual starting point for the sonomotiongram technique, which explores how motiongrams can be turned into sound using “inverse FFT”. The paper presents the idea of shape-sonification, gives an overview of the sonomotiongram technique, and discusses sonification examples of both simple and complex human motion.
Copyright (c) 2013 Alexander Refsum Jensenius, Rolf Inge Godøy
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.