Sonifying the Shape of Human Body Motion using Motiongrams

Alexander Refsum Jensenius, Rolf Inge Godøy

Abstract


The paper presents sonomotiongram, a technique for the creation of auditory displays of human body motion based on motiongrams. A motiongram is a visual display of motion, based on frame differencing and reduction of a regular video recording. The resultant motiongram shows the spatial shape of the motion as it unfolds in time, somewhat similar to the way in which spectrograms visualise the shape of (musical) sound. The visual similarity of motiongrams and spectrograms is the conceptual starting point for the sonomotiongram technique, which explores how motiongrams can be turned into sound using “inverse FFT”. The paper presents the idea of shape-sonification, gives an overview of the sonomotiongram technique, and discusses sonification examples of both simple and complex human motion.


Keywords


sonomotiongram; motiongram; sonification; music-related motion

Full Text:

PDF HTML


DOI: http://dx.doi.org/10.18061/emr.v8i2.3926

Refbacks

  • There are currently no refbacks.


Copyright (c) 2013 Alexander Refsum Jensenius, Rolf Inge Godøy

Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

 


Beginning with Volume 7, No 3-4 (2012), Empirical Musicology Review is published under a Creative Commons Attribution-NonCommercial license

Empirical Musicology Review is published by The Ohio State University Libraries.

If you encounter problems with the site or have comments to offer, including any access difficulty due to incompatibility with adaptive technology, please contact libkbhelp@lists.osu.edu.

ISSN: 1559-5749