Sonifying the Shape of Human Body Motion using Motiongrams

Authors

  • Alexander Refsum Jensenius
  • Rolf Inge God

DOI:

https://doi.org/10.18061/emr.v8i2.3926

Keywords:

sonomotiongram, motiongram, sonification, music-related motion

Abstract

The paper presents sonomotiongram, a technique for the creation of auditory displays of human body motion based on motiongrams. A motiongram is a visual display of motion, based on frame differencing and reduction of a regular video recording. The resultant motiongram shows the spatial shape of the motion as it unfolds in time, somewhat similar to the way in which spectrograms visualise the shape of (musical) sound. The visual similarity of motiongrams and spectrograms is the conceptual starting point for the sonomotiongram technique, which explores how motiongrams can be turned into sound using “inverse FFT”. The paper presents the idea of shape-sonification, gives an overview of the sonomotiongram technique, and discusses sonification examples of both simple and complex human motion.

Downloads

Published

2013-10-24

How to Cite

Jensenius, A. R., & God, R. I. (2013). Sonifying the Shape of Human Body Motion using Motiongrams. Empirical Musicology Review, 8(2), 73–83. https://doi.org/10.18061/emr.v8i2.3926