Skip to content

MGT-python: Musical Gestures Toolbox

PyPi version GitHub license CI Documentation

The Musical Gestures Toolbox for Python is a comprehensive collection of tools for visualization and analysis of audio and video, with a focus on motion capture and musical gesture analysis.

MGT python demo

What is MGT-python?

MGT-python provides researchers, artists, and developers with powerful tools to:

  • Analyze motion in video recordings
  • Extract audio features from multimedia files
  • Generate visualizations like motiongrams, videograms, and motion history images
  • Process and manipulate video content with computer vision techniques
  • Integrate seamlessly with scientific Python ecosystem (NumPy, SciPy, Matplotlib)

Key Features

🎥 Video Analysis

  • Motion detection and tracking
  • Optical flow analysis
  • Frame differencing and motion history
  • Video preprocessing (cropping, filtering, rotation)

🎵 Audio Processing

  • Waveform analysis and visualization
  • Spectrograms and chromagrams
  • Tempo and beat tracking
  • Audio feature extraction

📊 Visualization Tools

  • Motiongrams (motion over time)
  • Videograms (pixel intensity over time)
  • Average images and motion plots
  • Interactive plotting with Matplotlib

🔧 Utilities

  • Video format conversion
  • Batch processing capabilities
  • Integration with OpenPose for pose estimation
  • Export functionality for further analysis

Quick Start

Installation

pip install musicalgestures

Basic Usage

import musicalgestures as mg

# Load a video
mv = mg.MgVideo('dance.avi')

# Generate motion analysis
motion = mv.motion()

# Create visualizations
motiongram = mv.motiongrams()
average_image = mv.average()

# Audio analysis
audio = mg.MgAudio('music.wav')
spectrogram = audio.spectrogram()

Try it Online

Open In Colab

Getting Started

Academic Background

This toolbox builds upon years of research in musical gesture analysis:

Support and Community

Citation

If you use MGT-python in your research, please cite:

@software{mgt_python,
  title={Musical Gestures Toolbox for Python},
  author={University of Oslo fourMs Lab},
  url={https://fourms.github.io/MGT-python/},
  version={1.3.2},
  year={2024}
}

License

MGT-python is released under the GNU General Public License v3 (GPLv3).


Ready to explore musical gestures? Start with our Quick Start Guide or jump into the examples!