Software & Data Downloads — HMIS

Many sounds that humans encounter are hierarchical in nature; a piano note is one of many played during a performance, which is one of many instruments in a band, which might be playing in a bar with other noises occurring. Inspired by this, we re-frame the musical source separation problem as hierarchical, combining similar instruments together at certain levels and separating them at other levels. This allows us to deconstruct the same mixture in multiple ways, depending on the appropriate level of the hierarchy for a given application. In this software package, we present pytorch implementations of various methods for hierarchical musical instrument separation, with some methods focusing on separating specific instruments (like guitars) and other methods that determine what to separate based on a user-supplied audio example.

• Related Publications

   Manilow, E., Wichern, G., Le Roux, J., "Hierarchical Musical Instrument Separation", International Society for Music Information Retrieval (ISMIR) Conference, October 2020, pp. 376-383.

  BibTeX TR2020-136 PDF Software

  • @inproceedings{Manilow2020oct,
  • author = {Manilow, Ethan and Wichern, Gordon and Le Roux, Jonathan},
  • title = {Hierarchical Musical Instrument Separation},
  • booktitle = {International Society for Music Information Retrieval (ISMIR) Conference},
  • year = 2020,
  • pages = {376--383},
  • month = oct,
  • isbn = {978-0-9813537-0-8},
  • url = {https://www.merl.com/publications/TR2020-136}
  • }

Access software at https://github.com/merlresearch/hierarchical_music_separation.