A modulator for Audio Event Expressions

A new modulator to retrieve and use Audio Event Expressions data from audio clips.

When Bitwig analyses audio events (samples), it creates expressions for Onsets, Stretch, Gain, Pan, and Pitch. For instance, in the case of Onsets, it puts onset markers with sensitivity parameter that you can see and edit in inspector panel, and you can also put new onsets yourself.

There is potential to use this data as modulators. For instance, the Onsets modulation data could be used to improve the sensitivity of Replacer. Right now this device is just sensitive to threshold rather than transient or specific onset. Through this new modulator, replacer could be improved to react on onsets and then release note depending on threshold crossing. Then we could also use the new modulator to map velocity for generated notes, tapping into its sensitivity value.

The current Expressions modulator could be renamed “Note Expressions”, since it works with Note Events Expressions.

Onsets in an audio clip (image from the Bitwig User Guide).

What problem(s) would this feature resolve?

A current limitation to use Audio Events Expressions data for creative purposes. Also lack of precision of Replacer for note generation, limiting the possibilities for effects or splicing/replacement of audio.

How does this feature fit in Bitwig as a product?

It builds on Bitwig features such as Expressions and modulators.

Is there already an alternative way to achieve this on Bitwig?

Currently there’s no way to extract Onset data, especially as the clip plays.

Could it be implemented using Bitwig components or APIs, without Bitwig team’s support?

Probably no.

Could it be provided by a VST or something else reasonably integrated with Bitwig?

No, there are transient shapers and splitters, but that’s not the point. Onsets can be added manually and not necessarily where transients are.

Are there other products that offer this feature?

Not that we know of.


8 posts were split to a new topic: [Draft discussion] A modulator for Audio Event Expressions