Link Search Menu Expand Document

ossia

Advanced Examples

Choose a technique here when you want to change how a work behaves, not only replace its source material: disrupt a live image, perform by changing code, hear a dataset or switch whole treatments on musical boundaries.

If connecting different media is still new, begin with Multi-media patching. It connects sound analysis, MIDI and automation to a textured 3D image and is filed under Basics.

Examples by goal

  • How can a camera image lose its stability? See CPU data bending, with three distressed views beside the original, and GPU data bending, where motion, sorting and retained images become visual material.
  • Can the rules change during the performance? Livecoding processes lets you edit a signal, a shader image and a custom interface while their sections run.
  • How can a piece change treatment without stopping? Switch audio and video pipelines alternates effects at musical boundaries while their sources continue.
  • What does a dataset reveal by eye and ear? Data visualization and sonification turns one curve into a growing point history and synthesized sound.
  • How can text and recorded control values be reused? Files, strings and serialization paces text, transforms it, and records device values for replay.

For programmable processing, see JavaScript / QML, C++ JIT, Expressions and Compute Shaders. Classifier and Regressor cover learned mappings and their requirements.

For smaller control graphs, visit Data processing. For camera-based recognition and ways to use its results, see AI and tracking.

Table of contents