"See Sound..."

Here's a somewhat random collection of sounds and their visualised timbres. So we took random samples and visualised their timbre. Then we created an animation that shows a time indicator to help you align the timbre you hear with its location in the visualisation. Because the timbre of the sound evolves over time, its visual representation creates a unique pattern, like a fingerprint. (Horizontal axis is time, vertical axis is phase, colouring is amplitude of the original sound).

Flutes
Pianos
Audio-synthesizer "Strings" patches
Organs

 

Now - how about the opposite, let's start with an image. If this image was the visual representation of a timbre, what sound would it correspond to ? Here's a few examples again:

"...Hear Images"

Image-based audio synthesis: outputs of image synthesis algorithms and their corresponding mappings back to sounds
Audio synthesis via painting: images drawn with a graphics tool and their corresponding sounds

Sunics technology transforms sound to image - and vice versa. Sounds can be viewed, recognised, enhanced, modified and even synthesised via their corresponding image. The examples on this page illustrate how image processing turns into audio processing. The images show the timbres (cyclograms) of Sunics.

 

Noise Removal: irregular background noises are easily removed by removing visual noise.

A simple way to accomplish this is to apply a'blur' effect to the cyclogram.

This removal of visual noise removes the background noise in the corresponding audio signal

 

Example 1: an opera singer disturbed by a train noise in the background before (left) and after (right) applying a 'blur' effect to the waveshape.

 

Sound Source Separation: sounds mixed together can be separated again.

Selecting one sound component and applying above removal process extracts the selected component.

Selection is accomplished via appropriate choice of pitch.

Example 2: tuning into the vocals of a music piece (left) and applying a 'blur' effect to the waveshape extracts the vocals from the piece (right).

 

 

Audio Synthesis: create an image - create a sound.

Each image corresponds to a unique sound.

Transforming an image that was created via synthesis or capture to its corresponding sound therefore produces an entirely new sound.

Example 3: a drawing (left), fractal (center) and synthesised pattern (right) are each transformed to their corresponding audio, generating a variety of sounds.

 

 

Modification:cut/copy/paste can be used to replicate/remove sound features.

Audio features appear as distinct image features. Cutting/copying/pasting these features allows to move, replicate or remove the corresponding audio features.

 

Example 4: an audio feature of the original sound (top) is replicated (center) and removed (bottom) by replicating/removing the corresponding image feature. The narrow red region in the cyclograms (left column) corresponds to several intervals in the time-waveform (right column).

 

The last example also illustrates how in contrast to traditional tools, modifications can be performed in time and phase direction: selecting a region in the cyclogram corresponds to selecting several successive intervals in the time domain. Cutting/copying/pasting this region then applies to all these intervals simultaneously.