“Wave” is a project developed in Max MSP that analyses a video stream and understands the tone of a scene by looking at the prevalent colour in it, and then generates a suitable melody based on a synesthetic association between said colour and the feeling it conveys.

The melodies are generated by Music Transformer, an “attention-based” neural web capable of creating music with a special focus on long term coherence of musical constructs. These melodies are equalized and worked on through Ableton before being input in Max MSP.

“Wave” is a project developed in Max MSP that analyses a video stream and understands the tone of a scene by looking at the prevalent colour in it, and then generates a suitable melody based on a synesthetic association between said colour and the feeling it conveys.

The melodies are generated by Music Transformer, an “attention-based” neural web capable of creating music with a special focus on long term coherence of musical constructs. These melodies are equalized and worked on through Ableton before being input in Max MSP.

“Wave” is a project developed in Max MSP that analyses a video stream and understands the tone of a scene by looking at the prevalent colour in it, and then generates a suitable melody based on a synesthetic association between said colour and the feeling it conveys.

The melodies are generated by Music Transformer, an “attention-based” neural web capable of creating music with a special focus on long term coherence of musical constructs. These melodies are equalized and worked on through Ableton before being input in Max MSP.