Sound Art Zone Sound Culture and Creative Freedom
Kenji Kojima has been experimenting with the relationships between perception and cognition, technology, music and visual art since early 90s. Born in Japan, and moved to New York in 1980. He created RGB Music series, an interdisciplinary work exploring the relation between images and music. In 2008, as part of the series, the sound installation “Subway Synesthesia” exhibited in New York City. The RGB Music series has exhibited in media art festivals worldwide, including Europe, Brazil, and the first online exhibition by ACM SIGGRAPH.
The software programmed by Kenji Kojima captured and compared the brightness data of 84 divided image areas then the two largest different data were converted to musical notes and played computer instruments.
小島のプログラムしたソフトウエアが84のグリッドに分割したビデオ画面の明暗のデータを採取し、前の画面との違いの大きな２箇所のデータを音符に変換して演奏し、ビデオ撮影時の環境音に重ねます。
source: http://www.kenjikojima.com