When the world gets closer.

We help you see farther.

Sign up to our expressly international daily newsletter.

GAZETA WYBORCZA

Mozart Is Yellow: How A Self-Professed Cyborg *Listens* To Colors

Neil Harbisson was colorblind, until he strapped on an "eyeborg" and connected his mind's vision to what he was hearing.

Neil Harbisson listening to music with his "eyeborg"
Neil Harbisson listening to music with his "eyeborg"
Aleksandra Lipczak

Until the age of 11, Neil Harbisson, 31, didn’t know that what he was seeing weren’t colors but shades of grey. He was finally diagnosed with achromatopsia, a rare and incurable vision disorder.

When studying music composition in London, he met a cybernetic fan who agreed to help him extend his sense of vision. Together they’ve created the “eyeborg,” a device mounted to the head that provides the ability to perceive colors trough hearing.

GAZETA WYBORCZA: What is exactly the eyeborg?
NEIL HARBISSON: The model I’m using now consists of a head-mounted camera that senses colors in front of me and translates colors in real-time into sound waves, thanks to a chip pressed to the back of my head, I can now hear colors trough the bone, like dolphins. This year I’m undergoing a first-of-its-kind surgery to place the chip inside my head.

Why sounds?
Colors and sounds have something in common: the color of a light wave corresponds to an audio frequency. The electronic eye translates the color it is pointed at into the corresponding sound. It can also transform the saturation to the volume: I can hear vivid red stronger than pale green.

At first, I was translating colors as if I was studying a new language. At some point there was a click between the software and my brain. Then, the emotions came. In my dreams I was looking at the sky and I could hear a very clear Cis.

To see only in black and white, is it like turning off the colors in TV?
For you it’s always “turning off” – a loss. Maybe it’s you who cannot see the world in black and white? I used to hate colors; sooner or later they appear in every conversation: the Red Cross, green tea. I had to smell the glass to know what I was drinking. I was embarassed. I’ve never felt handicapped though, just excluded.

Can you now recognize all 360 colors?
I can do more. I’ve decided to extend my vision spectrum to ultraviolet and infrared. But at the same time, with my eyes closed I can’t know if a person in front of me is black or white: skin always sounds orange, there’s just a bit more red or yellow in the background. I need to open my eyes and see if the skin tone is dark or fair.

Your outfit is very colorful.
I used to dress exclusively in black and white – I couldn’t stand the thought that I didn’t know what I was wearing. Now, I try to compose my outfit so that it sounds well. I’m currently working on a fashion line – you could wear your favorite song as a T-shirt. I also make “sound portraits” of famous people. By the way, a person who doesn’t have harmonious features may sound surprisingly well, for example Prince Carol sounds similarly to Nicole Kidman.

How do I sound?
Your hair is a G. Eyes, wait a minute – he points his eyeborg on me –, one is an Ais and the other one is a B. They never sound the same. Your lips are an E, your skin a Fis. People whose eyes and hair have a similar color sound uniformly whereas in your case there’s a contrast; that’s nice.

Do you sometimes take a break from the eyeborg?
No, never. If I want to turn it off, I point it towards the ceiling. At home I have my bedroom in black and white because the eyeborg doesn’t react to those colors.

What’s your favorite one?
Eggplant. It has a beautiful, strong and high sound. Violet is by the way very dangerous, it has the highest frequency, hence sounds aggressively. The traffic lights should have violet instead of red, which has a very low frequency and sounds soft and innocent.

Which painter sounds best?
Warhol, Miró, Rothko, because they sound very clear. Da Vinci, Velázquez and Munch, on the contrary, used various shades of the same color, so they emit many similar sounds. It’s like horror music.

Do you hear colors when listening to music?
Mozart is yellow, Beethoven is violet or blue. But since I’ve been using the eyeborg, the classical music seems very basic. It’s all about 12 colors repeating themselves on and on. I prefer listening to electronic music. I also really enjoy instruments out of key. An unknown shade of turquoise may suddenly pop up.

You claim to be the first cyborg recognized by a government.
In 2004, when renewing my British passport, the administration wouldn’t allow me to attach a photo with the eyeborg on my head. Finally, with a medical expertise and a letter from the university, I succeeded in persuading them that the eyeborg is a part of my body. So now in my passport I have a photo with the electronic eye. One can say I’m officially a cyborg.

You've reached your monthly limit of free articles.
To read the full article, please subscribe.
Get unlimited access. Support Worldcrunch's unique mission:
  • Exclusive coverage from the world's top sources, in English for the first time.
  • Stories from the best international journalists.
  • Insights from the widest range of perspectives, languages and countries
Already a subscriber? Log in

When the world gets closer, we help you see farther

Sign up to our expressly international daily newsletter!
food / travel

Denied The Nile: Aboard Cairo's Historic Houseboats Facing Destruction

Despite opposition, authorities are proceeding with the eviction of residents of traditional houseboats docked along the Nile in Egypt's capital, as the government aims to "renovate" the area – and increase its economic value.

Houseboats on the Nile in Zamalek, Cairo

Ahmed Medhat and Rana Mamdouh

With an eye on increasing the profitability of the Nile's traffic and utilities, the Egyptian government has begun to forcibly evict residents and owners of houseboats docking along the banks of the river, in the Kit Kat area of Giza, part of the Greater Cairo metropolis.

The evictions come following an Irrigation Ministry decision, earlier this month, to remove the homes that have long docked along the river.

Keep reading...Show less

When the world gets closer, we help you see farther

Sign up to our expressly international daily newsletter!
You've reached your monthly limit of free articles.
To read the full article, please subscribe.
Get unlimited access. Support Worldcrunch's unique mission:
  • Exclusive coverage from the world's top sources, in English for the first time.
  • Stories from the best international journalists.
  • Insights from the widest range of perspectives, languages and countries
Already a subscriber? Log in
THE LATEST
FOCUS
TRENDING TOPICS

Central to the tragic absurdity of this war is the question of language. Vladimir Putin has repeated that protecting ethnic Russians and the Russian-speaking populations of Ukraine was a driving motivation for his invasion.

Yet one month on, a quick look at the map shows that many of the worst-hit cities are those where Russian is the predominant language: Kharkiv, Odesa, Kherson.

Watch VideoShow less
MOST READ