When the world gets closer.

We help you see farther.

Sign up to our expressly international daily newsletter.

GAZETA WYBORCZA

Mozart Is Yellow: How A Self-Professed Cyborg *Listens* To Colors

Neil Harbisson was colorblind, until he strapped on an "eyeborg" and connected his mind's vision to what he was hearing.

Neil Harbisson listening to music with his "eyeborg"
Neil Harbisson listening to music with his "eyeborg"
Aleksandra Lipczak

Until the age of 11, Neil Harbisson, 31, didn’t know that what he was seeing weren’t colors but shades of grey. He was finally diagnosed with achromatopsia, a rare and incurable vision disorder.

When studying music composition in London, he met a cybernetic fan who agreed to help him extend his sense of vision. Together they’ve created the “eyeborg,” a device mounted to the head that provides the ability to perceive colors trough hearing.

GAZETA WYBORCZA: What is exactly the eyeborg?
NEIL HARBISSON: The model I’m using now consists of a head-mounted camera that senses colors in front of me and translates colors in real-time into sound waves, thanks to a chip pressed to the back of my head, I can now hear colors trough the bone, like dolphins. This year I’m undergoing a first-of-its-kind surgery to place the chip inside my head.

Why sounds?
Colors and sounds have something in common: the color of a light wave corresponds to an audio frequency. The electronic eye translates the color it is pointed at into the corresponding sound. It can also transform the saturation to the volume: I can hear vivid red stronger than pale green.

At first, I was translating colors as if I was studying a new language. At some point there was a click between the software and my brain. Then, the emotions came. In my dreams I was looking at the sky and I could hear a very clear Cis.

To see only in black and white, is it like turning off the colors in TV?
For you it’s always “turning off” – a loss. Maybe it’s you who cannot see the world in black and white? I used to hate colors; sooner or later they appear in every conversation: the Red Cross, green tea. I had to smell the glass to know what I was drinking. I was embarassed. I’ve never felt handicapped though, just excluded.

Can you now recognize all 360 colors?
I can do more. I’ve decided to extend my vision spectrum to ultraviolet and infrared. But at the same time, with my eyes closed I can’t know if a person in front of me is black or white: skin always sounds orange, there’s just a bit more red or yellow in the background. I need to open my eyes and see if the skin tone is dark or fair.

Your outfit is very colorful.
I used to dress exclusively in black and white – I couldn’t stand the thought that I didn’t know what I was wearing. Now, I try to compose my outfit so that it sounds well. I’m currently working on a fashion line – you could wear your favorite song as a T-shirt. I also make “sound portraits” of famous people. By the way, a person who doesn’t have harmonious features may sound surprisingly well, for example Prince Carol sounds similarly to Nicole Kidman.

How do I sound?
Your hair is a G. Eyes, wait a minute – he points his eyeborg on me –, one is an Ais and the other one is a B. They never sound the same. Your lips are an E, your skin a Fis. People whose eyes and hair have a similar color sound uniformly whereas in your case there’s a contrast; that’s nice.

Do you sometimes take a break from the eyeborg?
No, never. If I want to turn it off, I point it towards the ceiling. At home I have my bedroom in black and white because the eyeborg doesn’t react to those colors.

What’s your favorite one?
Eggplant. It has a beautiful, strong and high sound. Violet is by the way very dangerous, it has the highest frequency, hence sounds aggressively. The traffic lights should have violet instead of red, which has a very low frequency and sounds soft and innocent.

Which painter sounds best?
Warhol, Miró, Rothko, because they sound very clear. Da Vinci, Velázquez and Munch, on the contrary, used various shades of the same color, so they emit many similar sounds. It’s like horror music.

Do you hear colors when listening to music?
Mozart is yellow, Beethoven is violet or blue. But since I’ve been using the eyeborg, the classical music seems very basic. It’s all about 12 colors repeating themselves on and on. I prefer listening to electronic music. I also really enjoy instruments out of key. An unknown shade of turquoise may suddenly pop up.

You claim to be the first cyborg recognized by a government.
In 2004, when renewing my British passport, the administration wouldn’t allow me to attach a photo with the eyeborg on my head. Finally, with a medical expertise and a letter from the university, I succeeded in persuading them that the eyeborg is a part of my body. So now in my passport I have a photo with the electronic eye. One can say I’m officially a cyborg.

You've reached your limit of free articles.

To read the full story, start your free trial today.

Get unlimited access. Cancel anytime.

Exclusive coverage from the world's top sources, in English for the first time.

Insights from the widest range of perspectives, languages and countries.

Geopolitics

D.C. Or Beijing? Two High-Stakes Trips — And Taiwan's Divided Future On The Line

Two presidents of Taiwan, the current serving president, Tsai Ing-wen, and her predecessor, Ma Ying-jeou from the opposition Kuomintang party, are traveling in opposite directions these days. Taiwan must choose whom to follow.

Photo of Taiwan President Tsai Ing-wen

Tsai Ing-wen, the President of Taiwan

Pierre Haski

-Analysis-

PARIS — Tsai Ing-wen, the President of Taiwan, is traveling to the United States today. Not on an official trip because Taiwan is not a state recognized by Washington, but in transit, en route to Central America, a strategy that allows her to pass through New York and California.

Ma Ying-jeou, a former president of Taiwan, arrived yesterday in Shanghai: he is making a 12-day visit at the invitation of the Chinese authorities at a time of high tension between China and the United States, particularly over the fate of Taiwan.

It would be difficult to make these two trips more contrasting, as both have the merit of summarizing at a glance the decisive political battle that is coming. Presidential and legislative elections will be held in January 2024 in Taiwan, which could well determine Beijing's attitude towards the island that China claims by all means, including force.

Keep reading...Show less

You've reached your limit of free articles.

To read the full story, start your free trial today.

Get unlimited access. Cancel anytime.

Exclusive coverage from the world's top sources, in English for the first time.

Insights from the widest range of perspectives, languages and countries.

The latest