Dude no freaking way! I have that too, but we're totally different as far as seeing it goes. It's extremely hard to describe, but i kind of see notes and sounds as different lines and the timbre affects the shapes of them as well as the colour.
I'm kind of hesitant to tell people about it because they usually say I'm crazy, and some think it's really cool and bug me about it for hours haha.
I tend to find music that has the most variation in lines and shapes intrigues me more than less shapey music. It helps with me composing because I can kind of get lost in what it looks like and I can tell how good something sounds through how it looks. Although when I start a piece it usually looks really empty to me and it's rather unsettling until I get to fill in other pieces haha.
I also find that it's near impossible to draw anything close to what I see at all.
Some things that I find interesting:
a. Dubstep looks so weird, in a cool awesome way. Very dark green and with an indescribable texture.
b. Skrillex style house is very blue to me, and it just looks so cool
c. Car engines, birds chirping, white noise, etc. all have very unique looks
d. Rock and roll is very very very rough, sometimes too much.
e. The way i see it, higher pitched sounds are higher up and lower tones are lower in my "vision"
f. Ovenrake's Catbutt looks so awesome!