Well at least you are thinking about it...
I would be interested in a demonstration of a classical wave effect which eliminates all interference when partial polarizers (or classical equivalent) are present in a setup similar to the double slit. You use the example of audio, and I think a careful consideration of your analogy will demonstrate that the interference will NOT be eliminated after all - as it would need to be to match light in a double slit.
Of course there is a lot more to the story on the quantum side anyway. If light were waves (only) then a lot of things would be different (in contradiction to experiment - see for example:
http://people.whitman.edu/~beckmk/QM/grangier/Thorn_ajp.pdf" ). If light polarization operated as you imagine, things would be different with entangled particle pairs (in contradiction to experiment).
You may not be aware of all of the experiments out there (who is?), but you might want to at least ask before talking about the emperor's clothes. The double slit is just one piece of the puzzle.