By "good looks at things from 4-6.5 magnitude" I assume you mean galaxies, nebulae, and the like (because stars are easily visible at these magnitudes through your binoculars). I regret to inform you that if your skies are as light polluted as you say, the most you will probably be able to see is the Orion Nebula, and probably the central part of the Andromeda Galaxy (This will look nothing like a galaxy. Fair warning).
If you're only limited by binoculars, if you have a car it could be worth it to take a drive out to the country to get better looks at some astronomical objects. You can see the light pollution situation at:
http://www.cleardarksky.com/csk/
Which also gives a relatively accurate assessment of seeing, humidity, and other conditions.
Try, as much as possible, to observe from a location where there are no local lights (shining in your eyes, or even near you). After 10-20 minutes in such conditions your eyes will start to see many more stars despite no change in the overall light pollution.
Other things you might try viewing include open star clusters (particularly, start with the pleaides), and it doesn't hurt to try a globular cluster either (but don't expect much).
There's not much you can do about the pollution with binocs except get to a locally dark site or travel out the the country.
Also, do not expect markedly different results with a telescope from what you achieve with binoculars. In heavily light polluted skies, the amount of skyglow increases with the size of your lens, so the effect almost cancels out the increased light from the source. Basically, size doesn't matter much for faint of objects you can see. (This isn't strictly true but it's a good approximation which appears to hold true from my experiences) So, with a telescope expect to be able to see what you already can see with the binoculars, but with greater resolution (planets will appear much crisper, you may be able to see more detail in the Orion nebula), but again, don't hold out for markedly better images from a telescope.
Sorry if this all sounds a little grim, but I have been the victim of horrible light pollution as well and am quite bitter about it!