In my opinion, "wave/particle duality" has a conceptually revealing element, and a conceptually obscuring element, so the key is to stress only the part that is useful and eliminate the other. The useful part is that when we thought classically, we used to think that particles and waves were two completely different things, with a firewall between them. When a homerun is hit in baseball, you had a particle flying out of the stadium, and a rush of sound waves following it as the fans cheered, and no connection whatsoever existed between those. So it is very enlightening to understand that actually everything that baseball is doing could be expressed in the mathematics of a well-localized wave with very short wavelengths, and everything that rush of sound was doing could be expressed in the mathematics of particles moving stochastically, and in turn the movement of those particles could be expressed as localized waves with very short wavelengths. So perhaps "wave/particle unity" would be a better phrase-- it just means that everything that we thought was a particle also involves the rules of waves, and everything we thought was a wave also involves the rules of particles. But I don't throw away wave/particle duality, I just think wave/particle unity every time I hear the phrase.
Which brings up the obscuring aspect of the phrase, which I believe is the part most of its detractors object to. They object, and rightly so, to the interpretation that "wave/particle duality" means "sometimes it's a particle, and sometimes it's a wave, depending on the question we put to it." That makes it sound disjoint and schizophrenic, when in fact it's the opposite of that, it's well unified into an elegant and aesthetically beautiful theory, just one that is not like we used to think when we thought waves and particles were two completely different things. So the problem is not with the "duality", it is with the whole idea that there are two separate things there that would need to be "dual" to be thought of as elements of the same thing. Shall we say that a coin exhibits "head/tail duality", or shall we just say there are "two sides to the same coin"?