(thinking in idealised terms) the damage would be bigger if you continue to accelerate because the wall wants the front end of car to stop but the acceleration is trying to keep pushing the car forward causing the car to squash even more. (but then by that time your engine is probably gone) now, you need to clarify your question a bit. when does the car actually stop accelerating and start "decelerating", the quicker (over shorter distance) it goes from 50 to 0, the bigger the impact/damage. as you can imagine if the wall breaks the car will not stop at the wall but a bit further down and as a result the stopping distance becomes longer, and hence in general less damage by comparsion is done on the car. just like an F1 hitting the tire wall, if the tires are as hard as rocks, it will not do any good. the fact that they are effective b/c they are soft and they breaks on impact.
so, stopping distance and time it takes to decelerate to 0 mph are the keys here. BUT having said that , we have assumed a lot here. and the real world is not that idealistic.