No, acceleration isn't the critical point. You can construct variants of the twin paradox in which nobody accelerates, but the twins come back with different ages.
How exactly does this apply to the twins paradox? I thought a key assumption is that they start and end in the same frame of reference. By this it would seem that the twin set into motion must experience a force in order to start, and to end his trip.