No, the drift velocity is causally determined by LOCAL quantities:
the Electric Field, the charge carrier density, the density, size,
and mass of the NON-mobile atoms (and the Temperature).
Voltage only has an effect on drift velocity if it influences the local E-field.
It's the E-field that accelerates electrons, before they collide and start again.
Cross-sectional Area only affects drift velocity if it decreases R thereby decreasing V (if current is held constant) thereby decreasing the local E-field.
Increasing the length might (if Voltage is held constant) change the local E-field, in what way?