Its not that it is any more difficult to subtract in binary than to add --- just simply the fact that we don't need to build two sets of circuits, when one set can do both functions by simply using complement operation. By the way, the same can be done with decimal numbers, its just not quite as easy as with binary.
KM