Permutations apart from probability are also important for linear algebra and tensor theory.
Geometry itself has important attributes regarding permutations that relate to the characterization of orientation. The determinant itself which is a signed measure has an important permutation property relating to how the determinant is not only calculated, but also derived.
In tensor theory, there is a special permutation tensor (which I think is called the Christoffel symbol) that is one foundation for understanding permutations and can be related back to the ideas of linear algebra.
The other important connection is to discrete mathematics especially for graphs and algorithms (apart from probability and general counting).
You can indirectly relate it back to number theory and other periodic processes (like waves) if you want as well.