Let's see it for a 2x2 matrix. Since a transposition of rows and columns does not change the value of the matrix, and a transposition of row or columns changes the sign, it is sufficient to consider how many different rows we can form. For a 2x2 matrix, we can form the first row in 3 ways (pairing one fixed element with the other 3 elements) and the second row can be formed in the 2 possible permutations of the remaining elements, so 3x2 = 6 possible determinants. Here they are:
[tex]
\left|\begin{array}{cc}<br />
1 & 2 \\<br />
<br />
3 & 4<br />
\end{array}\right| = 4 - 6 = -2[/tex]
[tex]
\left|\begin{array}{cc}<br />
1 & 2 \\<br />
<br />
4 & 3<br />
\end{array}\right| = 3 - 8 = -5[/tex]
[tex]
\left|\begin{array}{cc}<br />
1 & 3 \\<br />
<br />
2 & 4<br />
\end{array}\right| = 4 - 6 = -2[/tex]
[tex]
\left|\begin{array}{cc}<br />
1 & 3 \\<br />
<br />
4 & 2<br />
\end{array}\right| = 2 - 12 = -10[/tex]
[tex]
\left|\begin{array}{cc}<br />
1 & 4 \\<br />
<br />
2 & 3<br />
\end{array}\right| = 3 - 8 = -5[/tex]
[tex]
\left|\begin{array}{cc}<br />
1 & 4 \\<br />
<br />
3 & 2<br />
\end{array}\right| = 2 - 12 = -10[/tex]
I don't see how to generalize it at this point. I would think we need to add the biggest numbers [itex]n^{2}, (n - 1)^{2}, \ldots, n^{2} - n +1[/itex] along the main diagonal, then the next along the third to the main diagonal and start inserting the smallest elements along the odd diagonals.