I've bumped this over to the philosophy forum, since (to the best of my knowledge) these are philosophical terms, not mathematical ones.
My impression of these terms is that "potentially infinite" comes up when you deal with a sequence of "finite" approximations to some "infinite" idea. For example, rather than thinking of a decimal numeral as an object unto itself, you can instead imagine a process that iteratively writes its decimal digits one-by-one. I
think that one would say that the decimal numeral has actually infinitely many digits, whereas the process outputs potentially infinitely many digits.
One thing to be very careful of is not to confuse the individual terms of the approximation with the process itself (or with the thing being approximated). For example, while each of the terms of the approximation
0.9, 0.99, 0.999, 0.9999, ...
has finite length and is less than 1, the "process" itself represents a number exactly equal to 1, and the "process" itself is not finite in duration. (But it does have a finite description) I've seen it asserted that confusing the process with the individual terms is one of the major sources of confusion regarding the fact that 1=0.999...
However, to my eye, many uses of "potentially infinite" seem to be really dealing with the idea of indeterminate variables, despite never actually being phrased that way.