As was said before, the most important idea is that you're looking for a certain bound.
Going back to the definition of an infinite series, such a series actually represents a sequence of partial sums, each of which has a finite number of terms, and thus each partial sum is some number. In the real number system, if we have an increasing sequence (each term is greater than or equal to the one before it), and we can find some real number larger than every term in the sequence. we say the sequence has an upper bound. But in the real number system, if we have such a sequence that is bounded from above, but is always increasing, then there must be some real number L that is the smallest real number larger than every term in the sequence, called the least upper bound. It is this number that we call the sum of the infinite series.
In the case of your Riemann sum, taking the limit as n approaches infinity is really looking for the least upper bound of the set of real sums where n is finite; that is, if your integral is for a positive function. I'm sure you can generalize this idea to series for which we look for greatest lower bounds and so on.