A simpler example of a function that is not a linear operator is the norm. In any Hilbert space you have an inner product and if you take the inner product of a vector with itself you get the norm (squared). So, you could have:
##N: \mathcal{H} \rightarrow \mathbb{R}##
Defined by
##N(f) = ||f|| \equiv \langle f, f \rangle ^{1/2}##
Another, very important example, is the idea of a Linear Functional. Take any function ##f \in H##. Define:
##L_f : H \rightarrow \mathbb{C}##
where ##L_f(g) = \langle f, g \rangle##
In this case, therefore, ##L_f## maps each function to a complex number. Note that for every ##f \in H## you have a linear functional ##L_f##. The set of all linear functionals is called the Dual Space ...
Another example, which I think you are getting at is where the ##L## is an operator, but it produces functions that lie outside the Hilbert Space. For example, you take ##H## to be the space of square integrable functions on some interval ##[a, b]##, where the functions vanish at ##a## and ##b##. That is:
If ##f \in H##, then ##f(a) = f(b) = 0##Now, the differential operator ##L = \frac{d}{dx}## maps functions to functions that may not vanish at the end-points. In this case, ##L## maps functions in the original Hilbert space into a different space, that involves a wider class of functions.
But, you know, I don't really have time to teach anyone functional analysis!