Is convolution a linear operator?

Click For Summary

Discussion Overview

The discussion centers around the linearity of the convolution operator, exploring its properties in relation to vector spaces and bilinearity. Participants examine the definitions and implications of linearity and bilinearity, particularly in the context of complex vector spaces and the mathematical formulation of convolution.

Discussion Character

  • Exploratory
  • Technical explanation
  • Conceptual clarification
  • Debate/contested

Main Points Raised

  • Some participants define linearity in terms of a morphism between vector spaces, questioning how this applies to the convolution operator, which is a binary operation.
  • Others propose that convolution can be considered linear in each of its components, suggesting specific conditions for linearity in both arguments.
  • A participant seeks clarification on whether the definitions discussed correspond to bilinearity, indicating a potential overlap between linearity and bilinearity in this context.
  • There is a discussion about the definition of convolution as an integral, with participants providing their formulations and transformations of the convolution integral.
  • Some participants express uncertainty regarding the definitions of convolutions and whether they align with their previous learning, particularly in relation to complex vector spaces.
  • A later reply addresses the formatting of mathematical expressions in the forum, providing guidance on using LaTeX for clarity.

Areas of Agreement / Disagreement

Participants do not reach a consensus on the definitions and implications of linearity and bilinearity in relation to convolution. Multiple competing views remain regarding the application of these concepts, particularly in the context of complex vector spaces.

Contextual Notes

There are limitations in the discussion regarding the assumptions made about the definitions of linearity and bilinearity, as well as the specific conditions under which convolution is considered linear. The mathematical steps involved in the convolution integral are also not fully resolved.

mnb96
Messages
711
Reaction score
5
Hello,
If f is a morphism between two vector spaces, we say it is linear if we have:
1) [itex]f(x+y) = f(x) + f(y)[/itex]
2) [itex]f(ax) = af(x)[/itex]

Now, if f is the convolution operator [itex]\ast[/itex] , we have a binary operation, because convolution is only defined between two functions.

Can we still talk about linearity in this case or it does not make sense?
In case it makes sense, what does the definition of a binary linear operator looks like?
 
Physics news on Phys.org
You can talk about linearity in each "component". That is, if f(x,y)= v, then f is linear in its first component if and only if f(au+ bv, y)= af(u,y)+ bf(v,y). It is linear in its second component if and only if f(x, au+ bv)= af(x,u)+ bf(x,v). It may be said to be "linear" if it is linear in both components.

(If our vector space is over the complex numbers, the condition for "linear in the second component may becomes
"[tex]f(x, au+ bv)= \overline{a}f(x,u)+ \overline{b}f(x,v)[/tex]".)
 
Ok, that was very clear, thanks!
So I shall conclude that since convolution is distributive under addition, it must be then linear in both arguments.
One last question: were did you find these definitions? The books I have always deal with the basic definition, and never consider more general cases like this.

edit: was that actually the definition of bilinearity? (if it works for both the components)
 
Last edited:
mnb96 said:
edit: was that actually the definition of bilinearity? (if it works for both the components)

Yes, and that is a special case (n=2) of (n)-multilinearity.
 
HallsofIvy said:
(If our vector space is over the complex numbers, the condition for "linear in the second component may becomes
"[tex]f(x, au+ bv)= \overline{a}f(x,u)+ \overline{b}f(x,v)[/tex]".)

Do you mean that in general, for a function of n complex vectors, multilinear means "linear or conjugate linear (antilinear) in each of its arguments", or if not, how is multilinearity defined for a function of n complex vectors?

I see that the inner product of a complex vectors space is conjugate linear in its second argument, which follows from linearity of the first argument and the requirement that

[tex]\left \langle \mathbf{u},\mathbf{v} \right \rangle = \overline{\left \langle \mathbf{v},\mathbf{u} \right \rangle}[/tex]

But is it possible to have a function of at least two complex vectors that's just linear in its second argument?
 
Last edited:
Maybe our definitions of convolutions are different, but the definition I have learned for the convolution of two functions is defined by an integral, i.e. $ f*g(t)=\int_{0}^{t}f(u)g(t-u)du.$ Letting $v=t-u,$ then $dv=-du$($t$ is constant with respect to $u$). We also need to change our limits of integration. For $u=0$ we have $v=t,$ and for $u=t$ we have $v=0.$ Thus $f*g(t)=-\int_{t}^{0}g(v)f(t-v)dv=\int_{0}^{t}g(v)f(t-v)dv.$ The final expression is $g*f(t).$ The fact that we used $v$ instead of $u$ is unimportant.


Note: this is my first post and I apologize for not being able to enter the equations such that they appear as they would in LaTeX.
 
Last edited:
crd said:
Maybe our definitions of convolutions are different, but the definition I have learned for the convolution of two functions is defined by an integral, i.e.

[tex]f*g(t)=\int_{0}^{t}f(u)g(t-u)du.[/tex]

Letting [tex]v=t-u,[/tex] then [tex]dv=-du[/tex] ([tex]t[/tex] is constant with respect to [tex]u[/tex]). We also need to change our limits of integration. For [tex]u=0[/tex] we have [tex]v=t,[/tex] and for [tex]u=t[/tex] we have [tex]v=0.[/tex] Thus

[tex]f*g(t)=-\int_{t}^{0}g(v)f(t-v)dv=\int_{0}^{t}g(v)f(t-v)dv.[/tex]

The final expression is [tex]g*f(t).[/tex] The fact that we used [tex]v[/tex] instead of [tex]u[/tex] is unimportant.


Note: this is my first post and I apologize for not being able to enter the equations such that they appear as they would in LaTeX.

Hi crd, and welcome to Physics Forums. You just need to put "tex" in square brackets before the LaTeX and "/tex" in square brackets after it. Unfortunately the LaTeX isn't always lined up well with the text of the text. At least when I look at it in Firefox, the LaTeX symbols sometimes appear raised above the line of the text slightly. And bigger symbols, such as the integral signs can look very uneven with big gaps between the lines where they appear, so I usually put them on a separate line so that it's easier to read. There are also some Physics Forums tags you can use such as "i" in square brackets followed by any text you want in italics, then "/i". For bold "b" and "/b". For superscript, "sup" and "/sup". And for subscript, "sub" and "/sub".
 
Rasalhague said:
Unfortunately the LaTeX isn't always lined up well with the text of the text. At least when I look at it in Firefox, the LaTeX symbols sometimes appear raised above the line of the text slightly. And bigger symbols, such as the integral signs can look very uneven with big gaps between the lines where they appear, so I usually put them on a separate line so that it's easier to read.
Use [noparse][itex]...[/itex][/noparse] instead of [noparse][tex]...[/tex][/noparse] for inline tex, i.e. LaTeX within a paragraph of text. It's rendered smaller and more accurately aligned.
 

Similar threads

  • · Replies 3 ·
Replies
3
Views
3K
  • · Replies 8 ·
Replies
8
Views
3K
  • · Replies 1 ·
Replies
1
Views
3K
  • · Replies 3 ·
Replies
3
Views
3K
  • · Replies 10 ·
Replies
10
Views
3K
  • · Replies 0 ·
Replies
0
Views
9K
  • · Replies 5 ·
Replies
5
Views
2K
  • · Replies 7 ·
Replies
7
Views
2K
Replies
0
Views
667
  • · Replies 4 ·
Replies
4
Views
3K