Computer Vision, Corners and Eigenvalues

Click For Summary

Discussion Overview

The discussion revolves around the application of eigenvalues in the Harris Corner detection method within the field of Computer Vision. Participants explore the mathematical foundations of corner detection, particularly focusing on the role of eigenvalues and eigenvectors in analyzing image brightness gradients.

Discussion Character

  • Technical explanation
  • Conceptual clarification
  • Debate/contested

Main Points Raised

  • One participant questions the necessity of calculating eigenvalues in the Harris Corner detection method, suggesting that the computation of D(u,v) might suffice.
  • Another participant explains that the eigenvectors of D(u,v) indicate the directions of maximal and minimal gradient variation, while the eigenvalues represent the magnitude of these variations, implying their importance in identifying corners.
  • A third participant proposes a potential connection to principal components analysis, although this suggestion is later challenged by another participant.
  • Further discussion includes the nature of D(u,v) as a difference equation and whether the Taylor expansion applies to this equation or its derivative, raising questions about the mathematical treatment of image intensity changes.

Areas of Agreement / Disagreement

Participants express differing views on the necessity and role of eigenvalues in the context of corner detection, indicating that multiple competing perspectives exist without a clear consensus.

Contextual Notes

There are unresolved questions regarding the application of Taylor expansion to difference equations versus their derivatives, as well as the specific mathematical equations being solved in this context.

LouArnold
Messages
10
Reaction score
0
This question is about the use of eigenvalues in a specific application.
The subject is Computer Vision and the topic is the Harris Corner detection method. The attached file is PDF document of slides that show the math in a bit more detail.

In the slides, a corner is located by looking at the image brightness gradient in a region (say 5 x5 neighboring pixel) about each pixel in the image. The gradient value (formula) is

D(u,v) = [u v]C[u v]T = constant. C is the co-variance matrix for the neighborhood about a given pixel.

C is then diagonalized with eigenvalues, and they and their eigenvectors indicate the direction and strength of the brightness gradient.

But I’m puzzled why eigenvalues are calculated at all. Isn’t calculating D(u,v) for each pixel enough?

I am aware that eigenvalues provide a root to the homogeneous equation Ax=0, but why try and find roots at all in this situation? And what is the equation we trying to solve in this case?
 

Attachments

Physics news on Phys.org
The directions in which the gradient variation is maximal/minimal are given by the eigenvectors of D(u,v), and the magnitude of these maxima, minima is given by the eigenvalues. Supposedly a corner is characterized by the condition that both eigenvalues are large, which is why the are computed.
 
I don't think this has to do with principal component analysis, but it was a thoughtful suggestion.

I think you are right yyat. D(u,v) calculates the change in intensity about a point. But its essential term is I(i+u,j+v)-I(i,j). Is this a difference equation - effectively a discrete derivative? Or is the derivative of this equation what we want to set to zero and solve.

In the PDF the Taylor expansion is for I(i+u,j+v)=I(i,j)+Ix(u)+Iy(v)...(where Ix=dI/dx, and Iy=dI/dy, and x and y are in the i and j direction). But is this applied to the difference equation or to its derivative?

By the way, i and j represent pixel indices and have nothing to do with unit directional vectors.
 

Similar threads

Replies
8
Views
6K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 3 ·
Replies
3
Views
13K
  • · Replies 9 ·
Replies
9
Views
5K
  • · Replies 5 ·
Replies
5
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 43 ·
2
Replies
43
Views
12K
  • · Replies 1 ·
Replies
1
Views
2K
Replies
2
Views
3K