Minimum number of pixels of the image sensor to identify an object?

  • Context: Engineering 
  • Thread starter Thread starter eitan77
  • Start date Start date
  • Tags Tags
    Cameras
Click For Summary
SUMMARY

The discussion centers on the minimum number of pixels required on an image sensor to effectively identify an object, with a derived formula indicating that N = d/d', where d is the size of the object and d' is the size of its reflection on the sensor. The participants highlight that the context and characteristics of the object significantly influence detection capabilities, emphasizing that factors such as visual contrast, lens aberrations, and diffraction must be considered. The conversation concludes that while the theoretical calculations provide a starting point, practical applications require more nuanced criteria for object recognition.

PREREQUISITES
  • Understanding of image sensor physics
  • Familiarity with the concepts of pixel size and resolution
  • Knowledge of optical principles, including magnification and diffraction
  • Basic grasp of signal detection theory
NEXT STEPS
  • Research the impact of lens aberrations on image quality
  • Learn about visual contrast and its effect on object recognition
  • Study Shannon's sampling theorem in relation to spatial frequency
  • Explore advanced techniques for signal detection in noisy environments
USEFUL FOR

Optical engineers, computer vision specialists, and anyone involved in image processing or object recognition technology will benefit from this discussion.

eitan77
Messages
33
Reaction score
2
Homework Statement
Assume that the camera Field Of View is U, the lens focal length is F and the number of pixels of the detector (image sensor) is N. The camera is observing the objects at a very far distance. Assume that you want to identify an object, whose size is 1% of U. What is the minimum number (approximately) of the pixels of the detector you need for that?

I am new in this field and would appreciate it if you could help me understand how to get to the answer (My solution seems illogical to me)

Note: if it matters this is a theoretical question and not for an actual device.
Relevant Equations
## \theta =2arctan(d/2F) ##
## \theta = 2arctan(U/2D) ##
## pixels size= (object size)/N ##

d- the image sensor size
D- the distance between the object and the lens

d is unknown and D is considered very big.
##d/2F = U/2D##
##d'/2F = 0.01U/2D##
d' - the size of the object's reflection on the image sensor
##pixels size = d/N ##

since we want N to be minimal, the pixel size should be maximal: pixels size = d'

hence : ## N = d/(pixels size) = d/d' = 100 ##
My final answer does not depend on U & F which seems strange to me.
 
Physics news on Phys.org
Doesn't it kind of matter what the object is, and what the context is?

It seems to me that identifying an orange in a desert might require fewer pixels than identifying the "R" variant of an F-4J against the canopy of a jungle.
 
DaveC426913 said:
Doesn't it kind of matter what the object is, and what the context is?

It seems to me that identifying an orange in a desert might require fewer pixels than identifying the "R" variant of an F-4J against the canopy of a jungle.
This is not specified in the task, I guess it can be assumed that this is the simplest case that can be thought of.
 
I think this problem is a question of signal detection in noise.

There is only a probability, no certainty, that the object is present, where it may have been detected.

The variability of the target object being searched for, reduces the certainty of the detection.

A probability threshold for detection must be decided based on experience.
 
This is very much underspecified. What is the criterion for "recognizing" the object?? All you have written is that the angle subtended by the image and the object (from the lens center) will be the same. You need to specify that minimum required angle somehow. Then the pixels required can be calculated because you know the magnification of the lens when you know
I believe you have calculated N such that the image of the object will fill exactly one pixel....but even that is not clear to me.
 
hutchphd said:
I believe you have calculated N such that the image of the object will fill exactly one pixel....but even that is not clear to me.
That's what I did.

hutchphd said:
This is very much underspecified. What is the criterion for "recognizing" the object?? All you have written is that the angle subtended by the image and the object (from the lens center) will be the same. You need to specify that minimum required angle somehow. Then the pixels required can be calculated because you know the magnification of the lens when you know
the minimum requierd angle is not ## arctan (d'/2F)## ?
 
What exactly does "recognized" mean ? If the object is Mickey Mouse, for instance, do we need to be sure it is not Minnie Mouse instead? That changes the criterion.
Also, in the real world, there may be limits imposed by diffraction and lens aberrations. Additionally the visual contrast of Mickey relative to the background will be important.
 
Last edited:
Actually the issue of contrast brings along another question: the worst case scenario in your simple case is that the square object images equally onto the corners of four adjacent pixels. The change in response of any one pixel (caused by the object) will then be smaller by a factor of four. Is it good enough? Not enough criteria presented.
So what you did is not wrong, but far too simple to be of practical utility as I hope is clear to you from all the answers. You did warn that it was strictly a theoretical exercise!!
 
Shannon says you must sample at twice the spatial frequency of the object you are looking for. The aperture, in square pixels, must then be 4 times the target object area.
 

Similar threads

  • · Replies 8 ·
Replies
8
Views
2K
  • · Replies 5 ·
Replies
5
Views
2K
Replies
1
Views
2K
  • · Replies 226 ·
8
Replies
226
Views
16K
  • · Replies 25 ·
Replies
25
Views
3K
  • · Replies 3 ·
Replies
3
Views
3K
  • · Replies 12 ·
Replies
12
Views
6K
  • · Replies 6 ·
Replies
6
Views
3K
  • · Replies 34 ·
2
Replies
34
Views
14K
  • · Replies 1 ·
Replies
1
Views
3K