Minimum number of pixels of the image sensor to identify an object?

  • Context: Engineering 
  • Thread starter Thread starter eitan77
  • Start date Start date
  • Tags Tags
    Cameras
Click For Summary

Discussion Overview

The discussion revolves around the minimum number of pixels required on an image sensor to effectively identify an object. Participants explore various factors that may influence this requirement, including object type, context, and theoretical considerations related to signal detection and recognition criteria.

Discussion Character

  • Exploratory
  • Technical explanation
  • Debate/contested

Main Points Raised

  • One participant presents a formula relating pixel size and the number of pixels needed, concluding that the minimum number of pixels does not depend on certain parameters, which they find strange.
  • Another participant argues that the context and type of object significantly affect the number of pixels needed for identification, using examples of an orange in a desert versus an F-4J in a jungle.
  • A participant questions the clarity of the problem, emphasizing the need for a defined criterion for "recognizing" an object and suggesting that the minimum required angle for detection should be specified.
  • Concerns are raised about the implications of diffraction and lens aberrations on object recognition, highlighting the importance of visual contrast against the background.
  • One participant discusses the potential issue of an object image being spread across multiple pixels, which could affect the detection response, suggesting that the theoretical approach may be overly simplistic for practical applications.
  • A reference to Shannon's sampling theorem is made, indicating that the sampling rate must be sufficient relative to the spatial frequency of the object being observed.

Areas of Agreement / Disagreement

Participants express differing views on the sufficiency of the initial calculations and the assumptions made in the problem. There is no consensus on the criteria for recognizing an object or the implications of various factors such as context, contrast, and theoretical limits.

Contextual Notes

The discussion highlights limitations in the initial problem statement, including the lack of clarity regarding recognition criteria and the assumptions made about object characteristics and environmental factors.

eitan77
Messages
33
Reaction score
2
Homework Statement
Assume that the camera Field Of View is U, the lens focal length is F and the number of pixels of the detector (image sensor) is N. The camera is observing the objects at a very far distance. Assume that you want to identify an object, whose size is 1% of U. What is the minimum number (approximately) of the pixels of the detector you need for that?

I am new in this field and would appreciate it if you could help me understand how to get to the answer (My solution seems illogical to me)

Note: if it matters this is a theoretical question and not for an actual device.
Relevant Equations
## \theta =2arctan(d/2F) ##
## \theta = 2arctan(U/2D) ##
## pixels size= (object size)/N ##

d- the image sensor size
D- the distance between the object and the lens

d is unknown and D is considered very big.
##d/2F = U/2D##
##d'/2F = 0.01U/2D##
d' - the size of the object's reflection on the image sensor
##pixels size = d/N ##

since we want N to be minimal, the pixel size should be maximal: pixels size = d'

hence : ## N = d/(pixels size) = d/d' = 100 ##
My final answer does not depend on U & F which seems strange to me.
 
Physics news on Phys.org
Doesn't it kind of matter what the object is, and what the context is?

It seems to me that identifying an orange in a desert might require fewer pixels than identifying the "R" variant of an F-4J against the canopy of a jungle.
 
DaveC426913 said:
Doesn't it kind of matter what the object is, and what the context is?

It seems to me that identifying an orange in a desert might require fewer pixels than identifying the "R" variant of an F-4J against the canopy of a jungle.
This is not specified in the task, I guess it can be assumed that this is the simplest case that can be thought of.
 
I think this problem is a question of signal detection in noise.

There is only a probability, no certainty, that the object is present, where it may have been detected.

The variability of the target object being searched for, reduces the certainty of the detection.

A probability threshold for detection must be decided based on experience.
 
This is very much underspecified. What is the criterion for "recognizing" the object?? All you have written is that the angle subtended by the image and the object (from the lens center) will be the same. You need to specify that minimum required angle somehow. Then the pixels required can be calculated because you know the magnification of the lens when you know
I believe you have calculated N such that the image of the object will fill exactly one pixel....but even that is not clear to me.
 
hutchphd said:
I believe you have calculated N such that the image of the object will fill exactly one pixel....but even that is not clear to me.
That's what I did.

hutchphd said:
This is very much underspecified. What is the criterion for "recognizing" the object?? All you have written is that the angle subtended by the image and the object (from the lens center) will be the same. You need to specify that minimum required angle somehow. Then the pixels required can be calculated because you know the magnification of the lens when you know
the minimum requierd angle is not ## arctan (d'/2F)## ?
 
What exactly does "recognized" mean ? If the object is Mickey Mouse, for instance, do we need to be sure it is not Minnie Mouse instead? That changes the criterion.
Also, in the real world, there may be limits imposed by diffraction and lens aberrations. Additionally the visual contrast of Mickey relative to the background will be important.
 
Last edited:
Actually the issue of contrast brings along another question: the worst case scenario in your simple case is that the square object images equally onto the corners of four adjacent pixels. The change in response of any one pixel (caused by the object) will then be smaller by a factor of four. Is it good enough? Not enough criteria presented.
So what you did is not wrong, but far too simple to be of practical utility as I hope is clear to you from all the answers. You did warn that it was strictly a theoretical exercise!!
 
Shannon says you must sample at twice the spatial frequency of the object you are looking for. The aperture, in square pixels, must then be 4 times the target object area.
 

Similar threads

  • · Replies 8 ·
Replies
8
Views
2K
  • · Replies 5 ·
Replies
5
Views
2K
Replies
1
Views
2K
  • · Replies 226 ·
8
Replies
226
Views
16K
  • · Replies 25 ·
Replies
25
Views
4K
  • · Replies 3 ·
Replies
3
Views
3K
  • · Replies 12 ·
Replies
12
Views
6K
  • · Replies 6 ·
Replies
6
Views
3K
  • · Replies 34 ·
2
Replies
34
Views
14K
  • · Replies 1 ·
Replies
1
Views
3K