Three lines two neurons and M×M receptors.

Click For Summary
SUMMARY

This discussion centers on the application of neural networks to detect vertical, horizontal, and diagonal lines using two neurons. The conversation highlights the necessity of M×M receptors, with a minimum of 3×3 suggested for effective line detection, while noting that 4×4 may enhance results. The tradeoff between the number of receptors and the certainty of line detection is emphasized. Additionally, participants recommend introductory resources for learning probability, statistics, and neural networks, including specific books for foundational knowledge.

PREREQUISITES
  • Understanding of basic neural network concepts
  • Familiarity with probability theory
  • Knowledge of statistical inference and regression analysis
  • Background in linear algebra and calculus
NEXT STEPS
  • Research "Introduction to Probability" by Dimitri P. Bertsekas and John N. Tsitsiklis
  • Explore "Applied Probability Models" by Sheldon M. Ross
  • Learn about neural network architectures for line detection
  • Investigate the tradeoffs in sensor design for machine learning applications
USEFUL FOR

This discussion is beneficial for AI researchers, machine learning practitioners, and students interested in the foundational concepts of neural networks, probability, and statistics.

MacIntoShiba
Messages
7
Reaction score
1
Dear all, I have lately been interested in AI.

One of my thoughts has been as follows:

What if we have two 'neurons' and the world consists of vertical, horizontal and diagonal lines. How would we go about making sure only one neuron is assigned to either vertical or horizontal lines and that diagonal lines are neglected. Another related question would be the minimum amount of visual receptors which provide inputs to these two neurons. Let's say we need M×M recptors to spot a line. With M needs at least be 3×3, but maybe 4×4 would give better results. So there is a tradeoff between cost (number of receptors) and reward, certainty with which lines can be detected.Also I would like to start reading up on statistics/probability/neural networks. I have not studied these topics before so it needs to be an introduction. I am also a bit allergic to books with 1000+ pages so shorter is better. I have done a master in mechanical engineering,
so I do know about lin algebra, calculus etc.
 
Physics news on Phys.org
Hey MacIntoShiba.

There are a number of books on the areas you are seeking and for probability and statistics you will first have to learn probability and after that do statistical inference, regression and applied probability.

First books on probability often look at the same thing and something like below is a good introduction:

https://www.amazon.com/dp/0495110817/?tag=pfamazon01-20

After that you look at statistical inference, regression analysis and applied probability.

Here is a good applied probability model book:

https://www.amazon.com/dp/0124079482/?tag=pfamazon01-20

Graduate stuff goes into more abstraction and into different data types along with a more rigorous treatment of probability.

If you have specific questions on probability and statistics let us know in the thread so we can help you.
 
Last edited by a moderator:

Similar threads

  • · Replies 29 ·
Replies
29
Views
6K
  • · Replies 7 ·
Replies
7
Views
2K
  • · Replies 7 ·
Replies
7
Views
2K
  • · Replies 1 ·
Replies
1
Views
1K
  • · Replies 11 ·
Replies
11
Views
3K
  • · Replies 6 ·
Replies
6
Views
3K
  • · Replies 3 ·
Replies
3
Views
1K
  • · Replies 6 ·
Replies
6
Views
3K
  • · Replies 5 ·
Replies
5
Views
3K
  • · Replies 6 ·
Replies
6
Views
2K