What is meant when $\sigma$ is said to be discriminatory?

  • Context: Graduate 
  • Thread starter Thread starter jamesb1
  • Start date Start date
  • Tags Tags
    Measure theory
Click For Summary

Discussion Overview

The discussion revolves around the interpretation of the term $\sigma$ in the context of a definition related to the approximating power of neural networks, specifically in relation to measures and integrals. Participants are exploring theoretical aspects of this definition, including its implications and connections to existing mathematical concepts.

Discussion Character

  • Exploratory
  • Technical explanation
  • Conceptual clarification

Main Points Raised

  • One participant expresses confusion regarding a definition from a paper, particularly about the relationship between the integral being zero and the measure $\mu$ being zero, suggesting that this implies $\sigma$ is non-zero.
  • Another participant requests clarification on the initial understanding and definitions being used to provide better assistance.
  • A later reply indicates that $\sigma$ may be intended to approximate a characteristic function of a set $S$, being 1 on $S$ and 0 otherwise, but this raises further questions about the implications of this characterization.
  • There is mention of a potential interpretation of $\sigma$ as a sigmoidal function, which leads to uncertainty about its behavior as it approaches negative infinity.

Areas of Agreement / Disagreement

Participants do not appear to reach a consensus on the interpretation of $\sigma$ or its implications in the context of the definition discussed. Multiple viewpoints and uncertainties remain regarding the relationship between integrals, measures, and the nature of $\sigma$.

Contextual Notes

Participants express limitations in their understanding of the definitions and results related to the integral and measure, indicating that further clarification of these concepts is necessary for a more comprehensive discussion.

jamesb1
Messages
22
Reaction score
0
I am reviewing this http://deeplearning.cs.cmu.edu/pdfs/Cybenko.pdf on the approximating power of neural networks and I came across a definition that I could not quite understand. The definition reads:
0OFMv.png


where $I_n$ is the n-dimensional unit hypercube and $M(I_n)$ is the space of finite, signed, regular Borel measures on In.

The only thing that I could get from this definition which again does not seem plausible enough is: since whenever the integral is 0 it must imply that the measure μ is 0, then σ is non-zero. I am not sure if this right though.

I literally could not find any other literature or similar definitions on this and I've looked in a number of textbooks such as Kreyzig, Rudin and Stein & Shakarchi.

Any insight/help?
 
Last edited by a moderator:
Physics news on Phys.org
WWGD said:
I understand that, what I mean is I don't understand how it correlates with this definition; where the Lebesgue integral being zero implies that the measure μ is also 0.
 
Well, if you tell us up front what you understand and the main definitions/results you are working with, we may be better able to help you.
 
jamesb1 said:
where $I_n$ is the n-dimensional unit hypercube and $M(I_n)$ is the space of finite, signed, regular Borel measures on I_n.

The only thing that I could get from this definition which again does not seem plausible enough is: since whenever the integral is 0 it must imply that the measure μ is 0, then σ is non-zero. I am not sure if this right though.

WWGD said:
Well, if you tell us up front what you understand and the main definitions/results you are working with, we may be better able to help you.

The other definitions in the paper I linked are not really necessary as this definition does not take any special insight from them. I gave the information needed specifically for I_n and M(I_n) because they're mentioned but other than that, it can pretty much be taken as a standalone definition in my opinion. I just cannot understand what the correlation is between the integral being zero and the measure being zero. What does that tell us about the function sigma and how is it the case? I said what I think but I do not think it is correct.

*** EDIT ***
What MAY be of use is the fact sigma in this definition is possibly being taken as sigmoidal ONLY, but then again if that is the case then my understanding does not make sense since a sigmoid function f(t) can tend to zero as t -> -∞
 
Last edited:
All I know is the definition I read, in which I understood that ##\sigma ## is intended to approximate a characteristic function of a set S, i.e., to be 1 on S and 0 otherwise.
 

Similar threads

  • · Replies 7 ·
Replies
7
Views
7K
Replies
0
Views
5K
  • · Replies 7 ·
Replies
7
Views
3K
Replies
24
Views
8K