Proving quasi-concavity of a certain function

  • Thread starter Thread starter quantum_2000
  • Start date Start date
  • Tags Tags
    Function
Click For Summary

Homework Help Overview

The discussion revolves around proving the quasi-concavity of the function (1-\Phi(x))(x-k), where \Phi is the cumulative distribution function (cdf) of the normal distribution and k is a positive constant. Participants explore the behavior of the function's derivatives and their implications for quasi-concavity.

Discussion Character

  • Exploratory, Mathematical reasoning, Assumption checking

Approaches and Questions Raised

  • Participants discuss the first derivative of the function and its components, questioning how to demonstrate that one term increases in magnitude while the other decreases. There are attempts to analyze the second derivative and its implications for the function's behavior. Some participants suggest using graphical observations to inform their understanding.

Discussion Status

There is ongoing exploration of various mathematical properties related to the function, including the first and second derivatives. Some participants have proposed conditions for proving quasi-concavity, while others express uncertainty about the implications of their findings. The discussion reflects a mix of ideas and approaches, with no clear consensus reached.

Contextual Notes

Participants note constraints such as the requirement for x to be greater than k and the complexity of the derivatives involved. There is also mention of graphical observations that may differ among participants, indicating varying interpretations of the function's behavior.

quantum_2000
Messages
9
Reaction score
0

Homework Statement



I need to prove that the function

(1-[itex]\Phi[/itex](x))(x-k)

is quasi-concave (i.e. first increasing and then decreasing), where [itex]\Phi[/itex] is the cdf of the normal distribution and k is a positive constant

Homework Equations

The Attempt at a Solution



I plotted the function and even tried to disprove it by simulation and the function is always quasi-concave, but so far have not been able to prove it.

The main issue is the cdf of the normal distribution, which can only be expressed using the Erf function, and this is where I get stuck.
Any help will be appreciated!

Q
 
Last edited by a moderator:
Physics news on Phys.org
Show your work.
 
The first derivative of the function is

-[itex]\phi[/itex](x)(x-k)+(1-[itex]\Phi[/itex](x))

the first term is always negative, the second always positive, so to prove quasi-concavity is would be sufficient to show that the first term increases in magnitude and the second decreases as x goes up (this would actually prove concavity). The latter is of course true as the cdf is always an increasing function, but the former is not. So this way leads nowhere.
Writing the first derivative in detail I get

-[itex]\frac{1}{\sqrt{2\pi}\sigma}[/itex]e[itex]^{-\frac{(x-\mu)}{2\sigma^{2}}}[/itex](x-k)+[itex]\frac{1}{2}[/itex]-[itex]\frac{1}{\sqrt{\pi}}[/itex][itex]\int[/itex][itex]^{\frac{x}{\sqrt{2}}}_{0}[/itex]e[itex]^{-t^{2}}[/itex]dt

and I am stuck here, I don't know how to attack this beast. Going to second derivative is not going to help since the function is not concave, of this I am sure. I should prove that, as x increases, the first derivative as a "turning point" so that it is positive before that point and once it becomes negative it never gets positive again. I have litterally no idea how to prove this. One way would be to take x[itex]_{1}[/itex]<x[itex]_{2}[/itex], impose that the first derivative calculated at x[itex]_{1}[/itex] is negative, that the first derivative calculated at x[itex]_{2}[/itex] is positive, and then show that this is not possible by contradiction. But again, once I write down these conditions I don't know how to proceed. I can't take the difference of the equations and show that it is monotone, for example, since what matters is not monotonicity of the first derivative - again, I am not trying to prove concavity.
An equivalent problem to solve is to show that once

[itex]\frac{1}{\sqrt{2\pi}\sigma}[/itex]e[itex]^{-\frac{(x-\mu)}{2\sigma^{2}}}[/itex](x-k)+[itex]\frac{1}{\sqrt{\pi}}[/itex][itex]\int[/itex][itex]^{\frac{x}{\sqrt{2}}}_{0}[/itex]e[itex]^{-t^{2}}[/itex]dt

goes above 1/2 it stays there. Easy, right? :)

Any help, even on how quasi-concavity is typically proven, would be very much appreciated. Thank you in advance
 
quantum_2000 said:
The first derivative of the function is

-[itex]\phi[/itex](x)(x-k)+(1-[itex]\Phi[/itex](x))

the first term is always negative, the second always positive, so to prove quasi-concavity is would be sufficient to show that the first term increases in magnitude and the second decreases as x goes up (this would actually prove concavity). The latter is of course true as the cdf is always an increasing function, but the former is not. So this way leads nowhere.
Writing the first derivative in detail I get

-[itex]\frac{1}{\sqrt{2\pi}\sigma}[/itex]e[itex]^{-\frac{(x-\mu)}{2\sigma^{2}}}[/itex](x-k)+[itex]\frac{1}{2}[/itex]-[itex]\frac{1}{\sqrt{\pi}}[/itex][itex]\int[/itex][itex]^{\frac{x}{\sqrt{2}}}_{0}[/itex]e[itex]^{-t^{2}}[/itex]dt

and I am stuck here, I don't know how to attack this beast. Going to second derivative is not going to help since the function is not concave, of this I am sure. I should prove that, as x increases, the first derivative as a "turning point" so that it is positive before that point and once it becomes negative it never gets positive again. I have litterally no idea how to prove this. One way would be to take x[itex]_{1}[/itex]<x[itex]_{2}[/itex], impose that the first derivative calculated at x[itex]_{1}[/itex] is negative, that the first derivative calculated at x[itex]_{2}[/itex] is positive, and then show that this is not possible by contradiction. But again, once I write down these conditions I don't know how to proceed. I can't take the difference of the equations and show that it is monotone, for example, since what matters is not monotonicity of the first derivative - again, I am not trying to prove concavity.
An equivalent problem to solve is to show that once

[itex]\frac{1}{\sqrt{2\pi}\sigma}[/itex]e[itex]^{-\frac{(x-\mu)}{2\sigma^{2}}}[/itex](x-k)+[itex]\frac{1}{\sqrt{\pi}}[/itex][itex]\int[/itex][itex]^{\frac{x}{\sqrt{2}}}_{0}[/itex]e[itex]^{-t^{2}}[/itex]dt

goes above 1/2 it stays there. Easy, right? :)

Any help, even on how quasi-concavity is typically proven, would be very much appreciated. Thank you in advance

Looking at properties and behavior of the second derivative helps a lot in understanding more about the behavior of the first derivative.
 
True in general, and even the third derivative can help, but I do not see how it can be of help here. Please bring your ideas if you have any in this direction.

---

I came up with a (sufficient) set of conditions to show q-concavity, but it's rather complex. I put it down in case it helps you come up with other, simpler ideas.

1. Showing that the second derivative is negative until a certain x, and then becomes positive for all higher x's (which is what I observe graphically); this could be done by showing that:
1a. The second derivative is continuous;
1b. There exists a unique [itex]\widehat{x}[/itex] such that the third derivative is zero;
1c. The second derivative is positive for x1 and negative for x2 where x1<x2;

2. Showing that the integral of the second derivative from [itex]\widehat{x}[/itex] to +∞ is less than the first derivative calculated at [itex]\widehat{x}[/itex].
 
quantum_2000 said:
True in general, and even the third derivative can help, but I do not see how it can be of help here. Please bring your ideas if you have any in this direction.

---

I came up with a (sufficient) set of conditions to show q-concavity, but it's rather complex. I put it down in case it helps you come up with other, simpler ideas.

1. Showing that the second derivative is negative until a certain x, and then becomes positive for all higher x's (which is what I observe graphically); this could be done by showing that:
1a. The second derivative is continuous;
1b. There exists a unique [itex]\widehat{x}[/itex] such that the third derivative is zero;
1c. The second derivative is positive for x1 and negative for x2 where x1<x2;

2. Showing that the integral of the second derivative from [itex]\widehat{x}[/itex] to +∞ is less than the first derivative calculated at [itex]\widehat{x}[/itex].

what you say you observe graphically is incorrect; I observe something different graphically.

Anyway, if ##\phi(x) = \exp(-x^2/2)/\sqrt{2 \pi}## and ##\Phi^c(x) = 1 - \Phi(x)## your function is ##F(x) = (x-k) \Phi^c(x).## We have
[tex]F'(x) = \Phi^c(x) - (x-k) \phi(x),\\<br /> F''(x) = \phi(x) [x(x-k)-2].[/tex]
Note that ##F''(x) < 0## for x between 0 and k and ##F''(x) > 0## for large |x|. Thus, there exist ##x_1(k) < x_2(k)## such that ##F''(x) > 0## for ##x < x_1(k)## and ##x > x_2(k)##, while ##F''(x) < 0## for ##x_1(k) < x < x_2(k)##. Therefore, F is convex-concave-convex. Of course, ##x_1(k), x_2(k)## are just roots of a simple quadratic.

If you do further manipulations you can get what you need, but I cannot give further hints at this point.
 
Thank you for your suggestions. I realized that I did not mention that x is constrained to be grater than k, this is why I observed a concave-convex function... my mistake.

I could finally prove it. What I did was to look at the first order condition and show that it has a unique solution if [itex]\frac{\Phi^c-k}{\phi}[/itex] decreases in x, and this is the case because I know that [itex]\frac{\Phi^c}{\phi}[/itex] is decreasing in x since the normal distribution has Increasing Failure Rate.

I am not sure I'd be able to show q-concavity without resorting to the IFR property though, i.e. by just using math manipulation. Btw, is it possible that there is a typo in your second derivative? I was working on the third derivative trying to show that it has a unique positive solution that equates it to zero - this would be sufficient too given that the limit for x→+∞ is zero, third derivative is continuous, and the function is concave-convex - but I was stuck again, and then I got the idea of the IFR property.

Thanks again for taking the time to reply!
 
quantum_2000 said:
Thank you for your suggestions. I realized that I did not mention that x is constrained to be grater than k, this is why I observed a concave-convex function... my mistake.

I could finally prove it. What I did was to look at the first order condition and show that it has a unique solution if [itex]\frac{\Phi^c-k}{\phi}[/itex] decreases in x, and this is the case because I know that [itex]\frac{\Phi^c}{\phi}[/itex] is decreasing in x since the normal distribution has Increasing Failure Rate.

I am not sure I'd be able to show q-concavity without resorting to the IFR property though, i.e. by just using math manipulation. Btw, is it possible that there is a typo in your second derivative? I was working on the third derivative trying to show that it has a unique positive solution that equates it to zero - this would be sufficient too given that the limit for x→+∞ is zero, third derivative is continuous, and the function is concave-convex - but I was stuck again, and then I got the idea of the IFR property.

Thanks again for taking the time to reply!

You could also do it directly: as I said, the points 0 and k are in the concavity region, so if you are only interested in x >= k, the function is concave-convex. The inflection point x* > k is the largest root of x(x-k) = 2. We must have F'(x*) < 0, because if F'(x*) were >= 0 the (strict) convexity of F for x > x* would imply that F(x) → ∞ for x → ∞, which contradicts the easily-proven fact that F(x) → 0 for large x > 0. We have ##F'(k) = \Phi^c (k) > 0 ## (see below). Thus, F' is positive at x = k and negative at x = x*, so has a has a zero between k and x*; and that means that F has a single maximum, which lies in the concave region.

And no, I don't think my derivatives have typos. Letting
[tex]F(x) = (x-k)\Phi^c(x), \; \text{ where <br /> } \Phi^c(x) = \int_x^{\infty} \phi(t) \, dt,[/tex] we have
[tex]F'(x) = \Phi^c(x) - (x-k) \phi(x)\\<br /> F''(x) = -\phi(x) - \phi(x) -(x-k)(-x \phi(x)) = \phi(x) [x(x-k) - 2].[/tex]
This uses the fact that ##\phi^{\prime} (x) = -x \phi(x).##
 
Crisp and clear! Reading your arguments was really instructive.

Thank you again for sharing your thoughts

Q
 

Similar threads

  • · Replies 10 ·
Replies
10
Views
3K
Replies
7
Views
2K
  • · Replies 1 ·
Replies
1
Views
4K
  • · Replies 16 ·
Replies
16
Views
6K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 5 ·
Replies
5
Views
3K
  • · Replies 3 ·
Replies
3
Views
2K
Replies
1
Views
2K
  • · Replies 8 ·
Replies
8
Views
2K
  • · Replies 4 ·
Replies
4
Views
7K