How to derive the formula for the expected value for maximum of n normal random variables
$begingroup$
This is a follow-up question on this one: Expected value for maximum of n normal random variable
@RobertIsrael states the following:
Presumably the $X_i$ are independent. If $Phi$ is the standard normal cdf,
$$P(max_i X_i < mu + t sigma) = prod_i P(X_i < mu + t sigma) = Phi(t)^n$$
so
$$ E[max_i X_i] = mu + sigma int_{-infty}^infty t dfrac{d}{dt} Phi(t)^n dt $$
I can see some of the ideas that lead to this formula (e.g. the multiplication because of independence) but I don't see all of the details. It would be very helpful if somebody could explain the derivation in detail... Thank you!
probability proof-explanation normal-distribution
$endgroup$
add a comment |
$begingroup$
This is a follow-up question on this one: Expected value for maximum of n normal random variable
@RobertIsrael states the following:
Presumably the $X_i$ are independent. If $Phi$ is the standard normal cdf,
$$P(max_i X_i < mu + t sigma) = prod_i P(X_i < mu + t sigma) = Phi(t)^n$$
so
$$ E[max_i X_i] = mu + sigma int_{-infty}^infty t dfrac{d}{dt} Phi(t)^n dt $$
I can see some of the ideas that lead to this formula (e.g. the multiplication because of independence) but I don't see all of the details. It would be very helpful if somebody could explain the derivation in detail... Thank you!
probability proof-explanation normal-distribution
$endgroup$
add a comment |
$begingroup$
This is a follow-up question on this one: Expected value for maximum of n normal random variable
@RobertIsrael states the following:
Presumably the $X_i$ are independent. If $Phi$ is the standard normal cdf,
$$P(max_i X_i < mu + t sigma) = prod_i P(X_i < mu + t sigma) = Phi(t)^n$$
so
$$ E[max_i X_i] = mu + sigma int_{-infty}^infty t dfrac{d}{dt} Phi(t)^n dt $$
I can see some of the ideas that lead to this formula (e.g. the multiplication because of independence) but I don't see all of the details. It would be very helpful if somebody could explain the derivation in detail... Thank you!
probability proof-explanation normal-distribution
$endgroup$
This is a follow-up question on this one: Expected value for maximum of n normal random variable
@RobertIsrael states the following:
Presumably the $X_i$ are independent. If $Phi$ is the standard normal cdf,
$$P(max_i X_i < mu + t sigma) = prod_i P(X_i < mu + t sigma) = Phi(t)^n$$
so
$$ E[max_i X_i] = mu + sigma int_{-infty}^infty t dfrac{d}{dt} Phi(t)^n dt $$
I can see some of the ideas that lead to this formula (e.g. the multiplication because of independence) but I don't see all of the details. It would be very helpful if somebody could explain the derivation in detail... Thank you!
probability proof-explanation normal-distribution
probability proof-explanation normal-distribution
asked Jan 20 at 9:13
vonjdvonjd
4,23574058
4,23574058
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
$begingroup$
It is basically using the definition of expected value and one simple substitution. The first equation can be rewritten as
$$
mathbb{P}(max_i X_i < t) = Phileft(frac{t - mu}{sigma}right)^n.
$$
Then, by definition
$$
mathbb{E} max_i X_i = int_{-infty}^{+infty} t cdot frac{d}{dt} Phileft(frac{t - mu}{sigma}right)^n dt = int_{-infty}^{+infty} sigma(t + mu) cdot sigma frac{d}{dt} Phi(t)^n frac{dt}{sigma} = mu + sigma int_{-infty}^{+infty} tcdot frac{d}{dt} Phi(t)^n dt,
$$
as desired.
So, in the first equation we used the substitution $t to sigma t + mu$, in the second one we simplified the expression and used that integral of the density function over the whole domain is $1$.
$endgroup$
$begingroup$
Thank you, which definition are you using for the $d/dt$?
$endgroup$
– vonjd
Jan 20 at 9:54
$begingroup$
$frac{d}{dt}$ is the derivative operator, so $frac{d}{dt} Phi(t)^n$ becomes the density function. is it clear now?
$endgroup$
– pointguard0
Jan 20 at 9:56
$begingroup$
because the probability density function (which is used in the definition of expected value) is the derivative of cumulative distribution function
$endgroup$
– pointguard0
Jan 20 at 10:15
1
$begingroup$
Yes, got it - Thank you!
$endgroup$
– vonjd
Jan 20 at 11:02
add a comment |
Your Answer
StackExchange.ifUsing("editor", function () {
return StackExchange.using("mathjaxEditing", function () {
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix) {
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
});
});
}, "mathjax-editing");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "69"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
noCode: true, onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3080348%2fhow-to-derive-the-formula-for-the-expected-value-for-maximum-of-n-normal-random%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
$begingroup$
It is basically using the definition of expected value and one simple substitution. The first equation can be rewritten as
$$
mathbb{P}(max_i X_i < t) = Phileft(frac{t - mu}{sigma}right)^n.
$$
Then, by definition
$$
mathbb{E} max_i X_i = int_{-infty}^{+infty} t cdot frac{d}{dt} Phileft(frac{t - mu}{sigma}right)^n dt = int_{-infty}^{+infty} sigma(t + mu) cdot sigma frac{d}{dt} Phi(t)^n frac{dt}{sigma} = mu + sigma int_{-infty}^{+infty} tcdot frac{d}{dt} Phi(t)^n dt,
$$
as desired.
So, in the first equation we used the substitution $t to sigma t + mu$, in the second one we simplified the expression and used that integral of the density function over the whole domain is $1$.
$endgroup$
$begingroup$
Thank you, which definition are you using for the $d/dt$?
$endgroup$
– vonjd
Jan 20 at 9:54
$begingroup$
$frac{d}{dt}$ is the derivative operator, so $frac{d}{dt} Phi(t)^n$ becomes the density function. is it clear now?
$endgroup$
– pointguard0
Jan 20 at 9:56
$begingroup$
because the probability density function (which is used in the definition of expected value) is the derivative of cumulative distribution function
$endgroup$
– pointguard0
Jan 20 at 10:15
1
$begingroup$
Yes, got it - Thank you!
$endgroup$
– vonjd
Jan 20 at 11:02
add a comment |
$begingroup$
It is basically using the definition of expected value and one simple substitution. The first equation can be rewritten as
$$
mathbb{P}(max_i X_i < t) = Phileft(frac{t - mu}{sigma}right)^n.
$$
Then, by definition
$$
mathbb{E} max_i X_i = int_{-infty}^{+infty} t cdot frac{d}{dt} Phileft(frac{t - mu}{sigma}right)^n dt = int_{-infty}^{+infty} sigma(t + mu) cdot sigma frac{d}{dt} Phi(t)^n frac{dt}{sigma} = mu + sigma int_{-infty}^{+infty} tcdot frac{d}{dt} Phi(t)^n dt,
$$
as desired.
So, in the first equation we used the substitution $t to sigma t + mu$, in the second one we simplified the expression and used that integral of the density function over the whole domain is $1$.
$endgroup$
$begingroup$
Thank you, which definition are you using for the $d/dt$?
$endgroup$
– vonjd
Jan 20 at 9:54
$begingroup$
$frac{d}{dt}$ is the derivative operator, so $frac{d}{dt} Phi(t)^n$ becomes the density function. is it clear now?
$endgroup$
– pointguard0
Jan 20 at 9:56
$begingroup$
because the probability density function (which is used in the definition of expected value) is the derivative of cumulative distribution function
$endgroup$
– pointguard0
Jan 20 at 10:15
1
$begingroup$
Yes, got it - Thank you!
$endgroup$
– vonjd
Jan 20 at 11:02
add a comment |
$begingroup$
It is basically using the definition of expected value and one simple substitution. The first equation can be rewritten as
$$
mathbb{P}(max_i X_i < t) = Phileft(frac{t - mu}{sigma}right)^n.
$$
Then, by definition
$$
mathbb{E} max_i X_i = int_{-infty}^{+infty} t cdot frac{d}{dt} Phileft(frac{t - mu}{sigma}right)^n dt = int_{-infty}^{+infty} sigma(t + mu) cdot sigma frac{d}{dt} Phi(t)^n frac{dt}{sigma} = mu + sigma int_{-infty}^{+infty} tcdot frac{d}{dt} Phi(t)^n dt,
$$
as desired.
So, in the first equation we used the substitution $t to sigma t + mu$, in the second one we simplified the expression and used that integral of the density function over the whole domain is $1$.
$endgroup$
It is basically using the definition of expected value and one simple substitution. The first equation can be rewritten as
$$
mathbb{P}(max_i X_i < t) = Phileft(frac{t - mu}{sigma}right)^n.
$$
Then, by definition
$$
mathbb{E} max_i X_i = int_{-infty}^{+infty} t cdot frac{d}{dt} Phileft(frac{t - mu}{sigma}right)^n dt = int_{-infty}^{+infty} sigma(t + mu) cdot sigma frac{d}{dt} Phi(t)^n frac{dt}{sigma} = mu + sigma int_{-infty}^{+infty} tcdot frac{d}{dt} Phi(t)^n dt,
$$
as desired.
So, in the first equation we used the substitution $t to sigma t + mu$, in the second one we simplified the expression and used that integral of the density function over the whole domain is $1$.
answered Jan 20 at 9:27
pointguard0pointguard0
1,4801021
1,4801021
$begingroup$
Thank you, which definition are you using for the $d/dt$?
$endgroup$
– vonjd
Jan 20 at 9:54
$begingroup$
$frac{d}{dt}$ is the derivative operator, so $frac{d}{dt} Phi(t)^n$ becomes the density function. is it clear now?
$endgroup$
– pointguard0
Jan 20 at 9:56
$begingroup$
because the probability density function (which is used in the definition of expected value) is the derivative of cumulative distribution function
$endgroup$
– pointguard0
Jan 20 at 10:15
1
$begingroup$
Yes, got it - Thank you!
$endgroup$
– vonjd
Jan 20 at 11:02
add a comment |
$begingroup$
Thank you, which definition are you using for the $d/dt$?
$endgroup$
– vonjd
Jan 20 at 9:54
$begingroup$
$frac{d}{dt}$ is the derivative operator, so $frac{d}{dt} Phi(t)^n$ becomes the density function. is it clear now?
$endgroup$
– pointguard0
Jan 20 at 9:56
$begingroup$
because the probability density function (which is used in the definition of expected value) is the derivative of cumulative distribution function
$endgroup$
– pointguard0
Jan 20 at 10:15
1
$begingroup$
Yes, got it - Thank you!
$endgroup$
– vonjd
Jan 20 at 11:02
$begingroup$
Thank you, which definition are you using for the $d/dt$?
$endgroup$
– vonjd
Jan 20 at 9:54
$begingroup$
Thank you, which definition are you using for the $d/dt$?
$endgroup$
– vonjd
Jan 20 at 9:54
$begingroup$
$frac{d}{dt}$ is the derivative operator, so $frac{d}{dt} Phi(t)^n$ becomes the density function. is it clear now?
$endgroup$
– pointguard0
Jan 20 at 9:56
$begingroup$
$frac{d}{dt}$ is the derivative operator, so $frac{d}{dt} Phi(t)^n$ becomes the density function. is it clear now?
$endgroup$
– pointguard0
Jan 20 at 9:56
$begingroup$
because the probability density function (which is used in the definition of expected value) is the derivative of cumulative distribution function
$endgroup$
– pointguard0
Jan 20 at 10:15
$begingroup$
because the probability density function (which is used in the definition of expected value) is the derivative of cumulative distribution function
$endgroup$
– pointguard0
Jan 20 at 10:15
1
1
$begingroup$
Yes, got it - Thank you!
$endgroup$
– vonjd
Jan 20 at 11:02
$begingroup$
Yes, got it - Thank you!
$endgroup$
– vonjd
Jan 20 at 11:02
add a comment |
Thanks for contributing an answer to Mathematics Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3080348%2fhow-to-derive-the-formula-for-the-expected-value-for-maximum-of-n-normal-random%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown