probability distribution vs. probability mass function (PMF): what is the difference between the terms?
Consider a discrete case. PMF is the probability each value of random variable gets. So, for example, X ~ Poisson(2). I plot these probabilities (below), so I can say that I show the PMF of X. But on the other hand I show the distribution of X. For example, I can say whether the distribution I have is symmetrical or not. So, what is the difference between probability distribution and PMF terms (in discrete case)? Below I also bring the definitions from Wikipedia, but it is not helpful either.
Many thanks!
A probability mass function (pmf) is a function that gives the probability that a discrete random variable is exactly equal to some value.
https://en.wikipedia.org/wiki/Probability_mass_function
A probability distribution is a mathematical function that provides the probabilities of occurrence of different possible outcomes in an experiment.
https://en.wikipedia.org/wiki/Probability_distribution
probability probability-distributions terminology
add a comment |
Consider a discrete case. PMF is the probability each value of random variable gets. So, for example, X ~ Poisson(2). I plot these probabilities (below), so I can say that I show the PMF of X. But on the other hand I show the distribution of X. For example, I can say whether the distribution I have is symmetrical or not. So, what is the difference between probability distribution and PMF terms (in discrete case)? Below I also bring the definitions from Wikipedia, but it is not helpful either.
Many thanks!
A probability mass function (pmf) is a function that gives the probability that a discrete random variable is exactly equal to some value.
https://en.wikipedia.org/wiki/Probability_mass_function
A probability distribution is a mathematical function that provides the probabilities of occurrence of different possible outcomes in an experiment.
https://en.wikipedia.org/wiki/Probability_distribution
probability probability-distributions terminology
add a comment |
Consider a discrete case. PMF is the probability each value of random variable gets. So, for example, X ~ Poisson(2). I plot these probabilities (below), so I can say that I show the PMF of X. But on the other hand I show the distribution of X. For example, I can say whether the distribution I have is symmetrical or not. So, what is the difference between probability distribution and PMF terms (in discrete case)? Below I also bring the definitions from Wikipedia, but it is not helpful either.
Many thanks!
A probability mass function (pmf) is a function that gives the probability that a discrete random variable is exactly equal to some value.
https://en.wikipedia.org/wiki/Probability_mass_function
A probability distribution is a mathematical function that provides the probabilities of occurrence of different possible outcomes in an experiment.
https://en.wikipedia.org/wiki/Probability_distribution
probability probability-distributions terminology
Consider a discrete case. PMF is the probability each value of random variable gets. So, for example, X ~ Poisson(2). I plot these probabilities (below), so I can say that I show the PMF of X. But on the other hand I show the distribution of X. For example, I can say whether the distribution I have is symmetrical or not. So, what is the difference between probability distribution and PMF terms (in discrete case)? Below I also bring the definitions from Wikipedia, but it is not helpful either.
Many thanks!
A probability mass function (pmf) is a function that gives the probability that a discrete random variable is exactly equal to some value.
https://en.wikipedia.org/wiki/Probability_mass_function
A probability distribution is a mathematical function that provides the probabilities of occurrence of different possible outcomes in an experiment.
https://en.wikipedia.org/wiki/Probability_distribution
probability probability-distributions terminology
probability probability-distributions terminology
asked 3 hours ago
John
1106
1106
add a comment |
add a comment |
2 Answers
2
active
oldest
votes
The word "distribution" gets thrown around loosely sometimes, which can cause confusion.
The distribution of a random variable $X$ is the function that takes a set $S subset mathbb R$ as input and returns the number $P(X in S)$ as output. (Technically I should assume that $S$ is a "nice" subset of $mathbb R$ in some sense, but let's not worry about that.) I think the Wikipedia article would be more clear if it just gave us this definition up front.
The PMF of a random variable $X$ is the function that takes a number $x in mathbb R$ as input and returns the number $P(X=x)$ as output. If $X$ is a discrete random variable, then the PMF of $X$ is a convenient way to specify the distribution of $X$.
Here is one way to describe the relationship between the distribution of $X$ and the PMF of $X$, in the case where $X$ is a discrete random variable. Suppose that the possible values of $X$ are $x_1,x_2,ldots$ If $f$ is the distribution of $X$, then
$$
f(S) = sum_{i : x_i in S} P(X = x_i)
$$
for any set $S subset mathbb R$.
1
Thanks. But is not the definition of PMF by itself exactly as you described for "distribution of a random variable X"? If not, how they are different?
– John
2 hours ago
1
No, those definitions are not the same. For example, the PMF of $X$ takes a number as input, but the distribution of $X$ takes a set of numbers as input.
– littleO
2 hours ago
1
Thank you a lot, for clarification. But I am still a bit confused regarding your statement "the distribution of X takes a set of numbers as input". Suppose I flip a coin twice, X is number of tails. My PMF is: 0: 1/4, 1: 1/2, 2, 1/4. So, for each value X (0,1,2,) the PMF returns the P(X=x). How will look the distribution function? It would help you can update your answer. Thanks!
– John
2 hours ago
1
Let $f$ be the distribution of the random variable $X$ that you mentioned. Then for example, if $S = (-7,1.3)$ (that is, $S$ is the open interval from $-7$ to $1.3$), then $f(S) = 3/4$. We could attempt to describe $f$ more explicitly but I'm not sure that it would be useful. The definition of $f$ is just that $f(S) = P(X in S)$ for any set $S subset mathbb R$.
– littleO
2 hours ago
1
OK. I see. Thanks a lot.
– John
2 hours ago
|
show 4 more comments
I'm not aware of an agreed upon definition/meaning for probability distribution.
On the other hand, probability mass functions and probability density functions have agreed upon definitions and are used to describe probability distributions.
A probability density function is the generalization of probability mass functions to random variables which are not strictly discrete.
In the case of a discrete random variable, the main difference is that the probability density function should integrate to one, while the probability mass function should add to one.
Suppose $X$ is a discrete random variable taking values $S={x_1,x_2,ldots} subset mathbb{R}$.
The probability mass function is a function $p : Sto [0,1]$ where
$$
p(x) = mathbb{P}(X=x)
$$
On the other hand, the density function (of any RV) can be thought of as,
$$
f(x)dx = mathbb{P}(Xin[x+dx])
$$
In integral form you could write this as,
$$
int_{x}^{x+dx} f(z)dz = mathbb{P}(Xin [x,x+dx])
$$
That is, the density times the width of a small interval gives the probability that $X$ is in that small interval $Xin[x,x+dx]$.
If the random variable is discrete, then the probability that $X$ is in this interval is the same as the probability $X=x$ for small enough $dx$. So you have $f(x)dx = mathbb{P}(X=x)$ (or in integral form, $lim_{dxto 0}int_{x}^{x+dx} f(z)dz = mathbb{P}(X=x)$).
In particular, if $p(x)$ is the pmf for a discrete random variable $X$, then we can write the density function as:
$$
f(x) = sum_{i:p(x_i)neq 0} p(x_i) delta(x-x_i)
$$
where $delta(x)$ is the delta distribution; i.e. $int_a^b f(x)delta(c)d x = f(c)$ whenever $cin[a,b]$
1
Only a continuous random variable has a density function. Note that $lim_{dx to 0} int_x^{x+dx} f(z) dz = 0$, so your final equation states that $P(X = x) = 0$. This is true for a continuous random variable but not for a discrete random variable. (Discrete random variables don't have density functions.)
– littleO
2 hours ago
1
You can write the density of discrete random variables using delta distributions.
– tch
2 hours ago
add a comment |
Your Answer
StackExchange.ifUsing("editor", function () {
return StackExchange.using("mathjaxEditing", function () {
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix) {
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
});
});
}, "mathjax-editing");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "69"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
noCode: true, onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3057745%2fprobability-distribution-vs-probability-mass-function-pmf-what-is-the-differ%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
2 Answers
2
active
oldest
votes
2 Answers
2
active
oldest
votes
active
oldest
votes
active
oldest
votes
The word "distribution" gets thrown around loosely sometimes, which can cause confusion.
The distribution of a random variable $X$ is the function that takes a set $S subset mathbb R$ as input and returns the number $P(X in S)$ as output. (Technically I should assume that $S$ is a "nice" subset of $mathbb R$ in some sense, but let's not worry about that.) I think the Wikipedia article would be more clear if it just gave us this definition up front.
The PMF of a random variable $X$ is the function that takes a number $x in mathbb R$ as input and returns the number $P(X=x)$ as output. If $X$ is a discrete random variable, then the PMF of $X$ is a convenient way to specify the distribution of $X$.
Here is one way to describe the relationship between the distribution of $X$ and the PMF of $X$, in the case where $X$ is a discrete random variable. Suppose that the possible values of $X$ are $x_1,x_2,ldots$ If $f$ is the distribution of $X$, then
$$
f(S) = sum_{i : x_i in S} P(X = x_i)
$$
for any set $S subset mathbb R$.
1
Thanks. But is not the definition of PMF by itself exactly as you described for "distribution of a random variable X"? If not, how they are different?
– John
2 hours ago
1
No, those definitions are not the same. For example, the PMF of $X$ takes a number as input, but the distribution of $X$ takes a set of numbers as input.
– littleO
2 hours ago
1
Thank you a lot, for clarification. But I am still a bit confused regarding your statement "the distribution of X takes a set of numbers as input". Suppose I flip a coin twice, X is number of tails. My PMF is: 0: 1/4, 1: 1/2, 2, 1/4. So, for each value X (0,1,2,) the PMF returns the P(X=x). How will look the distribution function? It would help you can update your answer. Thanks!
– John
2 hours ago
1
Let $f$ be the distribution of the random variable $X$ that you mentioned. Then for example, if $S = (-7,1.3)$ (that is, $S$ is the open interval from $-7$ to $1.3$), then $f(S) = 3/4$. We could attempt to describe $f$ more explicitly but I'm not sure that it would be useful. The definition of $f$ is just that $f(S) = P(X in S)$ for any set $S subset mathbb R$.
– littleO
2 hours ago
1
OK. I see. Thanks a lot.
– John
2 hours ago
|
show 4 more comments
The word "distribution" gets thrown around loosely sometimes, which can cause confusion.
The distribution of a random variable $X$ is the function that takes a set $S subset mathbb R$ as input and returns the number $P(X in S)$ as output. (Technically I should assume that $S$ is a "nice" subset of $mathbb R$ in some sense, but let's not worry about that.) I think the Wikipedia article would be more clear if it just gave us this definition up front.
The PMF of a random variable $X$ is the function that takes a number $x in mathbb R$ as input and returns the number $P(X=x)$ as output. If $X$ is a discrete random variable, then the PMF of $X$ is a convenient way to specify the distribution of $X$.
Here is one way to describe the relationship between the distribution of $X$ and the PMF of $X$, in the case where $X$ is a discrete random variable. Suppose that the possible values of $X$ are $x_1,x_2,ldots$ If $f$ is the distribution of $X$, then
$$
f(S) = sum_{i : x_i in S} P(X = x_i)
$$
for any set $S subset mathbb R$.
1
Thanks. But is not the definition of PMF by itself exactly as you described for "distribution of a random variable X"? If not, how they are different?
– John
2 hours ago
1
No, those definitions are not the same. For example, the PMF of $X$ takes a number as input, but the distribution of $X$ takes a set of numbers as input.
– littleO
2 hours ago
1
Thank you a lot, for clarification. But I am still a bit confused regarding your statement "the distribution of X takes a set of numbers as input". Suppose I flip a coin twice, X is number of tails. My PMF is: 0: 1/4, 1: 1/2, 2, 1/4. So, for each value X (0,1,2,) the PMF returns the P(X=x). How will look the distribution function? It would help you can update your answer. Thanks!
– John
2 hours ago
1
Let $f$ be the distribution of the random variable $X$ that you mentioned. Then for example, if $S = (-7,1.3)$ (that is, $S$ is the open interval from $-7$ to $1.3$), then $f(S) = 3/4$. We could attempt to describe $f$ more explicitly but I'm not sure that it would be useful. The definition of $f$ is just that $f(S) = P(X in S)$ for any set $S subset mathbb R$.
– littleO
2 hours ago
1
OK. I see. Thanks a lot.
– John
2 hours ago
|
show 4 more comments
The word "distribution" gets thrown around loosely sometimes, which can cause confusion.
The distribution of a random variable $X$ is the function that takes a set $S subset mathbb R$ as input and returns the number $P(X in S)$ as output. (Technically I should assume that $S$ is a "nice" subset of $mathbb R$ in some sense, but let's not worry about that.) I think the Wikipedia article would be more clear if it just gave us this definition up front.
The PMF of a random variable $X$ is the function that takes a number $x in mathbb R$ as input and returns the number $P(X=x)$ as output. If $X$ is a discrete random variable, then the PMF of $X$ is a convenient way to specify the distribution of $X$.
Here is one way to describe the relationship between the distribution of $X$ and the PMF of $X$, in the case where $X$ is a discrete random variable. Suppose that the possible values of $X$ are $x_1,x_2,ldots$ If $f$ is the distribution of $X$, then
$$
f(S) = sum_{i : x_i in S} P(X = x_i)
$$
for any set $S subset mathbb R$.
The word "distribution" gets thrown around loosely sometimes, which can cause confusion.
The distribution of a random variable $X$ is the function that takes a set $S subset mathbb R$ as input and returns the number $P(X in S)$ as output. (Technically I should assume that $S$ is a "nice" subset of $mathbb R$ in some sense, but let's not worry about that.) I think the Wikipedia article would be more clear if it just gave us this definition up front.
The PMF of a random variable $X$ is the function that takes a number $x in mathbb R$ as input and returns the number $P(X=x)$ as output. If $X$ is a discrete random variable, then the PMF of $X$ is a convenient way to specify the distribution of $X$.
Here is one way to describe the relationship between the distribution of $X$ and the PMF of $X$, in the case where $X$ is a discrete random variable. Suppose that the possible values of $X$ are $x_1,x_2,ldots$ If $f$ is the distribution of $X$, then
$$
f(S) = sum_{i : x_i in S} P(X = x_i)
$$
for any set $S subset mathbb R$.
edited 1 hour ago
answered 3 hours ago
littleO
29.2k644108
29.2k644108
1
Thanks. But is not the definition of PMF by itself exactly as you described for "distribution of a random variable X"? If not, how they are different?
– John
2 hours ago
1
No, those definitions are not the same. For example, the PMF of $X$ takes a number as input, but the distribution of $X$ takes a set of numbers as input.
– littleO
2 hours ago
1
Thank you a lot, for clarification. But I am still a bit confused regarding your statement "the distribution of X takes a set of numbers as input". Suppose I flip a coin twice, X is number of tails. My PMF is: 0: 1/4, 1: 1/2, 2, 1/4. So, for each value X (0,1,2,) the PMF returns the P(X=x). How will look the distribution function? It would help you can update your answer. Thanks!
– John
2 hours ago
1
Let $f$ be the distribution of the random variable $X$ that you mentioned. Then for example, if $S = (-7,1.3)$ (that is, $S$ is the open interval from $-7$ to $1.3$), then $f(S) = 3/4$. We could attempt to describe $f$ more explicitly but I'm not sure that it would be useful. The definition of $f$ is just that $f(S) = P(X in S)$ for any set $S subset mathbb R$.
– littleO
2 hours ago
1
OK. I see. Thanks a lot.
– John
2 hours ago
|
show 4 more comments
1
Thanks. But is not the definition of PMF by itself exactly as you described for "distribution of a random variable X"? If not, how they are different?
– John
2 hours ago
1
No, those definitions are not the same. For example, the PMF of $X$ takes a number as input, but the distribution of $X$ takes a set of numbers as input.
– littleO
2 hours ago
1
Thank you a lot, for clarification. But I am still a bit confused regarding your statement "the distribution of X takes a set of numbers as input". Suppose I flip a coin twice, X is number of tails. My PMF is: 0: 1/4, 1: 1/2, 2, 1/4. So, for each value X (0,1,2,) the PMF returns the P(X=x). How will look the distribution function? It would help you can update your answer. Thanks!
– John
2 hours ago
1
Let $f$ be the distribution of the random variable $X$ that you mentioned. Then for example, if $S = (-7,1.3)$ (that is, $S$ is the open interval from $-7$ to $1.3$), then $f(S) = 3/4$. We could attempt to describe $f$ more explicitly but I'm not sure that it would be useful. The definition of $f$ is just that $f(S) = P(X in S)$ for any set $S subset mathbb R$.
– littleO
2 hours ago
1
OK. I see. Thanks a lot.
– John
2 hours ago
1
1
Thanks. But is not the definition of PMF by itself exactly as you described for "distribution of a random variable X"? If not, how they are different?
– John
2 hours ago
Thanks. But is not the definition of PMF by itself exactly as you described for "distribution of a random variable X"? If not, how they are different?
– John
2 hours ago
1
1
No, those definitions are not the same. For example, the PMF of $X$ takes a number as input, but the distribution of $X$ takes a set of numbers as input.
– littleO
2 hours ago
No, those definitions are not the same. For example, the PMF of $X$ takes a number as input, but the distribution of $X$ takes a set of numbers as input.
– littleO
2 hours ago
1
1
Thank you a lot, for clarification. But I am still a bit confused regarding your statement "the distribution of X takes a set of numbers as input". Suppose I flip a coin twice, X is number of tails. My PMF is: 0: 1/4, 1: 1/2, 2, 1/4. So, for each value X (0,1,2,) the PMF returns the P(X=x). How will look the distribution function? It would help you can update your answer. Thanks!
– John
2 hours ago
Thank you a lot, for clarification. But I am still a bit confused regarding your statement "the distribution of X takes a set of numbers as input". Suppose I flip a coin twice, X is number of tails. My PMF is: 0: 1/4, 1: 1/2, 2, 1/4. So, for each value X (0,1,2,) the PMF returns the P(X=x). How will look the distribution function? It would help you can update your answer. Thanks!
– John
2 hours ago
1
1
Let $f$ be the distribution of the random variable $X$ that you mentioned. Then for example, if $S = (-7,1.3)$ (that is, $S$ is the open interval from $-7$ to $1.3$), then $f(S) = 3/4$. We could attempt to describe $f$ more explicitly but I'm not sure that it would be useful. The definition of $f$ is just that $f(S) = P(X in S)$ for any set $S subset mathbb R$.
– littleO
2 hours ago
Let $f$ be the distribution of the random variable $X$ that you mentioned. Then for example, if $S = (-7,1.3)$ (that is, $S$ is the open interval from $-7$ to $1.3$), then $f(S) = 3/4$. We could attempt to describe $f$ more explicitly but I'm not sure that it would be useful. The definition of $f$ is just that $f(S) = P(X in S)$ for any set $S subset mathbb R$.
– littleO
2 hours ago
1
1
OK. I see. Thanks a lot.
– John
2 hours ago
OK. I see. Thanks a lot.
– John
2 hours ago
|
show 4 more comments
I'm not aware of an agreed upon definition/meaning for probability distribution.
On the other hand, probability mass functions and probability density functions have agreed upon definitions and are used to describe probability distributions.
A probability density function is the generalization of probability mass functions to random variables which are not strictly discrete.
In the case of a discrete random variable, the main difference is that the probability density function should integrate to one, while the probability mass function should add to one.
Suppose $X$ is a discrete random variable taking values $S={x_1,x_2,ldots} subset mathbb{R}$.
The probability mass function is a function $p : Sto [0,1]$ where
$$
p(x) = mathbb{P}(X=x)
$$
On the other hand, the density function (of any RV) can be thought of as,
$$
f(x)dx = mathbb{P}(Xin[x+dx])
$$
In integral form you could write this as,
$$
int_{x}^{x+dx} f(z)dz = mathbb{P}(Xin [x,x+dx])
$$
That is, the density times the width of a small interval gives the probability that $X$ is in that small interval $Xin[x,x+dx]$.
If the random variable is discrete, then the probability that $X$ is in this interval is the same as the probability $X=x$ for small enough $dx$. So you have $f(x)dx = mathbb{P}(X=x)$ (or in integral form, $lim_{dxto 0}int_{x}^{x+dx} f(z)dz = mathbb{P}(X=x)$).
In particular, if $p(x)$ is the pmf for a discrete random variable $X$, then we can write the density function as:
$$
f(x) = sum_{i:p(x_i)neq 0} p(x_i) delta(x-x_i)
$$
where $delta(x)$ is the delta distribution; i.e. $int_a^b f(x)delta(c)d x = f(c)$ whenever $cin[a,b]$
1
Only a continuous random variable has a density function. Note that $lim_{dx to 0} int_x^{x+dx} f(z) dz = 0$, so your final equation states that $P(X = x) = 0$. This is true for a continuous random variable but not for a discrete random variable. (Discrete random variables don't have density functions.)
– littleO
2 hours ago
1
You can write the density of discrete random variables using delta distributions.
– tch
2 hours ago
add a comment |
I'm not aware of an agreed upon definition/meaning for probability distribution.
On the other hand, probability mass functions and probability density functions have agreed upon definitions and are used to describe probability distributions.
A probability density function is the generalization of probability mass functions to random variables which are not strictly discrete.
In the case of a discrete random variable, the main difference is that the probability density function should integrate to one, while the probability mass function should add to one.
Suppose $X$ is a discrete random variable taking values $S={x_1,x_2,ldots} subset mathbb{R}$.
The probability mass function is a function $p : Sto [0,1]$ where
$$
p(x) = mathbb{P}(X=x)
$$
On the other hand, the density function (of any RV) can be thought of as,
$$
f(x)dx = mathbb{P}(Xin[x+dx])
$$
In integral form you could write this as,
$$
int_{x}^{x+dx} f(z)dz = mathbb{P}(Xin [x,x+dx])
$$
That is, the density times the width of a small interval gives the probability that $X$ is in that small interval $Xin[x,x+dx]$.
If the random variable is discrete, then the probability that $X$ is in this interval is the same as the probability $X=x$ for small enough $dx$. So you have $f(x)dx = mathbb{P}(X=x)$ (or in integral form, $lim_{dxto 0}int_{x}^{x+dx} f(z)dz = mathbb{P}(X=x)$).
In particular, if $p(x)$ is the pmf for a discrete random variable $X$, then we can write the density function as:
$$
f(x) = sum_{i:p(x_i)neq 0} p(x_i) delta(x-x_i)
$$
where $delta(x)$ is the delta distribution; i.e. $int_a^b f(x)delta(c)d x = f(c)$ whenever $cin[a,b]$
1
Only a continuous random variable has a density function. Note that $lim_{dx to 0} int_x^{x+dx} f(z) dz = 0$, so your final equation states that $P(X = x) = 0$. This is true for a continuous random variable but not for a discrete random variable. (Discrete random variables don't have density functions.)
– littleO
2 hours ago
1
You can write the density of discrete random variables using delta distributions.
– tch
2 hours ago
add a comment |
I'm not aware of an agreed upon definition/meaning for probability distribution.
On the other hand, probability mass functions and probability density functions have agreed upon definitions and are used to describe probability distributions.
A probability density function is the generalization of probability mass functions to random variables which are not strictly discrete.
In the case of a discrete random variable, the main difference is that the probability density function should integrate to one, while the probability mass function should add to one.
Suppose $X$ is a discrete random variable taking values $S={x_1,x_2,ldots} subset mathbb{R}$.
The probability mass function is a function $p : Sto [0,1]$ where
$$
p(x) = mathbb{P}(X=x)
$$
On the other hand, the density function (of any RV) can be thought of as,
$$
f(x)dx = mathbb{P}(Xin[x+dx])
$$
In integral form you could write this as,
$$
int_{x}^{x+dx} f(z)dz = mathbb{P}(Xin [x,x+dx])
$$
That is, the density times the width of a small interval gives the probability that $X$ is in that small interval $Xin[x,x+dx]$.
If the random variable is discrete, then the probability that $X$ is in this interval is the same as the probability $X=x$ for small enough $dx$. So you have $f(x)dx = mathbb{P}(X=x)$ (or in integral form, $lim_{dxto 0}int_{x}^{x+dx} f(z)dz = mathbb{P}(X=x)$).
In particular, if $p(x)$ is the pmf for a discrete random variable $X$, then we can write the density function as:
$$
f(x) = sum_{i:p(x_i)neq 0} p(x_i) delta(x-x_i)
$$
where $delta(x)$ is the delta distribution; i.e. $int_a^b f(x)delta(c)d x = f(c)$ whenever $cin[a,b]$
I'm not aware of an agreed upon definition/meaning for probability distribution.
On the other hand, probability mass functions and probability density functions have agreed upon definitions and are used to describe probability distributions.
A probability density function is the generalization of probability mass functions to random variables which are not strictly discrete.
In the case of a discrete random variable, the main difference is that the probability density function should integrate to one, while the probability mass function should add to one.
Suppose $X$ is a discrete random variable taking values $S={x_1,x_2,ldots} subset mathbb{R}$.
The probability mass function is a function $p : Sto [0,1]$ where
$$
p(x) = mathbb{P}(X=x)
$$
On the other hand, the density function (of any RV) can be thought of as,
$$
f(x)dx = mathbb{P}(Xin[x+dx])
$$
In integral form you could write this as,
$$
int_{x}^{x+dx} f(z)dz = mathbb{P}(Xin [x,x+dx])
$$
That is, the density times the width of a small interval gives the probability that $X$ is in that small interval $Xin[x,x+dx]$.
If the random variable is discrete, then the probability that $X$ is in this interval is the same as the probability $X=x$ for small enough $dx$. So you have $f(x)dx = mathbb{P}(X=x)$ (or in integral form, $lim_{dxto 0}int_{x}^{x+dx} f(z)dz = mathbb{P}(X=x)$).
In particular, if $p(x)$ is the pmf for a discrete random variable $X$, then we can write the density function as:
$$
f(x) = sum_{i:p(x_i)neq 0} p(x_i) delta(x-x_i)
$$
where $delta(x)$ is the delta distribution; i.e. $int_a^b f(x)delta(c)d x = f(c)$ whenever $cin[a,b]$
edited 1 hour ago
answered 3 hours ago
tch
32919
32919
1
Only a continuous random variable has a density function. Note that $lim_{dx to 0} int_x^{x+dx} f(z) dz = 0$, so your final equation states that $P(X = x) = 0$. This is true for a continuous random variable but not for a discrete random variable. (Discrete random variables don't have density functions.)
– littleO
2 hours ago
1
You can write the density of discrete random variables using delta distributions.
– tch
2 hours ago
add a comment |
1
Only a continuous random variable has a density function. Note that $lim_{dx to 0} int_x^{x+dx} f(z) dz = 0$, so your final equation states that $P(X = x) = 0$. This is true for a continuous random variable but not for a discrete random variable. (Discrete random variables don't have density functions.)
– littleO
2 hours ago
1
You can write the density of discrete random variables using delta distributions.
– tch
2 hours ago
1
1
Only a continuous random variable has a density function. Note that $lim_{dx to 0} int_x^{x+dx} f(z) dz = 0$, so your final equation states that $P(X = x) = 0$. This is true for a continuous random variable but not for a discrete random variable. (Discrete random variables don't have density functions.)
– littleO
2 hours ago
Only a continuous random variable has a density function. Note that $lim_{dx to 0} int_x^{x+dx} f(z) dz = 0$, so your final equation states that $P(X = x) = 0$. This is true for a continuous random variable but not for a discrete random variable. (Discrete random variables don't have density functions.)
– littleO
2 hours ago
1
1
You can write the density of discrete random variables using delta distributions.
– tch
2 hours ago
You can write the density of discrete random variables using delta distributions.
– tch
2 hours ago
add a comment |
Thanks for contributing an answer to Mathematics Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Some of your past answers have not been well-received, and you're in danger of being blocked from answering.
Please pay close attention to the following guidance:
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3057745%2fprobability-distribution-vs-probability-mass-function-pmf-what-is-the-differ%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown