Fit data to parametric distribution












5














I have data with nice bell-shaped histogram PDF. However, the Normal distribution fitting (by calculating mean and variance) does not work as the figure below.



normal fit Failed



My question is that if there are other distributions I should try according to your experience. In other words, by which distribution should a nice bell-shaped data, which is not well fit by Normal distribution, be fit.



My ultimate goal is to have an approximated analytic form of cummulative distribution function to analyze the according probability. Thus any advices towards solving this goal are appreciated.



I include the data (space as delimiter):
Data to fit.



Update: q-q plot
QQ-plot










share|cite|improve this question









New contributor




Anna Noie is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
















  • 3




    Welcome to the site, Anna. What is your ultimate goal? Why are you trying to fit a distribution to these data? What are you hoping to achieve in the end?
    – COOLSerdash
    2 days ago






  • 1




    @Xi'an it is not. My question is that by which distribution should a nice bell-shaped data, which is not well fit by Normal distribution, be fit.
    – Anna Noie
    2 days ago








  • 4




    A better plot to show us would be a qq-plot
    – kjetil b halvorsen
    2 days ago






  • 6




    There is a different global view on the problem: if you don't know the functional form of the real distribution and hope to judge any fit by its agreement with the observed histogram, the ultimate fit will have the precision of the histogram, due to model uncertainty. So I would just compute the empirical cumulative distribution function, a nonparametric estimator, and be done. This is the cumulative histogram when there is no binning of the data.
    – Frank Harrell
    2 days ago






  • 1




    One thing to try is my online statistical distribution fitter at zunzun.com/StatisticalDistributions/1 to see of it suggests any good candidate distributions. It fits the data to over 80 of the continuous statistical distributions in scipy, and is open source.
    – James Phillips
    2 days ago
















5














I have data with nice bell-shaped histogram PDF. However, the Normal distribution fitting (by calculating mean and variance) does not work as the figure below.



normal fit Failed



My question is that if there are other distributions I should try according to your experience. In other words, by which distribution should a nice bell-shaped data, which is not well fit by Normal distribution, be fit.



My ultimate goal is to have an approximated analytic form of cummulative distribution function to analyze the according probability. Thus any advices towards solving this goal are appreciated.



I include the data (space as delimiter):
Data to fit.



Update: q-q plot
QQ-plot










share|cite|improve this question









New contributor




Anna Noie is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
















  • 3




    Welcome to the site, Anna. What is your ultimate goal? Why are you trying to fit a distribution to these data? What are you hoping to achieve in the end?
    – COOLSerdash
    2 days ago






  • 1




    @Xi'an it is not. My question is that by which distribution should a nice bell-shaped data, which is not well fit by Normal distribution, be fit.
    – Anna Noie
    2 days ago








  • 4




    A better plot to show us would be a qq-plot
    – kjetil b halvorsen
    2 days ago






  • 6




    There is a different global view on the problem: if you don't know the functional form of the real distribution and hope to judge any fit by its agreement with the observed histogram, the ultimate fit will have the precision of the histogram, due to model uncertainty. So I would just compute the empirical cumulative distribution function, a nonparametric estimator, and be done. This is the cumulative histogram when there is no binning of the data.
    – Frank Harrell
    2 days ago






  • 1




    One thing to try is my online statistical distribution fitter at zunzun.com/StatisticalDistributions/1 to see of it suggests any good candidate distributions. It fits the data to over 80 of the continuous statistical distributions in scipy, and is open source.
    – James Phillips
    2 days ago














5












5








5


1





I have data with nice bell-shaped histogram PDF. However, the Normal distribution fitting (by calculating mean and variance) does not work as the figure below.



normal fit Failed



My question is that if there are other distributions I should try according to your experience. In other words, by which distribution should a nice bell-shaped data, which is not well fit by Normal distribution, be fit.



My ultimate goal is to have an approximated analytic form of cummulative distribution function to analyze the according probability. Thus any advices towards solving this goal are appreciated.



I include the data (space as delimiter):
Data to fit.



Update: q-q plot
QQ-plot










share|cite|improve this question









New contributor




Anna Noie is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.











I have data with nice bell-shaped histogram PDF. However, the Normal distribution fitting (by calculating mean and variance) does not work as the figure below.



normal fit Failed



My question is that if there are other distributions I should try according to your experience. In other words, by which distribution should a nice bell-shaped data, which is not well fit by Normal distribution, be fit.



My ultimate goal is to have an approximated analytic form of cummulative distribution function to analyze the according probability. Thus any advices towards solving this goal are appreciated.



I include the data (space as delimiter):
Data to fit.



Update: q-q plot
QQ-plot







distributions normal-distribution descriptive-statistics fitting






share|cite|improve this question









New contributor




Anna Noie is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.











share|cite|improve this question









New contributor




Anna Noie is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.









share|cite|improve this question




share|cite|improve this question








edited 1 hour ago









kjetil b halvorsen

28.9k980208




28.9k980208






New contributor




Anna Noie is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.









asked 2 days ago









Anna NoieAnna Noie

262




262




New contributor




Anna Noie is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.





New contributor





Anna Noie is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.






Anna Noie is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.








  • 3




    Welcome to the site, Anna. What is your ultimate goal? Why are you trying to fit a distribution to these data? What are you hoping to achieve in the end?
    – COOLSerdash
    2 days ago






  • 1




    @Xi'an it is not. My question is that by which distribution should a nice bell-shaped data, which is not well fit by Normal distribution, be fit.
    – Anna Noie
    2 days ago








  • 4




    A better plot to show us would be a qq-plot
    – kjetil b halvorsen
    2 days ago






  • 6




    There is a different global view on the problem: if you don't know the functional form of the real distribution and hope to judge any fit by its agreement with the observed histogram, the ultimate fit will have the precision of the histogram, due to model uncertainty. So I would just compute the empirical cumulative distribution function, a nonparametric estimator, and be done. This is the cumulative histogram when there is no binning of the data.
    – Frank Harrell
    2 days ago






  • 1




    One thing to try is my online statistical distribution fitter at zunzun.com/StatisticalDistributions/1 to see of it suggests any good candidate distributions. It fits the data to over 80 of the continuous statistical distributions in scipy, and is open source.
    – James Phillips
    2 days ago














  • 3




    Welcome to the site, Anna. What is your ultimate goal? Why are you trying to fit a distribution to these data? What are you hoping to achieve in the end?
    – COOLSerdash
    2 days ago






  • 1




    @Xi'an it is not. My question is that by which distribution should a nice bell-shaped data, which is not well fit by Normal distribution, be fit.
    – Anna Noie
    2 days ago








  • 4




    A better plot to show us would be a qq-plot
    – kjetil b halvorsen
    2 days ago






  • 6




    There is a different global view on the problem: if you don't know the functional form of the real distribution and hope to judge any fit by its agreement with the observed histogram, the ultimate fit will have the precision of the histogram, due to model uncertainty. So I would just compute the empirical cumulative distribution function, a nonparametric estimator, and be done. This is the cumulative histogram when there is no binning of the data.
    – Frank Harrell
    2 days ago






  • 1




    One thing to try is my online statistical distribution fitter at zunzun.com/StatisticalDistributions/1 to see of it suggests any good candidate distributions. It fits the data to over 80 of the continuous statistical distributions in scipy, and is open source.
    – James Phillips
    2 days ago








3




3




Welcome to the site, Anna. What is your ultimate goal? Why are you trying to fit a distribution to these data? What are you hoping to achieve in the end?
– COOLSerdash
2 days ago




Welcome to the site, Anna. What is your ultimate goal? Why are you trying to fit a distribution to these data? What are you hoping to achieve in the end?
– COOLSerdash
2 days ago




1




1




@Xi'an it is not. My question is that by which distribution should a nice bell-shaped data, which is not well fit by Normal distribution, be fit.
– Anna Noie
2 days ago






@Xi'an it is not. My question is that by which distribution should a nice bell-shaped data, which is not well fit by Normal distribution, be fit.
– Anna Noie
2 days ago






4




4




A better plot to show us would be a qq-plot
– kjetil b halvorsen
2 days ago




A better plot to show us would be a qq-plot
– kjetil b halvorsen
2 days ago




6




6




There is a different global view on the problem: if you don't know the functional form of the real distribution and hope to judge any fit by its agreement with the observed histogram, the ultimate fit will have the precision of the histogram, due to model uncertainty. So I would just compute the empirical cumulative distribution function, a nonparametric estimator, and be done. This is the cumulative histogram when there is no binning of the data.
– Frank Harrell
2 days ago




There is a different global view on the problem: if you don't know the functional form of the real distribution and hope to judge any fit by its agreement with the observed histogram, the ultimate fit will have the precision of the histogram, due to model uncertainty. So I would just compute the empirical cumulative distribution function, a nonparametric estimator, and be done. This is the cumulative histogram when there is no binning of the data.
– Frank Harrell
2 days ago




1




1




One thing to try is my online statistical distribution fitter at zunzun.com/StatisticalDistributions/1 to see of it suggests any good candidate distributions. It fits the data to over 80 of the continuous statistical distributions in scipy, and is open source.
– James Phillips
2 days ago




One thing to try is my online statistical distribution fitter at zunzun.com/StatisticalDistributions/1 to see of it suggests any good candidate distributions. It fits the data to over 80 of the continuous statistical distributions in scipy, and is open source.
– James Phillips
2 days ago










2 Answers
2






active

oldest

votes


















3














The histogram, as presented by the OP, gives the impression that the data is symmetrical. Given that the data is noticeably more peaked than Normal, and if the data is roughly symmetrical, then a natural suggestion to try is the Student's t with location parameter $mu$, scale parameter $sigma$, and $v$ degrees of freedom, and pdf $f(x)$:



$$f = frac{1}{sigma sqrt{v} ; Bleft(frac{v}{2},frac{1}{2}right)} left(frac{v}{v+frac{(x-mu )^2}{sigma ^2}}right)^{frac{v+1}{2}} quad text{defined on the real line}$$



Student t fit



The following diagram shows a sample fit using the Student's t, with $mu = 5.45$, $sigma = 6.61$ and $v = 2.97$:



enter image description here



In the diagram:




  • the dashed red curve is the fitted Student's t pdf


  • the squiggly blue curve is the empirical pdf (frequency polygon) of the raw data



On the upside, this appears to be a significantly better fit than the Normal, using the same raw data set provided.



On the possible downside, I am not sure I would fully agree with the OP's opening statement: "I have data with nice bell-shaped histogram PDF". In particular, if one looks more closely at your data set (which contains 100,000 samples), the maximum is 37.45, while the minimum is -910. Moreover, there is not just one large negative value, but a whole bunch of them. This suggests that your data set is not symmetrical, but negatively skewed ... and that there other things going on in the tails, and if so, other distributions may perhaps be better suited. Zooming out, again with the same Student's t fit, we can see this feature of the data, in the right and left tails:



enter image description here






share|cite|improve this answer





















  • I also found student;s t to work well per your answer. Additionally, I found the Johnson SU to work well here.
    – James Phillips
    yesterday



















3














In short: your two plots show a big discrepancy, the smallest values shown in the histogram is about $-30$, while the qqplot shows values down to around $-900$. All those lom-tailed outliers is about 0.7% of the sample, but dominates the qqplot. So you need to ask yourself what produces those outliers! and that should guide you to what to do with your data. If I make a qqplot after eliminating that long tail, it looks much closer to normal, but not perfect. Look at these:



mean(Y)
[1] 3.9657
mean(Y[Y>= -30])
[1] 4.414797


but the effect on standard deviation is larger:



sd(Y)
[1] 10.92237
sd(Y[Y>= -30])
[1] 8.006223


and that explains the strange form of your first plot (histogram): the fitted normal curve you shows is influenced by that long tail you omitted from the plot.






share|cite|improve this answer



















  • 1




    Thanks, great advice. I understand that perfect fitting of the probability density function is not very feasible. As I just edit my question, my goal is to have an approximated analytic CDF. I am thinking about your advice about dominated outliners.
    – Anna Noie
    2 days ago






  • 4




    To give better advice, we really need to know the context. What does your variable measure, and what is the goal of modeling?
    – kjetil b halvorsen
    2 days ago











Your Answer





StackExchange.ifUsing("editor", function () {
return StackExchange.using("mathjaxEditing", function () {
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix) {
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
});
});
}, "mathjax-editing");

StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "65"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});

function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});


}
});






Anna Noie is a new contributor. Be nice, and check out our Code of Conduct.










draft saved

draft discarded


















StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstats.stackexchange.com%2fquestions%2f385728%2ffit-data-to-parametric-distribution%23new-answer', 'question_page');
}
);

Post as a guest















Required, but never shown

























2 Answers
2






active

oldest

votes








2 Answers
2






active

oldest

votes









active

oldest

votes






active

oldest

votes









3














The histogram, as presented by the OP, gives the impression that the data is symmetrical. Given that the data is noticeably more peaked than Normal, and if the data is roughly symmetrical, then a natural suggestion to try is the Student's t with location parameter $mu$, scale parameter $sigma$, and $v$ degrees of freedom, and pdf $f(x)$:



$$f = frac{1}{sigma sqrt{v} ; Bleft(frac{v}{2},frac{1}{2}right)} left(frac{v}{v+frac{(x-mu )^2}{sigma ^2}}right)^{frac{v+1}{2}} quad text{defined on the real line}$$



Student t fit



The following diagram shows a sample fit using the Student's t, with $mu = 5.45$, $sigma = 6.61$ and $v = 2.97$:



enter image description here



In the diagram:




  • the dashed red curve is the fitted Student's t pdf


  • the squiggly blue curve is the empirical pdf (frequency polygon) of the raw data



On the upside, this appears to be a significantly better fit than the Normal, using the same raw data set provided.



On the possible downside, I am not sure I would fully agree with the OP's opening statement: "I have data with nice bell-shaped histogram PDF". In particular, if one looks more closely at your data set (which contains 100,000 samples), the maximum is 37.45, while the minimum is -910. Moreover, there is not just one large negative value, but a whole bunch of them. This suggests that your data set is not symmetrical, but negatively skewed ... and that there other things going on in the tails, and if so, other distributions may perhaps be better suited. Zooming out, again with the same Student's t fit, we can see this feature of the data, in the right and left tails:



enter image description here






share|cite|improve this answer





















  • I also found student;s t to work well per your answer. Additionally, I found the Johnson SU to work well here.
    – James Phillips
    yesterday
















3














The histogram, as presented by the OP, gives the impression that the data is symmetrical. Given that the data is noticeably more peaked than Normal, and if the data is roughly symmetrical, then a natural suggestion to try is the Student's t with location parameter $mu$, scale parameter $sigma$, and $v$ degrees of freedom, and pdf $f(x)$:



$$f = frac{1}{sigma sqrt{v} ; Bleft(frac{v}{2},frac{1}{2}right)} left(frac{v}{v+frac{(x-mu )^2}{sigma ^2}}right)^{frac{v+1}{2}} quad text{defined on the real line}$$



Student t fit



The following diagram shows a sample fit using the Student's t, with $mu = 5.45$, $sigma = 6.61$ and $v = 2.97$:



enter image description here



In the diagram:




  • the dashed red curve is the fitted Student's t pdf


  • the squiggly blue curve is the empirical pdf (frequency polygon) of the raw data



On the upside, this appears to be a significantly better fit than the Normal, using the same raw data set provided.



On the possible downside, I am not sure I would fully agree with the OP's opening statement: "I have data with nice bell-shaped histogram PDF". In particular, if one looks more closely at your data set (which contains 100,000 samples), the maximum is 37.45, while the minimum is -910. Moreover, there is not just one large negative value, but a whole bunch of them. This suggests that your data set is not symmetrical, but negatively skewed ... and that there other things going on in the tails, and if so, other distributions may perhaps be better suited. Zooming out, again with the same Student's t fit, we can see this feature of the data, in the right and left tails:



enter image description here






share|cite|improve this answer





















  • I also found student;s t to work well per your answer. Additionally, I found the Johnson SU to work well here.
    – James Phillips
    yesterday














3












3








3






The histogram, as presented by the OP, gives the impression that the data is symmetrical. Given that the data is noticeably more peaked than Normal, and if the data is roughly symmetrical, then a natural suggestion to try is the Student's t with location parameter $mu$, scale parameter $sigma$, and $v$ degrees of freedom, and pdf $f(x)$:



$$f = frac{1}{sigma sqrt{v} ; Bleft(frac{v}{2},frac{1}{2}right)} left(frac{v}{v+frac{(x-mu )^2}{sigma ^2}}right)^{frac{v+1}{2}} quad text{defined on the real line}$$



Student t fit



The following diagram shows a sample fit using the Student's t, with $mu = 5.45$, $sigma = 6.61$ and $v = 2.97$:



enter image description here



In the diagram:




  • the dashed red curve is the fitted Student's t pdf


  • the squiggly blue curve is the empirical pdf (frequency polygon) of the raw data



On the upside, this appears to be a significantly better fit than the Normal, using the same raw data set provided.



On the possible downside, I am not sure I would fully agree with the OP's opening statement: "I have data with nice bell-shaped histogram PDF". In particular, if one looks more closely at your data set (which contains 100,000 samples), the maximum is 37.45, while the minimum is -910. Moreover, there is not just one large negative value, but a whole bunch of them. This suggests that your data set is not symmetrical, but negatively skewed ... and that there other things going on in the tails, and if so, other distributions may perhaps be better suited. Zooming out, again with the same Student's t fit, we can see this feature of the data, in the right and left tails:



enter image description here






share|cite|improve this answer












The histogram, as presented by the OP, gives the impression that the data is symmetrical. Given that the data is noticeably more peaked than Normal, and if the data is roughly symmetrical, then a natural suggestion to try is the Student's t with location parameter $mu$, scale parameter $sigma$, and $v$ degrees of freedom, and pdf $f(x)$:



$$f = frac{1}{sigma sqrt{v} ; Bleft(frac{v}{2},frac{1}{2}right)} left(frac{v}{v+frac{(x-mu )^2}{sigma ^2}}right)^{frac{v+1}{2}} quad text{defined on the real line}$$



Student t fit



The following diagram shows a sample fit using the Student's t, with $mu = 5.45$, $sigma = 6.61$ and $v = 2.97$:



enter image description here



In the diagram:




  • the dashed red curve is the fitted Student's t pdf


  • the squiggly blue curve is the empirical pdf (frequency polygon) of the raw data



On the upside, this appears to be a significantly better fit than the Normal, using the same raw data set provided.



On the possible downside, I am not sure I would fully agree with the OP's opening statement: "I have data with nice bell-shaped histogram PDF". In particular, if one looks more closely at your data set (which contains 100,000 samples), the maximum is 37.45, while the minimum is -910. Moreover, there is not just one large negative value, but a whole bunch of them. This suggests that your data set is not symmetrical, but negatively skewed ... and that there other things going on in the tails, and if so, other distributions may perhaps be better suited. Zooming out, again with the same Student's t fit, we can see this feature of the data, in the right and left tails:



enter image description here







share|cite|improve this answer












share|cite|improve this answer



share|cite|improve this answer










answered 2 days ago









wolfieswolfies

5,52511721




5,52511721












  • I also found student;s t to work well per your answer. Additionally, I found the Johnson SU to work well here.
    – James Phillips
    yesterday


















  • I also found student;s t to work well per your answer. Additionally, I found the Johnson SU to work well here.
    – James Phillips
    yesterday
















I also found student;s t to work well per your answer. Additionally, I found the Johnson SU to work well here.
– James Phillips
yesterday




I also found student;s t to work well per your answer. Additionally, I found the Johnson SU to work well here.
– James Phillips
yesterday













3














In short: your two plots show a big discrepancy, the smallest values shown in the histogram is about $-30$, while the qqplot shows values down to around $-900$. All those lom-tailed outliers is about 0.7% of the sample, but dominates the qqplot. So you need to ask yourself what produces those outliers! and that should guide you to what to do with your data. If I make a qqplot after eliminating that long tail, it looks much closer to normal, but not perfect. Look at these:



mean(Y)
[1] 3.9657
mean(Y[Y>= -30])
[1] 4.414797


but the effect on standard deviation is larger:



sd(Y)
[1] 10.92237
sd(Y[Y>= -30])
[1] 8.006223


and that explains the strange form of your first plot (histogram): the fitted normal curve you shows is influenced by that long tail you omitted from the plot.






share|cite|improve this answer



















  • 1




    Thanks, great advice. I understand that perfect fitting of the probability density function is not very feasible. As I just edit my question, my goal is to have an approximated analytic CDF. I am thinking about your advice about dominated outliners.
    – Anna Noie
    2 days ago






  • 4




    To give better advice, we really need to know the context. What does your variable measure, and what is the goal of modeling?
    – kjetil b halvorsen
    2 days ago
















3














In short: your two plots show a big discrepancy, the smallest values shown in the histogram is about $-30$, while the qqplot shows values down to around $-900$. All those lom-tailed outliers is about 0.7% of the sample, but dominates the qqplot. So you need to ask yourself what produces those outliers! and that should guide you to what to do with your data. If I make a qqplot after eliminating that long tail, it looks much closer to normal, but not perfect. Look at these:



mean(Y)
[1] 3.9657
mean(Y[Y>= -30])
[1] 4.414797


but the effect on standard deviation is larger:



sd(Y)
[1] 10.92237
sd(Y[Y>= -30])
[1] 8.006223


and that explains the strange form of your first plot (histogram): the fitted normal curve you shows is influenced by that long tail you omitted from the plot.






share|cite|improve this answer



















  • 1




    Thanks, great advice. I understand that perfect fitting of the probability density function is not very feasible. As I just edit my question, my goal is to have an approximated analytic CDF. I am thinking about your advice about dominated outliners.
    – Anna Noie
    2 days ago






  • 4




    To give better advice, we really need to know the context. What does your variable measure, and what is the goal of modeling?
    – kjetil b halvorsen
    2 days ago














3












3








3






In short: your two plots show a big discrepancy, the smallest values shown in the histogram is about $-30$, while the qqplot shows values down to around $-900$. All those lom-tailed outliers is about 0.7% of the sample, but dominates the qqplot. So you need to ask yourself what produces those outliers! and that should guide you to what to do with your data. If I make a qqplot after eliminating that long tail, it looks much closer to normal, but not perfect. Look at these:



mean(Y)
[1] 3.9657
mean(Y[Y>= -30])
[1] 4.414797


but the effect on standard deviation is larger:



sd(Y)
[1] 10.92237
sd(Y[Y>= -30])
[1] 8.006223


and that explains the strange form of your first plot (histogram): the fitted normal curve you shows is influenced by that long tail you omitted from the plot.






share|cite|improve this answer














In short: your two plots show a big discrepancy, the smallest values shown in the histogram is about $-30$, while the qqplot shows values down to around $-900$. All those lom-tailed outliers is about 0.7% of the sample, but dominates the qqplot. So you need to ask yourself what produces those outliers! and that should guide you to what to do with your data. If I make a qqplot after eliminating that long tail, it looks much closer to normal, but not perfect. Look at these:



mean(Y)
[1] 3.9657
mean(Y[Y>= -30])
[1] 4.414797


but the effect on standard deviation is larger:



sd(Y)
[1] 10.92237
sd(Y[Y>= -30])
[1] 8.006223


and that explains the strange form of your first plot (histogram): the fitted normal curve you shows is influenced by that long tail you omitted from the plot.







share|cite|improve this answer














share|cite|improve this answer



share|cite|improve this answer








edited 1 hour ago

























answered 2 days ago









kjetil b halvorsenkjetil b halvorsen

28.9k980208




28.9k980208








  • 1




    Thanks, great advice. I understand that perfect fitting of the probability density function is not very feasible. As I just edit my question, my goal is to have an approximated analytic CDF. I am thinking about your advice about dominated outliners.
    – Anna Noie
    2 days ago






  • 4




    To give better advice, we really need to know the context. What does your variable measure, and what is the goal of modeling?
    – kjetil b halvorsen
    2 days ago














  • 1




    Thanks, great advice. I understand that perfect fitting of the probability density function is not very feasible. As I just edit my question, my goal is to have an approximated analytic CDF. I am thinking about your advice about dominated outliners.
    – Anna Noie
    2 days ago






  • 4




    To give better advice, we really need to know the context. What does your variable measure, and what is the goal of modeling?
    – kjetil b halvorsen
    2 days ago








1




1




Thanks, great advice. I understand that perfect fitting of the probability density function is not very feasible. As I just edit my question, my goal is to have an approximated analytic CDF. I am thinking about your advice about dominated outliners.
– Anna Noie
2 days ago




Thanks, great advice. I understand that perfect fitting of the probability density function is not very feasible. As I just edit my question, my goal is to have an approximated analytic CDF. I am thinking about your advice about dominated outliners.
– Anna Noie
2 days ago




4




4




To give better advice, we really need to know the context. What does your variable measure, and what is the goal of modeling?
– kjetil b halvorsen
2 days ago




To give better advice, we really need to know the context. What does your variable measure, and what is the goal of modeling?
– kjetil b halvorsen
2 days ago










Anna Noie is a new contributor. Be nice, and check out our Code of Conduct.










draft saved

draft discarded


















Anna Noie is a new contributor. Be nice, and check out our Code of Conduct.













Anna Noie is a new contributor. Be nice, and check out our Code of Conduct.












Anna Noie is a new contributor. Be nice, and check out our Code of Conduct.
















Thanks for contributing an answer to Cross Validated!


  • Please be sure to answer the question. Provide details and share your research!

But avoid



  • Asking for help, clarification, or responding to other answers.

  • Making statements based on opinion; back them up with references or personal experience.


Use MathJax to format equations. MathJax reference.


To learn more, see our tips on writing great answers.





Some of your past answers have not been well-received, and you're in danger of being blocked from answering.


Please pay close attention to the following guidance:


  • Please be sure to answer the question. Provide details and share your research!

But avoid



  • Asking for help, clarification, or responding to other answers.

  • Making statements based on opinion; back them up with references or personal experience.


To learn more, see our tips on writing great answers.




draft saved


draft discarded














StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstats.stackexchange.com%2fquestions%2f385728%2ffit-data-to-parametric-distribution%23new-answer', 'question_page');
}
);

Post as a guest















Required, but never shown





















































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown

































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown







Popular posts from this blog

Mario Kart Wii

What does “Dominus providebit” mean?

Antonio Litta Visconti Arese