Why is this estimator biased? The Next CEO of Stack OverflowHow do I check for bias of an estimator?Bootstrap confidence interval for a biased estimatorConceptual question about bias of an estimatorEstimator, unbiased or biasedCalculating risk for a density estimatorLinear model with biased estimatorBias Correction for Estimator with known biasWhy is OLS estimator of AR(1) coefficient biased?Cramer-Rao lower bound for biased estimatorVariance of distribution for maximum likelihood estimator

Why do remote companies require working in the US?

How to get regions to plot as graphics

Anatomically Correct Strange Women In Ponds Distributing Swords

Why do airplanes bank sharply to the right after air-to-air refueling?

Go Pregnant or Go Home

Opposite of a diet

Hindi speaking tourist to UK from India

How to count occurrences of text in a file?

Rotate a column

Is HostGator storing my password in plaintext?

How should I support this large drywall patch?

What do "high sea" and "carry" mean in this sentence?

How to make a software documentation "officially" citable?

Would this house-rule that treats advantage as a +1 to the roll instead (and disadvantage as -1) and allows them to stack be balanced?

What was the first Unix version to run on a microcomputer?

If the heap is initialized for security, then why is the stack uninitialized?

What does this shorthand mean?

What flight has the highest ratio of time difference to flight time?

Extending anchors in TikZ

Extracting names from filename in bash

How do you know when two objects are so called entangled?

Are there languages with no euphemisms?

How do I go from 300 unfinished/half written blog posts, to published posts?

Title page not generated



Why is this estimator biased?



The Next CEO of Stack OverflowHow do I check for bias of an estimator?Bootstrap confidence interval for a biased estimatorConceptual question about bias of an estimatorEstimator, unbiased or biasedCalculating risk for a density estimatorLinear model with biased estimatorBias Correction for Estimator with known biasWhy is OLS estimator of AR(1) coefficient biased?Cramer-Rao lower bound for biased estimatorVariance of distribution for maximum likelihood estimator










2












$begingroup$


$X_1,X_2,..,X_n$ are iid $sim Poisson(mu)$



than the MLE for $theta=e^-mu$ is $hat theta =e^-bar x$



Why is this considered to be biased for $theta$?



Is $E[hat theta]$ not $theta$ ?



as



$E[bar x]= mu$






estimation poisson-distribution bias







share|cite|improve this question









$endgroup$







  • 6




    $begingroup$
    E[f(X)] != f(E[X]) in general.
    $endgroup$
    – The Laconic
    Mar 22 at 20:54











  • $begingroup$
    I know that general result but I am still confused how to do it here since the sum of poisson is also poisson with mean $n mu$
    $endgroup$
    – Quality
    Mar 22 at 21:01















2












$begingroup$


$X_1,X_2,..,X_n$ are iid $sim Poisson(mu)$



than the MLE for $theta=e^-mu$ is $hat theta =e^-bar x$



Why is this considered to be biased for $theta$?



Is $E[hat theta]$ not $theta$ ?



as



$E[bar x]= mu$






estimation poisson-distribution bias







share|cite|improve this question









$endgroup$







  • 6




    $begingroup$
    E[f(X)] != f(E[X]) in general.
    $endgroup$
    – The Laconic
    Mar 22 at 20:54











  • $begingroup$
    I know that general result but I am still confused how to do it here since the sum of poisson is also poisson with mean $n mu$
    $endgroup$
    – Quality
    Mar 22 at 21:01













2












2








2


2



$begingroup$


$X_1,X_2,..,X_n$ are iid $sim Poisson(mu)$



than the MLE for $theta=e^-mu$ is $hat theta =e^-bar x$



Why is this considered to be biased for $theta$?



Is $E[hat theta]$ not $theta$ ?



as



$E[bar x]= mu$






estimation poisson-distribution bias







share|cite|improve this question









$endgroup$




$X_1,X_2,..,X_n$ are iid $sim Poisson(mu)$



than the MLE for $theta=e^-mu$ is $hat theta =e^-bar x$



Why is this considered to be biased for $theta$?



Is $E[hat theta]$ not $theta$ ?



as



$E[bar x]= mu$






estimation poisson-distribution bias




estimation poisson-distribution bias






share|cite|improve this question













share|cite|improve this question











share|cite|improve this question




share|cite|improve this question










asked Mar 22 at 20:47









QualityQuality

30019




30019







  • 6




    $begingroup$
    E[f(X)] != f(E[X]) in general.
    $endgroup$
    – The Laconic
    Mar 22 at 20:54











  • $begingroup$
    I know that general result but I am still confused how to do it here since the sum of poisson is also poisson with mean $n mu$
    $endgroup$
    – Quality
    Mar 22 at 21:01












  • 6




    $begingroup$
    E[f(X)] != f(E[X]) in general.
    $endgroup$
    – The Laconic
    Mar 22 at 20:54











  • $begingroup$
    I know that general result but I am still confused how to do it here since the sum of poisson is also poisson with mean $n mu$
    $endgroup$
    – Quality
    Mar 22 at 21:01







6




6




$begingroup$
E[f(X)] != f(E[X]) in general.
$endgroup$
– The Laconic
Mar 22 at 20:54





$begingroup$
E[f(X)] != f(E[X]) in general.
$endgroup$
– The Laconic
Mar 22 at 20:54













$begingroup$
I know that general result but I am still confused how to do it here since the sum of poisson is also poisson with mean $n mu$
$endgroup$
– Quality
Mar 22 at 21:01




$begingroup$
I know that general result but I am still confused how to do it here since the sum of poisson is also poisson with mean $n mu$
$endgroup$
– Quality
Mar 22 at 21:01










2 Answers
2






active

oldest

votes


















5












$begingroup$

Recall that the moment generating function of $X sim operatornamePoisson(mu)$ is
$$
E[e^s X] = exp(mu(e^s - 1))
$$
for all $s in mathbbR$



Proof.
We just compute:
$$
beginaligned
E[e^s X]
&= sum_k=0^infty e^s k e^-mu fracmu^kk! \
&= e^-mu sum_k=0^infty fracleft(mu e^sright)^kk! \
&= e^-mu e^mu e^s \
&= exp(mu(e^s - 1)).
endaligned
$$
We will use this result with $s = -1/n$.



If $X_1, ldots, X_n sim operatornamePoisson(mu)$ are i.i.d. and
$$
widehattheta
= expleft(-frac1n sum_i=1^n X_iright)
= prod_i=1^n expleft(-fracX_inright),
$$
then, using independence,
$$
beginaligned
E[widehattheta]
&= prod_i=1^n Eleft[e^-X_i / nright] \
&= prod_i=1^n exp(mu(e^-1/n - 1)) \
&= exp(n mu(e^-1/n - 1)) \
&neq e^-mu,
endaligned
$$
so $widehattheta$ is not an unbiased estimator of $e^-mu$






share|cite|improve this answer









$endgroup$












  • $begingroup$
    Thank you, makes perfect sense
    $endgroup$
    – Quality
    Mar 22 at 21:16


















6












$begingroup$

As an aside from finding the exact expectation, you can use Jensen's inequality, which says that for a random variable $X$ and a convex function $g$,



$$Eleft[g(X)right]ge gleft(Eleft[Xright]right)$$



, provided the expectations exist.



Verify that $g(x)=e^-x$ is a convex function from the fact that $g''>0$.



The equality does not hold because $g$ is not an affine function or a constant function.






share|cite|improve this answer









$endgroup$













    Your Answer





    StackExchange.ifUsing("editor", function ()
    return StackExchange.using("mathjaxEditing", function ()
    StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix)
    StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
    );
    );
    , "mathjax-editing");

    StackExchange.ready(function()
    var channelOptions =
    tags: "".split(" "),
    id: "65"
    ;
    initTagRenderer("".split(" "), "".split(" "), channelOptions);

    StackExchange.using("externalEditor", function()
    // Have to fire editor after snippets, if snippets enabled
    if (StackExchange.settings.snippets.snippetsEnabled)
    StackExchange.using("snippets", function()
    createEditor();
    );

    else
    createEditor();

    );

    function createEditor()
    StackExchange.prepareEditor(
    heartbeatType: 'answer',
    autoActivateHeartbeat: false,
    convertImagesToLinks: false,
    noModals: true,
    showLowRepImageUploadWarning: true,
    reputationToPostImages: null,
    bindNavPrevention: true,
    postfix: "",
    imageUploader:
    brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
    contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
    allowUrls: true
    ,
    onDemand: true,
    discardSelector: ".discard-answer"
    ,immediatelyShowMarkdownHelp:true
    );



    );













    draft saved

    draft discarded


















    StackExchange.ready(
    function ()
    StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstats.stackexchange.com%2fquestions%2f398954%2fwhy-is-this-estimator-biased%23new-answer', 'question_page');

    );

    Post as a guest















    Required, but never shown

























    2 Answers
    2






    active

    oldest

    votes








    2 Answers
    2






    active

    oldest

    votes









    active

    oldest

    votes






    active

    oldest

    votes









    5












    $begingroup$

    Recall that the moment generating function of $X sim operatornamePoisson(mu)$ is
    $$
    E[e^s X] = exp(mu(e^s - 1))
    $$
    for all $s in mathbbR$



    Proof.
    We just compute:
    $$
    beginaligned
    E[e^s X]
    &= sum_k=0^infty e^s k e^-mu fracmu^kk! \
    &= e^-mu sum_k=0^infty fracleft(mu e^sright)^kk! \
    &= e^-mu e^mu e^s \
    &= exp(mu(e^s - 1)).
    endaligned
    $$
    We will use this result with $s = -1/n$.



    If $X_1, ldots, X_n sim operatornamePoisson(mu)$ are i.i.d. and
    $$
    widehattheta
    = expleft(-frac1n sum_i=1^n X_iright)
    = prod_i=1^n expleft(-fracX_inright),
    $$
    then, using independence,
    $$
    beginaligned
    E[widehattheta]
    &= prod_i=1^n Eleft[e^-X_i / nright] \
    &= prod_i=1^n exp(mu(e^-1/n - 1)) \
    &= exp(n mu(e^-1/n - 1)) \
    &neq e^-mu,
    endaligned
    $$
    so $widehattheta$ is not an unbiased estimator of $e^-mu$






    share|cite|improve this answer









    $endgroup$












    • $begingroup$
      Thank you, makes perfect sense
      $endgroup$
      – Quality
      Mar 22 at 21:16















    5












    $begingroup$

    Recall that the moment generating function of $X sim operatornamePoisson(mu)$ is
    $$
    E[e^s X] = exp(mu(e^s - 1))
    $$
    for all $s in mathbbR$



    Proof.
    We just compute:
    $$
    beginaligned
    E[e^s X]
    &= sum_k=0^infty e^s k e^-mu fracmu^kk! \
    &= e^-mu sum_k=0^infty fracleft(mu e^sright)^kk! \
    &= e^-mu e^mu e^s \
    &= exp(mu(e^s - 1)).
    endaligned
    $$
    We will use this result with $s = -1/n$.



    If $X_1, ldots, X_n sim operatornamePoisson(mu)$ are i.i.d. and
    $$
    widehattheta
    = expleft(-frac1n sum_i=1^n X_iright)
    = prod_i=1^n expleft(-fracX_inright),
    $$
    then, using independence,
    $$
    beginaligned
    E[widehattheta]
    &= prod_i=1^n Eleft[e^-X_i / nright] \
    &= prod_i=1^n exp(mu(e^-1/n - 1)) \
    &= exp(n mu(e^-1/n - 1)) \
    &neq e^-mu,
    endaligned
    $$
    so $widehattheta$ is not an unbiased estimator of $e^-mu$






    share|cite|improve this answer









    $endgroup$












    • $begingroup$
      Thank you, makes perfect sense
      $endgroup$
      – Quality
      Mar 22 at 21:16













    5












    5








    5





    $begingroup$

    Recall that the moment generating function of $X sim operatornamePoisson(mu)$ is
    $$
    E[e^s X] = exp(mu(e^s - 1))
    $$
    for all $s in mathbbR$



    Proof.
    We just compute:
    $$
    beginaligned
    E[e^s X]
    &= sum_k=0^infty e^s k e^-mu fracmu^kk! \
    &= e^-mu sum_k=0^infty fracleft(mu e^sright)^kk! \
    &= e^-mu e^mu e^s \
    &= exp(mu(e^s - 1)).
    endaligned
    $$
    We will use this result with $s = -1/n$.



    If $X_1, ldots, X_n sim operatornamePoisson(mu)$ are i.i.d. and
    $$
    widehattheta
    = expleft(-frac1n sum_i=1^n X_iright)
    = prod_i=1^n expleft(-fracX_inright),
    $$
    then, using independence,
    $$
    beginaligned
    E[widehattheta]
    &= prod_i=1^n Eleft[e^-X_i / nright] \
    &= prod_i=1^n exp(mu(e^-1/n - 1)) \
    &= exp(n mu(e^-1/n - 1)) \
    &neq e^-mu,
    endaligned
    $$
    so $widehattheta$ is not an unbiased estimator of $e^-mu$






    share|cite|improve this answer









    $endgroup$



    Recall that the moment generating function of $X sim operatornamePoisson(mu)$ is
    $$
    E[e^s X] = exp(mu(e^s - 1))
    $$
    for all $s in mathbbR$



    Proof.
    We just compute:
    $$
    beginaligned
    E[e^s X]
    &= sum_k=0^infty e^s k e^-mu fracmu^kk! \
    &= e^-mu sum_k=0^infty fracleft(mu e^sright)^kk! \
    &= e^-mu e^mu e^s \
    &= exp(mu(e^s - 1)).
    endaligned
    $$
    We will use this result with $s = -1/n$.



    If $X_1, ldots, X_n sim operatornamePoisson(mu)$ are i.i.d. and
    $$
    widehattheta
    = expleft(-frac1n sum_i=1^n X_iright)
    = prod_i=1^n expleft(-fracX_inright),
    $$
    then, using independence,
    $$
    beginaligned
    E[widehattheta]
    &= prod_i=1^n Eleft[e^-X_i / nright] \
    &= prod_i=1^n exp(mu(e^-1/n - 1)) \
    &= exp(n mu(e^-1/n - 1)) \
    &neq e^-mu,
    endaligned
    $$
    so $widehattheta$ is not an unbiased estimator of $e^-mu$







    share|cite|improve this answer












    share|cite|improve this answer



    share|cite|improve this answer










    answered Mar 22 at 21:12









    Artem MavrinArtem Mavrin

    1,201710




    1,201710











    • $begingroup$
      Thank you, makes perfect sense
      $endgroup$
      – Quality
      Mar 22 at 21:16
















    • $begingroup$
      Thank you, makes perfect sense
      $endgroup$
      – Quality
      Mar 22 at 21:16















    $begingroup$
    Thank you, makes perfect sense
    $endgroup$
    – Quality
    Mar 22 at 21:16




    $begingroup$
    Thank you, makes perfect sense
    $endgroup$
    – Quality
    Mar 22 at 21:16













    6












    $begingroup$

    As an aside from finding the exact expectation, you can use Jensen's inequality, which says that for a random variable $X$ and a convex function $g$,



    $$Eleft[g(X)right]ge gleft(Eleft[Xright]right)$$



    , provided the expectations exist.



    Verify that $g(x)=e^-x$ is a convex function from the fact that $g''>0$.



    The equality does not hold because $g$ is not an affine function or a constant function.






    share|cite|improve this answer









    $endgroup$

















      6












      $begingroup$

      As an aside from finding the exact expectation, you can use Jensen's inequality, which says that for a random variable $X$ and a convex function $g$,



      $$Eleft[g(X)right]ge gleft(Eleft[Xright]right)$$



      , provided the expectations exist.



      Verify that $g(x)=e^-x$ is a convex function from the fact that $g''>0$.



      The equality does not hold because $g$ is not an affine function or a constant function.






      share|cite|improve this answer









      $endgroup$















        6












        6








        6





        $begingroup$

        As an aside from finding the exact expectation, you can use Jensen's inequality, which says that for a random variable $X$ and a convex function $g$,



        $$Eleft[g(X)right]ge gleft(Eleft[Xright]right)$$



        , provided the expectations exist.



        Verify that $g(x)=e^-x$ is a convex function from the fact that $g''>0$.



        The equality does not hold because $g$ is not an affine function or a constant function.






        share|cite|improve this answer









        $endgroup$



        As an aside from finding the exact expectation, you can use Jensen's inequality, which says that for a random variable $X$ and a convex function $g$,



        $$Eleft[g(X)right]ge gleft(Eleft[Xright]right)$$



        , provided the expectations exist.



        Verify that $g(x)=e^-x$ is a convex function from the fact that $g''>0$.



        The equality does not hold because $g$ is not an affine function or a constant function.







        share|cite|improve this answer












        share|cite|improve this answer



        share|cite|improve this answer










        answered Mar 22 at 21:16









        StubbornAtomStubbornAtom

        2,8621532




        2,8621532



























            draft saved

            draft discarded
















































            Thanks for contributing an answer to Cross Validated!


            • Please be sure to answer the question. Provide details and share your research!

            But avoid …


            • Asking for help, clarification, or responding to other answers.

            • Making statements based on opinion; back them up with references or personal experience.

            Use MathJax to format equations. MathJax reference.


            To learn more, see our tips on writing great answers.




            draft saved


            draft discarded














            StackExchange.ready(
            function ()
            StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstats.stackexchange.com%2fquestions%2f398954%2fwhy-is-this-estimator-biased%23new-answer', 'question_page');

            );

            Post as a guest















            Required, but never shown





















































            Required, but never shown














            Required, but never shown












            Required, but never shown







            Required, but never shown

































            Required, but never shown














            Required, but never shown












            Required, but never shown







            Required, but never shown







            -

            Popular posts from this blog

            Adding axes to figuresAdding axes labels to LaTeX figuresLaTeX equivalent of ConTeXt buffersRotate a node but not its content: the case of the ellipse decorationHow to define the default vertical distance between nodes?TikZ scaling graphic and adjust node position and keep font sizeNumerical conditional within tikz keys?adding axes to shapesAlign axes across subfiguresAdding figures with a certain orderLine up nested tikz enviroments or how to get rid of themAdding axes labels to LaTeX figures

            Image
            Fear of getting stuck on one programming language / technology that is not used in my country Is there a single word describing earning money through any means? Why do we read the Megillah by night and by day? Pre-mixing cryogenic fuels and using only one fuel tank Is the U.S. Code copyrighted by the Government? Should I outline or discovery write my stories? What is this called? Old film camera viewer? Does the expansion of the universe explain why the universe doesn't collapse? Removing files under particular conditions (number of files, file age) Argument list too long when zipping large list of certain files in a folder When a Cleric spontaneously casts a Cure Light Wounds spell, will a Pearl of Power recover the original spell or Cure Light Wounds? Non-trope happy ending? Is it better practice to read straight from sheet music rather than memorize it? Do Legal Documents Require Signing In Standard Pen Colors? Does an advisor owe his/her student anyt...
            Read more

            Tähtien Talli Jäsenet | Lähteet | NavigointivalikkoSuomen Hippos – Tähtien Talli

            Image
            RaviurheiluUrheilun kunniagalleriat Suomen HippoksenravihevostenLämminverisiäsuomenhevosiaSuomen raviurheilunBrad de Veluwe Tähtien Talli on vuonna 1995 perustettu Suomen Hippoksen ylläpitämä suomalaisten ravihevosten kunniagalleria. Tähtien Tallissa on toistaiseksi yhteensä 20 hevosta. Lämminverisiä galleriassa on kymmenen ja suomenhevosia kymmenen. Ulkomailla syntyneitä hevosia on mukana kolme. Vaikka Suomen raviurheilun perinteet ulottuvat jo 1800-luvun puolelle, painottuvat Tähtien Tallien valinnat viimeisten 20-30 vuoden aikana kilpailleisiin hevosiin. Viimeisin kunnianosoituksen saanut hevonen on Brad de Veluwe joka liitettiin Tähtien Talliin vuoden 2015 Ravigaalassa. Jäsenet | Reipas vuoden 1958 Kuninkuusraveissa Lahdessa. Passionate Kemp lämminveristen Suomen mestaruuden voittoloimi yllään. Hevonen Kilpailuvuodet Kasvattaja Valinta- vuosi Charme Asserdal 1975–1981 Erik Andersson 1995...
            Read more

            Do these cracks on my tires look bad? The Next CEO of Stack OverflowDry rot tire should I replace?Having to replace tiresFishtailed so easily? Bad tires? ABS?Filling the tires with something other than air, to avoid puncture hassles?Used Michelin tires safe to install?Do these tyre cracks necessitate replacement?Rumbling noise: tires or mechanicalIs it possible to fix noisy feathered tires?Are bad winter tires still better than summer tires in winter?Torque converter failure - Related to replacing only 2 tires?Why use snow tires on all 4 wheels on 2-wheel-drive cars?

            Image
            Small nick on power cord from an electric alarm clock, and copper wiring exposed but intact Why do we say “un seul M” and not “une seule M” even though M is a “consonne”? Read/write a pipe-delimited file line by line with some simple text manipulation Free fall ellipse or parabola? Why did the Drakh emissary look so blurred in S04:E11 "Lines of Communication"? A hang glider, sudden unexpected lift to 25,000 feet altitude, what could do this? Planeswalker Ability and Death Timing Which acid/base does a strong base/acid react when added to a buffer solution? Is the 21st century's idea of "freedom of speech" based on precedent? Shortening a title without changing its meaning Man transported from Alternate World into ours by a Neutrino Detector Is it reasonable to ask other researchers to send me their previous grant applications? Find a path from s to t using as few red nodes as possible What difference does it make matching a w...
            Read more