Get inspired by the success stories of our students in IIT JAM 2021. Learn More 

Is MLE always a function of a Sufficient Statistic?

MLE is an algorithm to find a reasonable estimator (personally, it really woos my mind - simple and yet so beautiful.).

Now, well - Life is hard. People has devised ways to check if an esimator is good or not - why will they care I like it or not.

So, they have developed Small Sample Properties and Large Sample Properties to do the quality control of MLE.

This post tests the flamboyancy of MLE is terms of the idea of "Sufficiency".

We ask "Is MLE sufficient? How is MLE and Sufficiency related?"

We discover a rich relationship between the two. Again, MLE wins my heart. Does it win yours? Check with the hints and the solution.

Hints, Solution, and More

  • Use Neymann Factorization Theorem to prove that MLE is a function of a Sufficient Statistic T.
  • Write the Likelihood of the data is terms of T and progress towards the proof.
  • Now, take a sample from Uniform (\(\theta,\theta +1\)).
  • Now, observe that MLE is not unique and find a MLE which is not a function of T - a small but creative step.
  • Look out for the Food for Thought.

Do subscribe to our channel to get instant notification of Live Session, so that you can join us live in the master classes!

Build your foundations.

Ace your Exams.

Learn. Enjoy. Practice. Repeat.

  • Is MLE a sufficient statistic?
  • Is MLE consistent?
  • IS MLE a complete sufficient statistic?
  • Is MLE asymptotically normal?
  • What if the underlying distribution is Exponential Family?

Some Useful Links:

Cheenta. Passion for Mathematics

Advanced Mathematical Science. Taught by olympians, researchers and true masters of the subject.