Maximum Likelihood Estimation

Maximum likelihood picks the parameter values that make the observed data most probable under the assumed model. It's the general-purpose estimator behind GARCH, logistic regression and most of modern statistics, and under normal errors it coincides exactly with least squares. Its guarantees are asymptotic, so in small samples MLE can be meaningfully biased — variance estimates being the classic example.