Influential Observations

One important regression diagnostic concerns influential observations. A regression coefficient represents the average effect of an independent variable on a dependent variable, holding other variables constant.

Yet some observations may have excessive influences over the coefficient estimates, the predicted values, and the overall fit of a regression model. This introduces much uncertainty as to whether it’s the presence or absence of such observations that gives us good or bad estimates of the population parameter.