Section 21 Principle of Least Squares: Plot

21.1 Null Model

\[ \large y_{i} = \beta_0 + \epsilon_{i} \]

21.2 Regression Model

\[ \large y_{i} = \beta_0 + \beta_1 x_{i} + \epsilon_{i} \]

21.3 Prediction

\[ \large \hat y_{i} = \hat \beta_0 + \hat \beta_1 x_{i} \]

21.4 Residual

\[ \large \hat\epsilon_{i} = y_i - \hat y_{i} \]

\[ \large \hat\epsilon_{i} = y_i - \hat \beta_0 - \hat \beta_1 x_{i} \]

21.5 Residual Sum of Squares

\[ \large RSS = \hat\epsilon_{1}^2 + \hat\epsilon_{2}^2 + ... + \hat\epsilon_{n}^2 \]

\[ \large RSS = \sum\limits_{i=1}^{n} \hat\epsilon_{i}^2 \]

21.6 Scatter Plot