Root Mean Squared Error

A typical way of measuring the difference between observations and results from a predictor.

The formal definition is:

\[ \begin{aligned} RMSE(\hat{\theta}) &= \sqrt{\operatorname{MSE}(\hat{\theta})} \\\\ &= \sqrt{\operatorname{E}((\hat{\theta}-\theta)^2)}. \end{aligned} \]

For \(N\) observations \(Y=\{y_1, \dots,y_N\}\) we can express it as:

\[ RMSE=\sqrt{\frac{\sum _ {n=1}^{N}(\hat{y} _{n}-y _{n})^{2}}{N}}. \]

Example

import numpy as np

X = 2 * np.random.rand(1000,1)
X_b = np.c_[np.ones((1000,1)), X]

Y = 1 + 2.5 * X + np.random.randn(1000,1)