-
Bits-Back Coding
April 1, 2023
-
Gaussian Processes
March 30, 2023
-
Variational Autoencoders
March 5, 2023
I’ve been wanting to write a primer on the variational autoencoders for some time. There have been so many papers and blog posts written on this that I am at this point very late to the party. Nevertheless, I will put this out for the exercise of it. Perhaps I will have a slightly different way of thinking about it that someone finds illuminating. …
-
Bias-Variance Decomposition
July 14, 2019
All about the bias-variance decomposition as it pertains to machine learning. All you need to know: $$ \begin{align*} & \mathbb{E}_D[(f(x; D) - y(x))^2] \qquad\quad\ \textrm{Avg. error}\\ & = (\mathbb{E}_D[f(x; D)] - y(x))^2 \qquad \textrm{Bias}_y(f)^2\\ &\phantom{=}\, + \mathbb{V}_D[f(x; D)] \qquad\qquad\quad\ \, \textrm{Variance}(f)\\ \end{align*} $$ …