https://tomroth.dev/tags/linear-algebra/Recent content in linear algebra on Tom RothHugo -- gohugo.ioenTue, 07 Jan 2020 00:00:00 +0000https://tomroth.dev/intdim/Tue, 07 Jan 2020 00:00:00 +0000https://tomroth.dev/intdim/The paper in one sentence. The Pareto principle for neural networks: what’s the least number of parameters needed for to achieve most of the results? Structure of this article. I give an introduction to objective landscapes and talk about how to define solutions. I use these concepts to describe the subspace training method. Finally, I summarise the key results of the paper. Objective landscapes Link to heading For every combination of neural network architecture and dataset, the shape of the objective/loss function is fixed.