This note derives the gradients for training a deep neural network while trying to use only matrix algebra and vector calculus. It isn’t quite enough so we have to add a little more structure based on ‘tuples’, basically a list
A first-order optimization method for learning to reconstruct opacity in computational imaging
Unknown self-occlusion in a scene with opaque objects causes the multiview reconstruction problem to become ill-posed and nonlinear. In this report we describe a scalable nonlinear optimization method for simultaneously reconstructing the object and occlusion. The approach uses a simple
Quadratic Programming with Keras
This note describes how to implement and solve a quadratic programming optimization problem using a shallow neural network in Keras. A single linear layer is used with a custom one-sided loss to impose the inequality constraints. A custom kernel regularizer