1. Introduction 2. Dynamic Programming 3. Neural Network Architectures and Training 4. Stochastic Iterative Algorithms 5. Simulation Methods for a Lookup Table Representation 6. Approximate DP with Cost-to-go Function Approximation 7. Extensions 8. Case Studies