1. Introduction
2. Dynamic Programming
3. Neural Network Architectures and Training
4. Stochastic Iterative Algorithms
5. Simulation Methods for a Lookup Table Representation
6. Approximate DP with Cost-to-go Function Approximation
7. Extensions
8. Case Studies