Video Lectures
Lecture 9: Markov Rewards and Dynamic Programming
Description: This lecture covers rewards for Markov chains, expected first passage time, and aggregate rewards with a final reward. The professor then moves on to discuss dynamic programming and the dynamic programming algorithm.
Instructor: Prof. Robert Gallager
Course Info
Instructor
Departments
As Taught In
Spring
2011
Level
Learning Resource Types
grading
Exams with Solutions
menu_book
Open Textbooks
theaters
Lecture Videos
assignment
Problem Sets
Problem Set Solutions
