6.041 | Fall 2010 | Undergraduate

Probabilistic Systems Analysis and Applied Probability

Video Lectures

Lecture 16: Markov Chains I

Description: In this lecture, the professor discussed Markov process definition, n-step transition probabilities, and classification of states.

Instructor: John Tsitsiklis

Course Info

Fall 2010
Exam Solutions
Exams
Lecture Videos
Problem Set Solutions
Problem Sets