Dynamic environments

State(t)

Markov property:
- past independent of future given current state;
- a conditional independence assumption;
- implied by fact that there are no arcs t? t+2.