Markovian analysis