Markov chain

A Markov chain is a stochastic model used to determine the likelihood that the equipment will be in a certain state or health after it has reached a certain state or health in a previous iteration of the chain. The changes to the state of the equipment are called transitions and the probabilities that the equipment moves from one state to another are called transition probabilities. The initial state of the equipment is assumed to be perfect health.