Markov chains and their various generalizations, being one of the main concepts of probability theory, find increasing application in physics, geophysics, stellar astronomy and technical issues. Their mathematical development and these applications are devoted to a very large literature, mainly of a specially journal nature.