In the context of complex networks, we often encounter systems in which the constituent entities randomly interact with each other as they evolve with time. Such random interactions can be described by Markov ...