Jim and Joe start a game with five tokens, three for Jim and twofor Joe. A coin is tossed and if the outcome is heads, Jim givesJoe a token, else Jim gets a token from Joe. The game ends when Jimor Joe has all the tokens. At this point, there is 30% chance thatJim and Joe will continue to play the game, again starting withthree tokens for Jim and two for Joe.

?Represent the game as Markov Chain.
?Determine the probability that Joe will win in three cointosses.
?Determine the probability that a game will end in Jim’sfavor.
?Determine the average number of coin tosses needed before Jimwins.

Answer rating: 100% (QA)

Answer to Question 1 Represent the game as Markov Chain A Markov chain is a mathematical model used to describe a sequence of events or states in which the probability of transitioning from one state ... View the full answer