This question is related to Hidden Markov Model, Please help me to solve out the question as below. Thank you!

Consider an ergodic 4-state Hidden Markov Model (HMM) dened over a discrete set of ve symbols, with tran- sition matrix A, emission matrix B and initial state vector 1r, dened as: 0.1 0.3 0.3 0.3 0.7 0.1 0.1 0.1 A: 0.25 0.25 0.25 0.25 0.1 0.4 0.4 0.1 0.6 0.1 0.1 0.1 0.1 B_ 0.1 0.6 0.1 0.1 0.1 0.2 0.2 0.2 0.2 0.2 0 0 0 0.5 0.5 =[025 0.25 0.25 0.25] In the transition matrix, columns indicate previous state, and rows indicate current state. For instance, a transition from state 2 to state 3 has probability of 0.1. (a) What is the probability p(Q) of the state sequence Q = [1234]? (b) What is the probability p(Q,O) of the combined state and observation sequence Q : [1234] and O : [5321]? What is the probability for the same state sequence but observation sequence 0 = [5324]? (c) What is the average duration in each of the model states