In many applications, some variables evolve over time in a random (stochastic) way in that even...
Fantastic news! We've Found the answer you've been seeking!
Question:
Transcribed Image Text:
In many applications, some variables evolve over time in a random (stochastic) way in that even if you know everything up to time t, it is still impossible to know for sure which values the variables take in the future. Stochastic processes are mathematical models that describe these phenomena when the randomness is driven by something out of the control of the relevant decision makers. For example, the stock prices can be (and usually are) modeled as stochastic processes, since it is difficult for an investor to affect them. However, in a chess game, the uncertainty in your opponents' future moves are not modeled as stochastic processes as they are made by a decision maker with the goal to defeat you and they may be adjusted based on your moves. One simple and widely used class of stochastic processes are Markov chains. In this question, we study Markov chains on a finite state space. There is a sequence of random variables ro, ₁,...,,.... each taking value in a finite set S called the state space. The subscripts have the interpretation of time. Therefore given an integer time t, o, are assumed to be known at the time, while +1, +2,... remain random. For convenience, we label states with positive integers: S [1... n}, where n is the number of possible states. (a) Is S a good choice of sample space for describing this stochastic process? No matter what the answer is, for the rest of the question we assume that a good sample space (which might be S if your answer is "yes") has been chosen to carry the random variables. = (b) The fundamental assumption of Markov chains is that given xo....., the probability that +1 = j is pji where i is the value of at. This holds for every t=0, 1.... and the numbers pj, are independent of t. More precisely, for any fixed t and the event A that zo ao.... tat (where ao, a, a, are integers in S), P(a) A) = P(A)p,.,; this holds for all ao, a1, a. (The so-called Markov property means that the value of. *1+1 only depends on , and not on history further back.) - Let P be the nxn matrix whose (j, i) entry is p., for all i, je S; it is called the transition matria of the Markov chain. Show that for the probabilities to be well-defined for all laws of co. each column of P sums up to one.. YA (c) A law on the state space S can be represented by an x 1 matrix (column vector), whose (i. 1) entry is the probability of (i). A function : SR can be represented by a 1 x n matrix whose (1, 1) entry is the number f(). (Notice that is not a random variable unless your answer to Part. (a) is "yes".) If the law of ro is to, then what is the interpretation of fuo (matrix product)? (d) In what follows, fix a law to of zo and a function f:SR. What is the law of r₁? (e) Notice that fP is a 1xn matrix, so it represents a function on S. What does that function mean intuitively? (As we can see, the transformation from f to fP is another way to describe the transition matrix P. and this transformation plays an important role when studying more complicated Markov processes.) (f) What is the law of ? In many applications, some variables evolve over time in a random (stochastic) way in that even if you know everything up to time t, it is still impossible to know for sure which values the variables take in the future. Stochastic processes are mathematical models that describe these phenomena when the randomness is driven by something out of the control of the relevant decision makers. For example, the stock prices can be (and usually are) modeled as stochastic processes, since it is difficult for an investor to affect them. However, in a chess game, the uncertainty in your opponents' future moves are not modeled as stochastic processes as they are made by a decision maker with the goal to defeat you and they may be adjusted based on your moves. One simple and widely used class of stochastic processes are Markov chains. In this question, we study Markov chains on a finite state space. There is a sequence of random variables ro, ₁,...,,.... each taking value in a finite set S called the state space. The subscripts have the interpretation of time. Therefore given an integer time t, o, are assumed to be known at the time, while +1, +2,... remain random. For convenience, we label states with positive integers: S [1... n}, where n is the number of possible states. (a) Is S a good choice of sample space for describing this stochastic process? No matter what the answer is, for the rest of the question we assume that a good sample space (which might be S if your answer is "yes") has been chosen to carry the random variables. = (b) The fundamental assumption of Markov chains is that given xo....., the probability that +1 = j is pji where i is the value of at. This holds for every t=0, 1.... and the numbers pj, are independent of t. More precisely, for any fixed t and the event A that zo ao.... tat (where ao, a, a, are integers in S), P(a) A) = P(A)p,.,; this holds for all ao, a1, a. (The so-called Markov property means that the value of. *1+1 only depends on , and not on history further back.) - Let P be the nxn matrix whose (j, i) entry is p., for all i, je S; it is called the transition matria of the Markov chain. Show that for the probabilities to be well-defined for all laws of co. each column of P sums up to one.. YA (c) A law on the state space S can be represented by an x 1 matrix (column vector), whose (i. 1) entry is the probability of (i). A function : SR can be represented by a 1 x n matrix whose (1, 1) entry is the number f(). (Notice that is not a random variable unless your answer to Part. (a) is "yes".) If the law of ro is to, then what is the interpretation of fuo (matrix product)? (d) In what follows, fix a law to of zo and a function f:SR. What is the law of r₁? (e) Notice that fP is a 1xn matrix, so it represents a function on S. What does that function mean intuitively? (As we can see, the transformation from f to fP is another way to describe the transition matrix P. and this transformation plays an important role when studying more complicated Markov processes.) (f) What is the law of ?
Expert Answer:
Answer rating: 100% (QA)
answers A It depends For example if we are only interested in the set of possible values that a part... View the full answer
Related Book For
Posted Date:
Students also viewed these accounting questions
-
Even if prices follow a random walk, they still may not be information ally efficient. Explain why this may be true, and why it matters for the efficient allocation of capital in our economy.
-
Mathematical models can help us estimate values that are difficult to measure. Consider again a bee sucking nectar from a flower, with F(t) = t / 0.5 + t. We also measure that the bee remains a...
-
Describe how we can use Markov analysis to make future predictions.
-
Suppose that the fixed cost for a product is $400 and the break-even quantity is 80. Find the marginal profit (the slope of the linear profit function).
-
Katie needs to borrow $ 50,000, but she cannot make periodic payments. Instead she would like to make a lump- sum payment in 10 years. Assuming that Katie and the bank agree on 8 percent interest...
-
How is the job of a coach similar to that of an IS graduate?
-
Air at \(200^{\circ} \mathrm{F}\) and 60 psia flows in a 4-in.-diameter pipe at a rate of \(0.52 \mathrm{lb} / \mathrm{s}\). Determine the pressure at the 2-in.-diameter throat of a Venturi meter...
-
Amigo Software Inc. has total assets of $889,000, current liabilities of $192,000, and long-term liabilities of $154,000. There is $87,000 in preferred stock outstanding. Thirty thousand shares of...
-
You are going to pitch an idea to secure additional funding for your start-up company. The product that you are selling is insulated water bottle. Create the following: Introduction This should...
-
Prepare Trial Balance? Angela Mosely owns Innovative Designs. The Accounts and their balances for the Trial Balance of the first for January 31, 20X1, the first month of operation, are shown below....
-
Do you think the 2010 Arizona immigration law was a good idea or not? Should states enforce federal immigration laws when federal authorities wish not to intervene?
-
James Howells, a computer engineer, was tidying up his old computers and accidentally threw away a laptop containing 7500 Bitcoins in 2013, which was worth 750,000. Today it is more likely to be...
-
You are shown a website and asked to identify it as either a brand- building advert, a direct-response ad, or a mixture of the two. What clues would you use from the advert itself to help you...
-
Jim Donaldson was recently hired as a sales representative for Mitleson Pharmaceutical. In his first week on the job, he is calling on a medium-sized academic medical center. His major focus is in...
-
Give an example of an acquisition objective and a retention objective for an airline. How might the two objectives be clearly related to one another?
-
In recent years, there has been a growing attempt to measure the performance of health care providers. The federal gov ernment and the states have published data on how hospitals compare to accept-...
-
Given the realization that all forecasts are wrong, why do we still see forecasting used so frequently by organizations? Explain your rationale?
-
Find the numerical value of each expression. (a) sech 0 (b) cosh -1 1
-
Consider the three stocks in the following table. Pt represents price at time t, and Qt represents shares outstanding at time t. Stock C splits two for one in the last period. a. Calculate the rate...
-
What is the largest percentage fee that a client who currently is lending (y < 1) will be willing to pay to invest in your fund? What about a client who is borrowing (y > 1)? For Challenge Problems...
-
Jones Group has been generating stable after-tax return on equity (ROE) despite declining operating income. Explain how it might be able to maintain its stable after-tax ROE.
-
One molecule of ATP provides 0.30 eV when it is used to power cellular processes. Photosynthesis in a typical plant requires 8 photons at 550 nm to produce 1 molecule of ATP. What is the overall...
-
A study of photosynthesis in phytoplankton in the open ocean used short pulses of laser light to trigger photosynthetic reactions. The investigators system used 0.10 mW pulses of 640 nm laser light...
-
Greg and Jan are married and file a joint tax return. They have two children: Ben and Kelly. Ben, age 20, was a full-time student during the current year and had scholarships of \($12,000.\) Greg and...
Study smarter with the SolutionInn App