Part a)
Discrete-time continuous state Markov processes are widely used. Autoregressive processes are a very important example.
Actually, if you relax the Markov property and look at discrete-time continuous state stochastic processes in general, then this is the topic of study of a huge part of Time series analysis and signal processing.
The most famous examples are ARMA processes, the Conditionally Heteroscedastic models, a large subclass of Hidden Markov models
Part b)
Given, random process, X(t)=Kcos(wt)t≥0
The expected value of K is, E[K]=21+0=0.5
The variance of K is, σK2=12(1−0)2=121
Thus
E[K2]=σK2+[E[K]]2E[K2]=121+(0.5)2E[K2]=31
The mean of X(t) is,
E[X(t)]=E[Kcos(wt)]E[X(t)]=E[K]cos(wt)E[X(t)]=21cos(wt)
The autocorrelation function of X(t) is,
Rxx(t,s)=E[X(t)X(s)]Rxx(t,s)=E[K2cos(wt)cos(ws)]Rxx(t,s)=E[K2]cos(wt)cos(ws)Rxx(t,s)=31cos(wt)cos(ws)
The autocovariance function of X(t) is,
Cxx(t,s)=Rxx(t,s)—E[X(t)]E[X(s)]Cxx(t,s)=31cos(wt)cos(ws)−41cos(wt)cos(ws)Cxx(t,s)=121cos(wt)cos(ws)
Comments
Leave a comment