Limiting Behavior of A Sequence of Density Ratios

Sunardi Wirjosudirdjo

Data & Software Engineering Research Group
STEI-ITB, Jl. Ganeca No.10, Bandung 40132, Indonesia
 

Let X₁, X₂,….. be a sequence of random variables and Р= {P_θ,θ Є (-)} be a family of distributions of the sequence.  For each n, An is the σ-field generated by X₁,…, X_n.If θ₁,θ₂ Є (-), we define R_n (θ₁,θ₂) as the density ratio of P_θ1,P_θ2 on An.

The main purpose of the paper is to investigate limiting behavior of the sequence R_n with respect to any P_θ. This has applications in sequential analysis, where it is desired to know whether a sequential probability ratio test terminates with probability one.  The same conclusion can be drawn in the case of generalized sequential probability ratio test, under some restriction as to how the stopping bounds vary with n.

If the X_i are independent and identically distributed, then we can write in Rn  as  where the Y_i are independent and identically distributed. We have then that  converges to ~ or to -~ a.e. according as E_θ {Y_i}>0 or <0. For any θ, say θ₀, for which Eθ₀{Yi}=0 we have lim inf Rn="0" and lim sup R_n=~ a.e. Pθ_0.

A sequence of non-independent nor identically distributed random variables {Xi} may arise in tests of composite hypotheses in the presence of nuisance parameters. An example of the situation is the sequential t-test, by some authors called the WAGR test. In this example we have the same qualitative  result as if the  Xi are independent and identically distributed.

The foregoing example suggested the more general problem with the assumption A  and B (see chapters 2 and 3). The result can be described as follows: If θ₁ < θ₂ then R_n converges a.e. to 0 if θ≤θ₁ and to ~ if 0 ≥ θ₂. For θ between θ₁and θ₂, except perhaps for one θ₀, then lim inf is 0 or lim sup is ~ a.e. So that a sequential probability ratio test terminates with probability one, except perhaps for one value of θ. There is no example known to show  that there may exist a θ₀ for which  the sequence density ratios has a positive lim inf and a finite lim sup.

Download Article