3 - Statistical Information: Classical Approach

Summary

As discussed in the previous chapter, on the one hand, problems of estimation and testing are defined with respect to a function of the parameters. On the other hand, methods that answer these problems are based on functions of the observations. In the present chapter, we shall focus on the “information” on a given function of the parameters that is contained in a function of the observations, i.e., in a statistic. We shall study successively the following four issues:

1. a) Characterize the statistics that contain all the available information regarding the parameter function of interest. These are called sufficient statistics.

2. b) Characterize the statistics that contain no information regarding the parameter function of interest. These are called ancillary statistics.

3. c) Measure the loss of information associated with a given statistic that is neither sufficient nor ancillary.

4. d) Characterize the functions or the values of the parameters for which it is impossible to be completely informed. This is the so-called identification problem.

In this chapter, we shall study these issues within a classical framework, i.e., within a decision theoretical framework without a prior distribution on the parameters. Similar results are established in Chapter 4 within the Bayesian and empirical Bayesian frameworks.

Sufficiency

Definition

Suppose that an entrepreneur receives an important shipment of industrial parts. The shipment contains an unknown proportion θ of defective parts. Because a systematic quality control is too expensive, the entrepreneur only checks a sample of n parts. It is assumed that each part is randomly drawn with equal probability and replacement.