Next Article in Journal
Thermal Contact
Next Article in Special Issue
Information, Deformed қ-Wehrl Entropies and Semiclassical Delocalization
Previous Article in Journal
Non-linear Information Inequalities
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Generalized Measure of Departure from No Three-Factor Interaction Model for 2 x 2 x K Contingency Tables

Department of Information Sciences, Faculty of Science and Technology, Tokyo University of Science, Noda City, Chiba, 278-8510, Japan
*
Author to whom correspondence should be addressed.
Entropy 2008, 10(4), 776-785; https://doi.org/10.3390/e10040776
Submission received: 31 October 2008 / Accepted: 16 December 2008 / Published: 22 December 2008
(This article belongs to the Special Issue Information and Entropy)

Abstract

:
For 2 × 2 × K contingency tables, Tomizawa considered a Shannon entropy type measure to represent the degree of departure from a log-linear model of no three-factor interaction (the NOTFI model). This paper proposes a generalization of Tomizawa’s measure for 2 × 2 × K tables. The measure proposed is expressed by using Patil-Taillie diversity index or Cressie-Read power-divergence. A special case of the proposed measure includes Tomizawa’s measure. The proposed measure would be useful for comparing the degrees of departure from the NOTFI model in several tables.

1. Introduction

For the I × J × K contingency table, let p i j k denote the probability that an observation will fall in the cell ( i , j , k ) of the table ( i = 1 , , I ; j = 1 , , J ; k = 1 , , K ) . One can express log p i j k as
log p i j k = u + u 1 ( i ) + u 2 ( j ) + u 3 ( k ) + u 12 ( i j ) + u 13 ( i k ) + u 23 ( j k ) + u 123 ( i j k ) ,
where
i u s ( i ) = 0 ( s = 1 , 2 , 3 ) , i u s t ( i j ) = j u s t ( i j ) = 0 ( 1 s < t 3 ) , i u 123 ( i j k ) = j u 123 ( i j k ) = k u 123 ( i j k ) = 0 ;
see, e.g., Bishop, Fienberg and Holland [1, Chap. 2]. Let l i j k = log p i j k . The u-term in (1) are, for example,
u = l · · · I J K ( overall mean ) , u 1 ( i ) = l i · · J K l · · · I J K ( main effect of variable 1 ) , u 12 ( i j ) = l i j · K l i · · J K + l · j · I K + l · · · I J K ( two factor effect between variables 1 and 2 ) ,
and
u 123 ( i j k ) = l i j k ( u + u 1 ( i ) + u 2 ( j ) + u 3 ( k ) + u 12 ( i j ) + u 13 ( i k ) + u 23 ( j k ) ) ( three factor effect ( interaction ) ) ,
where
l · · · = i = 1 I j = 1 J k = 1 K l i j k , l i · · = j = 1 J k = 1 K l i j k , l i j · = k = 1 K l i j k , l · j · = i = 1 I k = 1 K l i j k ;
see, e.g., Bishop et al. [1, Chap. 2].
We obtain the well-known four models by setting the parameters in (1) as
( i ) u 12 ( i j ) = u 13 ( i k ) = u 23 ( j k ) = u 123 ( i j k ) = 0 , ( ii ) u 13 ( i k ) = u 23 ( j k ) = u 123 ( i j k ) = 0 , ( iii ) u 13 ( i k ) = u 123 ( i j k ) = 0 , ( iv ) u 123 ( i j k ) = 0 ,
for all i , j , k . Model (1) imposed restriction (iv) is usually referred to as the no three-factor interaction (NOTFI) model (or no second-order interaction model). Model (1) imposed restrictions (i), (ii), (iii) and (iv) also can be expressed as
H 1 : p i j k = p i · · p · j · p · · k , H 2 : p i j k = p i j · p · · k , H 3 : p i j k = p i j · p · j k p · j · , H 4 : θ i j ( 1 ) = = θ i j ( K ) ,
respectively, where
p i · · = j k p i j k , p · j · = i k p i j k , p · · k = i j p i j k , p i j · = k p i j k , p · j k = i p i j k , θ i j ( t ) = p i j t p i + 1 , j + 1 , t p i , j + 1 , t p i + 1 , j , t ;
see, e.g., Fienberg [2, Chap. 3]. When none of models H 1 , H 2 , H 3 and H 4 holds, namely, when model H 4 does not hold, we are interested in seeing the degree of departure from model H 4 , i.e., the degree of non-uniformity of odds-ratios { θ i j ( t ) } .
For the 2 × 2 × K contingency table, Tomizawa [3] considered a measure which represents the degree of departure from the NOTFI model. The measure is expressed by using the Shannon entropy (see Appendix).
By the way, Patil and Taillie [4] considered the diversity index, which includes the Shannon entropy in a special case. We are interested in a measure of departure from the NOTFI model, based on the diversity index.
The purpose of this paper is to propose a generalization of Tomizawa’s measure for the 2 × 2 × K table. The proposed measure includes Tomizawa’s measure in a special case. The measure would be useful for comparing the degrees of departure from the NOTFI model in several tables.

2. A generalization of measure

Consider the 2 × 2 × K contingency table. The NOTFI model is expressed as
θ 1 = θ 2 = = θ K ,
where
θ t = p 11 t p 22 t p 12 t p 21 t .
This shows that the K odds-ratios are identical. Let
D = k = 1 K θ k , θ t * = θ t D ,
for t = 1 , , K .
Assuming that the { p i j k } are positive, consider a measure to represent the degree of departure from the NOTFI model, defined by
φ ( λ ) = 1 H ( λ ) ( θ * ) C ( λ ) , for λ > 1
where
H ( λ ) ( θ * ) = 1 λ 1 t = 1 K ( θ t * ) λ + 1 , C ( λ ) = 1 λ 1 1 K λ ,
and the value at λ = 0 is taken to be the limit as λ 0 , where λ is a real value that is chosen by the user. Thus, φ ( 0 ) is equal to φ in Appendix. Note that φ ( 0 ) in equation (2) is the same as Tomizawa’s measure. Also, note that H ( λ ) ( θ * ) is Patil and Taillie’s diversity index of degree λ for { θ t * }, which includes the Shannon entropy (when λ = 0 ) in a special case.
The measure φ ( λ ) may be expressed as
φ ( λ ) = λ + 1 K λ C ( λ ) I ( λ ) θ t * ; 1 K ,
where
I ( λ ) ( · ; · ) = 1 λ ( λ + 1 ) t = 1 K θ t * θ t * 1 / K λ 1 .
Note that I ( λ ) ( { θ t * } ; { 1 K } ) is the power-divergence between { θ t * } and { 1 K } . For more details of the power-divergence I ( λ ) ( · ; · ) , see Cressie and Read [5], and Read and Cressie [6, p. 15].
The H ( λ ) ( θ * ) must lie between 0 and C ( λ ) but it cannot attain the lower limit of 0 in terms of the assumption that the { p i j k } are positive. Thus the measure φ ( λ ) must lie between 0 and 1, but it cannot attain the upper limit of 1. Now it is easily seen that the NOTFI model holds if and only if the measure φ ( λ ) is equal to zero. According to the diversity index or the power-divergence, φ ( λ ) represents the degree of departure from NOTFI model, and the degree increases as the value of φ ( λ ) increases.

3. Approximate confidence interval for measure

Let n i j k denote the observed frequency in the cell ( i , j , k ) of the 2 × 2 × K table ( i = 1 , 2 ; j = 1 , 2 ; k = 1 , , K ). Assuming that { n i j k } result from full multinomial sampling, we shall consider an approximate standard error and large-sample confidence interval of measure φ ( λ ) , using the delta method of which descriptions are given by, for example, Bishop et al. [1, Sec. 14.6]. The sample version of measure φ ( λ ) , i.e., φ ^ ( λ ) , is given by φ ( λ ) with { p i j k } replaced by { p ^ i j k } , where p ^ i j k = n i j k / n and n = n i j k . Using the delta method, n ( φ ^ ( λ ) φ ( λ ) ) has asymptotically (as n ) a normal distribution with mean zero and variance
σ 2 [ φ ( λ ) ] = λ + 1 λ C ( λ ) D λ + 2 2 × t = 1 K θ t 2 D θ t λ k = 1 K θ k λ + 1 2 1 p 11 t + 1 p 12 t + 1 p 21 t + 1 p 22 t .
Let σ ^ 2 [ φ ( λ ) ] denote σ 2 [ φ ( λ ) ] with { p i j k } replaced by { p ^ i j k } . Then σ ^ [ φ ( λ ) ] / n is an estimated approximate standard error for φ ^ ( λ ) , and φ ^ ( λ ) ± z p / 2 σ ^ [ φ ( λ ) ] / n is an approximate 100 ( 1 p ) percent confidence interval for φ ( λ ) , where z p / 2 is the percentage point from the standard normal distribution corresponding to a two-tail probability equal to p.

4. Examples

Table 1 taken from Agresti [7, p. 68] refers to the effect of passive smoking on lung cancer. It summarizes results of case-control studies from three countries among nonsmoking women married to smokers. For these data, the estimated odds-ratios between having passive smoking and lung cancer in Japan, Great Britain, and United States are 0.66, 0.63, and 0.76, respectively.
Let X, Y and Z denote the first, second and third variables, respectively. For Table 2 which is the 2 × 2 × 3 artificial data, the estimated odds-ratios between variables X and Y at each level of Z are 7.50, 0.33, and 1.33.
Table 1. The results of case-control studies from three countries among nonsmoking women married to smokers; from Agresti [7, p. 68].
Table 1. The results of case-control studies from three countries among nonsmoking women married to smokers; from Agresti [7, p. 68].
CountrySpouse SmokedCasesControls
JapanNo2182
Yes73188
Great BritainNo516
Yes1938
United StatesNo71249
Yes137363
Table 2. Artificial data (n is sample size).
Table 2. Artificial data (n is sample size).
n = 300
Y
ZX(1)(2)
(1)(1)5020
(2)1030
(2)(1)1030
(2)2020
(3)(1)2020
(2)3040
Because the confidence intervals for φ ( λ ) applied to the data in Table 1 include zero for all λ (see Table 3a), this would indicate that there is a structure of NOTFI model in Table 1; or, if this is not the case, then it indicates that the degree of departure from NOTFI model is slight. In contrast, since the confidence intervals for φ ( λ ) applied to the data in Table 2 do not include zero for all λ (see Table 3b), this would indicate that there is not a structure of NOTFI model in Table 2.
When the degrees of departure from NOTFI model in Table 1 and Table 2 are compared using the confidence intervals for φ ( λ ) , the degree of departure in Table 2 would be greater than that in Table 1. This is because, for any given λ ( > 1 ) , the values in the confidence interval for φ ( λ ) applied to the data in Table 2 are greater than the values in the corresponding confidence interval for φ ( λ ) applied to the data in Table 1. We note that in Table 3a the confidence interval for φ ( λ ) includes the negative values and this is natural because φ ^ ( λ ) has asymptotically a normal distribution.
Note: Let W ( λ ) denote the power-divergence statistic for testing goodness-of-fit of the NOTFI model with K 1 degrees of freedom, i.e.,
W ( λ ) = 2 λ ( λ + 1 ) i = 1 2 j = 1 2 k = 1 K n i j k n i j k m ^ i j k λ 1 , for < λ <
where m ^ i j k is the maximum likelihood estimate of the expected frequency m i j k under the NOTFI model and the values at λ = 1 and λ = 0 are taken to be the limits as λ 1 and as λ 0 , respectively. For the details of power-divergence test statistic, see Cressie and Read [5], and Read and Cressie [6, p. 15]. In particular, note that W ( 0 ) and W ( 1 ) are the likelihood ratio and Pearson chi-squared statistics, respectively. Table 4 gives the values of W ( λ ) applied to the data in Table 1 and Table 2. Therefore, the NOTFI model fits the data in Table 1 well, but it does not fit the data in Table 2 well.
Table 3. Estimates of φ ( λ ) , estimated approximate standard error for φ ^ ( λ ) , approximate 95% confidence interval for φ ( λ ) , applied to Table 1 and Table 2.
(a) For Table 1
(a) For Table 1
Values of λEstimated measureStandard errorConfidence interval
-0.40.0020.012(-0.021, 0.025)
00.0030.016(-0.028, 0.034)
0.60.0030.018(-0.031, 0.038)
1.00.0030.017(-0.031, 0.037)
1.60.0030.015(-0.027, 0.032)
(b) For Table 2
(b) For Table 2
Values of λEstimated measureStandard errorConfidence interval
-0.40.3880.124(0.145, 0.630)
00.4860.149(0.194, 0.777)
0.60.5360.166(0.211, 0.861)
1.00.5380.172(0.200, 0.876)
1.60.5170.180(0.165, 0.869)
Table 4. Values of power-divergence statistic W ( λ ) (with 2 degrees of freedom) for testing goodness-of-fit of the NOTFI model, applied to Table 1 and Table 2.
Table 4. Values of power-divergence statistic W ( λ ) (with 2 degrees of freedom) for testing goodness-of-fit of the NOTFI model, applied to Table 1 and Table 2.
Values of λFor Table 1For Table 2
-0.40.24024.889
00.24024.462
0.60.23924.056
1.00.23823.933
1.60.23723.957

5. Remark

Consider the case of K = 2 , i.e., 2 × 2 × 2 contingency table. Then the measure φ ( λ ) can be simply expressed as
φ ( λ ) = 1 1 λ C ( λ ) 1 r λ + 1 + 1 ( 1 + r ) λ + 1 , for λ > 1 ; λ 0 , 1 1 ( log 2 ) ( 1 + r ) ( 1 + r ) log ( 1 + r ) r log r , for λ = 0 ,
where
r = θ 1 θ 2 = p 111 p 221 p 122 p 212 p 121 p 211 p 112 p 222 .
In addition, the approximate variance of n ( φ ^ ( λ ) φ ( λ ) ) , which was given in Section 3, can be simply expressed as
σ 2 [ φ ( λ ) ] = λ + 1 λ C ( λ ) 2 r λ + 1 r ( 1 + r ) λ + 2 2 i = 1 2 j = 1 2 k = 1 2 1 p i j k .
Note that σ 2 [ φ ( λ ) ] = 0 when r = 1 . Now, three kinds of expressions of r are obtained as
r = p 111 p 221 p 121 p 211 / p 112 p 222 p 122 p 212 = p 111 p 212 p 112 p 211 / p 121 p 222 p 122 p 221 = p 111 p 122 p 112 p 121 / p 211 p 222 p 212 p 221 .
Therefore, the measure φ ( λ ) , which represents the degree of departure from the equality of odds-ratio between variables X and Y at each level of variable Z, also represents the degree of departure from the equality of odds-ratio between X and Z at each level of Y and further represents it between Y and Z at each of X.

6. Concluding Remarks

The measure φ ^ ( λ ) would be useful for comparing the degrees of departure from the NOTFI model in several tables.
Table 5. (a), (b) Artificial data (n is sample size).
(a) n = 315
(a) n = 315
Y
ZX(1)(2)
(1)(1)2520
(2)2540
(2)(1)4515
(2)2020
(3)(1)3020
(2)2015
(b) n = 1575
(b) n = 1575
Y
ZX(1)(2)
(1)(1)125100
(2)125200
(2)(1)22575
(2)150150
(3)(1)150100
(2)10075
Table 6. Values of φ ^ ( λ ) applied to Table 5a and Table 5b.
Table 6. Values of φ ^ ( λ ) applied to Table 5a and Table 5b.
Values of λFor Table 5aFor Table 5b
-0.40.0500.050
00.0660.066
0.60.0730.073
1.00.0700.070
1.60.0610.061
Table 7. Values of power-divergence statistic W ( λ ) (with 2 degrees of freedom) for testing goodness-of-fit of the NOTFI model, applied to Table 5a and Table 5b.
Table 7. Values of power-divergence statistic W ( λ ) (with 2 degrees of freedom) for testing goodness-of-fit of the NOTFI model, applied to Table 5a and Table 5b.
Values of λFor Table 5aFor Table 5b
-0.42.73413.669
02.73013.648
0.62.72613.630
1.02.72613.628
1.62.72713.637
Consider the artificial data in Table 5a and Table 5b. For Table 5a, the estimated odds-ratios between variables X and Y at each level of Z are 2.00, 3.00, and 1.13. All values of observed frequencies in Table 5a multiplied by 5 equal the values in Table 5b. Thus, it is natural that the estimated odds-ratios between variables X and Y at each level of Z for Table 5b are equal to those for Table 5a. Therefore, the value of φ ^ ( λ ) (for every λ) for Table 5a is identical with that for Table 5b (see Table 6). However the value of W ( λ ) is greater for Table 5b than for Table 5a (see Table 7). Therefore the measure φ ^ ( λ ) rather than test statistic W ( λ ) would be useful for comparing the degrees of departure from the NOTFI model in several tables.
The W ( λ ) is also an information measure on the cell probability scale, and moreover W ( λ ) / n seems to be a reasonable measure of departure from the NOTFI model (though it is not a function of odds-ratios { θ i } , i = 1 , , K ). However, φ ^ ( λ ) rather than W ( λ ) / n would be useful for comparing the degrees of departure from the NOTFI model in several tables. This is because φ ^ ( λ ) is always in the range between 0 and 1, but W ( λ ) / n is not; namely, φ ^ ( λ ) can measure the degree of departure toward the maximum departure from uniformity of odds-ratios { θ i } , i = 1 , , K ; but the W ( λ ) / n cannot measure it.
Table 8. (a), (b) Artificial data (n is sample size) and (c) corresponding values of φ ^ ( λ ) applied to Table 8a and Table 8b.
(a) n = 291
(a) n = 291
Y
ZX(1)(2)
(1)(1)279
(2)1016
(2)(1)1435
(2)3145
(3)(1)2818
(2)1345
(b) n = 291
(b) n = 291
Y
ZX(1)(2)
(1)(1)2223
(2)3016
(2)(1)2018
(2)2243
(3)(1)1121
(2)2639
(c) Values of φ ^ ( λ )
(c) Values of φ ^ ( λ )
Values of λFor Table 8aFor Table 8b
-0.40.1860.126
00.2130.170
0.60.2000.197
1.00.178*0.198
1.60.140*0.183
* indicates that φ ^ ( λ ) is less for Table 8a than for Table 8b.
The readers may be interested in which value of λ is preferred for a given table. However, in comparing tables, it seems difficult to discuss this. For example, consider the artificial data in Table 8a and Table 8b. We see from Table 8c that the value of φ ^ ( 0 ) is greater for Table 8a than for Table 8b, but the value of φ ^ ( 1 ) is less for Table 8a than for Table 8b. So, for these cases, it may be impossible to decide (by using φ ^ ( λ ) ) whether the degree of departure from the NOTFI model is greater for Table 8a or for Table 8b. But generally, for the comparison between two tables, it would be possible to draw a conclusion if φ ^ ( λ ) (for every λ) is always greater (or always less) for one table than for the other table. Thus, it seems to be important that which value of λ is preferred for a given table, the analyst calculates the value of φ ^ ( λ ) for various values of λ and discusses the degree of departure from the NOTFI model in terms of φ ^ ( λ ) values. It may seem to readers that when the odds-ratios of Table 8a vary more widely (relatively in ratio) than those of Table 8b, the φ ( λ ) values in Table 8c may vary with a pattern; namely, they are large for Table 8a for smaller values of λ, but the other way round when λ is greater than certain value less than 1. However, we cannot prove that the case holds. It may be dangerous to compare the degrees of departure from the NOTFI model in several tables in terms of only Tomizawa’s [3] measure, i.e., φ ^ ( 0 ) ; because it may arise that for two tables (say, table A and table B), φ ^ ( 0 ) is greater for table A than for table B, however, φ ^ ( λ 1 ) with some λ 1 ( 0 ) is less for table A than for table B.
The measure φ ^ ( λ ) would be useful when one wants to measure how far the odds-ratios { θ t } are directly distant from the uniformity, although W ( λ ) / n may be useful when one wants to measure how far the estimated cell probability distribution with the structure of NOTFI is distant from the sample cell probability distribution.
The readers may be interested in extending the measure φ ( λ ) to a 2 × 3 × K table or I × J × K table; however, it may be difficult to consider a single-valued measure to represent the degree of departure from no three-factor interaction.

Appendix

For the 2 × 2 × K contingency table, a measure of departure from the NOTFI model by Tomizawa [3] is given as follows:
φ = 1 H ( θ * ) log K ,
where
H ( θ * ) = t = 1 K θ t * log θ t *
and { θ t * } are defined in Section 2.

Acknowledgements

The authors would like to thank two referees for the helpful comments.

References and Notes

  1. Bishop, Y.M.M.; Fienberg, S.E.; Holland, P.W. Discrete Multivariate Analysis: Theory and Practice; The MIT Press: Cambridge, Massachusetts, 1975. [Google Scholar]
  2. Fienberg, S.E. The Analysis of Cross-Classified Categorical Data, 2nd Ed. ed; The MIT Press: Cambridge, Massachusetts, 1980. [Google Scholar]
  3. Tomizawa, S. A measure of departure from no three-factor interaction model in a 2 × 2 × k contingency table. J. Stat. Res. 1993, 27, 1–8. [Google Scholar]
  4. Patil, G.P.; Taillie, C. Diversity as a concept and its measurement. J. Am. Stat. Assoc. 1982, 77, 548–561. [Google Scholar]
  5. Cressie, N.A.C.; Read, T.R.C. Multinomial goodness-of-fit tests. J. Royal Stat. Soc., Series B 1984, 46, 440–464. [Google Scholar]
  6. Read, T.R.C.; Cressie, N.A.C. Goodness-of-Fit Statistics for Discrete Multivariate Data; Springer: New York, NY, 1988. [Google Scholar]
  7. Agresti, A. An Introduction to Categorical Data Analysis; Wiley: New York, NY, 1996. [Google Scholar]

Share and Cite

MDPI and ACS Style

Yamamoto, K.; Ban, Y.; Tomizawa, S. Generalized Measure of Departure from No Three-Factor Interaction Model for 2 x 2 x K Contingency Tables. Entropy 2008, 10, 776-785. https://doi.org/10.3390/e10040776

AMA Style

Yamamoto K, Ban Y, Tomizawa S. Generalized Measure of Departure from No Three-Factor Interaction Model for 2 x 2 x K Contingency Tables. Entropy. 2008; 10(4):776-785. https://doi.org/10.3390/e10040776

Chicago/Turabian Style

Yamamoto, Kouji, Yohei Ban, and Sadao Tomizawa. 2008. "Generalized Measure of Departure from No Three-Factor Interaction Model for 2 x 2 x K Contingency Tables" Entropy 10, no. 4: 776-785. https://doi.org/10.3390/e10040776

APA Style

Yamamoto, K., Ban, Y., & Tomizawa, S. (2008). Generalized Measure of Departure from No Three-Factor Interaction Model for 2 x 2 x K Contingency Tables. Entropy, 10(4), 776-785. https://doi.org/10.3390/e10040776

Article Metrics

Back to TopTop