Background Indicators

Abstract

It is customary to assume that an indicator of a latent variable is driven by the latent variable and some random noise. In contrast, a background indicator is also systematically influenced by variables outside the structural model of interest. Background indicators deserve attention because in empirical work they are difficult to distinguish from ordinary effect indicators. This paper assesses instrumental variable (IV) estimation of the effect of a latent variable in a linear model when a background indicator replaces the latent variable. It turns out that IV estimates are inconsistent in many important cases. In some cases, the estimates capture causal effects of the indicator rather than causal effects of the latent variable. A simulation experiment that considers the impact of economic uncertainty on aggregate consumption illustrates some of the results.

1. Introduction

A popular strategy for estimating the causal effect of a latent variable in a linear structural model is to replace the latent variable with an indicator. It is usually assumed that the indicator variable is driven by the latent variable and some random noise.1 The effect of the latent variable is then estimated from the resulting auxiliary model.

It is well known that the ordinary least squares (OLS) method does not provide consistent coefficient estimates because the indicator becomes endogenous in the auxiliary model. In contrast, instrumental variable (IV) methods provide consistent estimates when a valid instrument is used for the indicator.

This paper looks at indicators of latent variables that violate the classical assumptions. In contrast to ordinary effect indicators, these indicators are also systematically influenced by variables that are not part of the structural model of interest. Such “background indicators” deserve attention because in empirical work they can easily be confused with ordinary effect indicators. This paper studies how background indicators affect the identification and estimation of causal effects of latent variables in linear models.

Background indicators are subtle. As just mentioned, background indicators are influenced by “background variables” that do not belong to the structural model of interest. Thus, background indicators do not directly affect the dependent variable. However, a background indicator can, in contrast to an ordinary effect indicator, also be a cause of the latent variable. In this case, the background indicator affects the dependent variable only indirectly via the latent variable. Background indicators can invalidate otherwise perfectly valid instruments for the latent variable. This happens because of the chosen indicator and not because there is something fundamentally wrong with the instrument. Moreover, in certain cases one must control for the background variable in an IV estimation although the indicator has neither a direct nor an indirect effect on the dependent variable, and although the instrument for the latent variable is valid. Furthermore, when a background indicator causes the latent variable it can happen that IV estimation yields the causal effect of the indicator rather than the causal effect of the latent variable. The objective of this paper is to explain these notable results in detail.

Background indicators can in principle occur in any empirical study in which latent variables are replaced by indicators. The following two examples from economics are cases where background indicators might occur. The discussion aims to highlight possible scenarios and should not be understood as a critique of the empirical results of these studies.

The first example is about the impact of financial development on economic growth. Financial development is an unobservable variable. Therefore, bank credit relative to gross domestic product (GDP) is often used as an indicator for the development of the banking sector of a country.2 However, credit to GDP ratios may capture more than domestic financial development. International financial integration may also affect credit to GDP ratios, in particular in developing economies where foreign lending is important (Giannetti and Ongena 2009). Furthermore, international financial integration may also directly affect the financial sector of a country via entry, or the thread of entry of foreign banks. Thus, credit to GDP ratios may be background indicators of financial development, and international financial integration may be a background variable.

The second example deals with uncertainty and economic activity. Empirical studies about the impact of uncertainty on economic activity often use stock market volatility to measure uncertainty.3 For example, Bloom (2009) finds that stock market volatility rises sharply after bad events such as war or terror. However, these bad events may simultaneously affect stock market volatility and economic uncertainty. Moreover, high levels of stock market volatility may amplify uncertainty when people see the stock market as a predictor of future economic activity (Farmer 2015; Romer 1990). Stock market volatility could therefore be a background indicator of uncertainty that sometimes reinforces economic uncertainty even further.

The analysis in this paper builds on causal graphs and path-tracing rules (Chen and Pearl 2014; Morgan and Winship 2007; Pearl 2009). Causal graphs make modeling assumptions transparent, and the path-tracing rules yield algebraic expressions for OLS and IV estimates when the model is linear.

Graphical methods for studying structural models are well known in statistics, computer science, and sociology, but are relatively unknown in economics.4 Therefore, the next section provides a gentle introduction to the graphical methods that are used in this paper. The book of Pearl (2009) provides a comprehensive and much more general treatment of graphical methods and causal inference.

The graphical analysis proceeds in two steps. The analysis first presents some results about identification of effects of latent variables with IV methods and ordinary effect indicators through the lens of graphical methods. Additional control variables can play an important role in the identification of the causal effect of a latent variable. The exposition therefore explains what types of control variables enable or prevent identification of effects of latent variables. The results about control variables also apply when IV methods are used to identify effects of observable variables. Some of these results are not all widely known and are not discussed in standard econometrics texts. The main point of this first step is to equip the reader with general results that are also relevant in the analysis of background indicators.

Then the analysis moves on to background indicators. The analysis shows that background indicators complicate the identification of effects of latent variables. Moreover, background indicators often produce inconsistent estimates in empirically relevant cases. The last part of the graphical analysis shows that a background indicator can nevertheless be a useful instrument for an effect indicator.5

A simple simulation experiment in which stock market volatility is used to estimate the effect of uncertainty on consumption illustrates how background indicators can affect OLS and IV estimates. The experiment shows that the negative impact of uncertainty on consumption may be overestimated when stock market volatility is a background indicator.

2. Graphs and Path-Tracing Rules

This section introduces causal graphs and the path-tracing rules that are used in this paper. Figure 1 shows five graphs. Solid nodes represent observed variables, hollow nodes represent unobserved variables, solid arrows indicate causal links, and curved dashed bi-directed arrows indicate covariances that arise from unspecified causes. Hence, all variables in Figure 1a–c are observed, $X_3$ is unobserved in Figure 1d, and $X_1$ causes $X_2$ in Figure 1e but the variables are also correlated because of other unmodeled causes.

A path is a sequence of nodes connected by arrows. A path is d-connected if it does not traverse any collider.6 A variable is a collider on a path if two arrows are pointing into it. Thus, the paths $X_1\to X_2$ and $X_1\leftarrow X_3\to X_2$ in Figure 1a are d-connected. The path $X_1\to X_3\leftarrow X_2$ in Figure 1b is not d-connected because $X_3$ is a collider that blocks the path.

A path between two variables $X_i$ and $X_j$ can be blocked or d-separated by a set of variables S in two ways. The path can be blocked by conditioning when the path contains a chain $X_i⟶X_k⟶X_j$ or a fork $X_i⟵X_k⟶X_j$ and the middle variable $X_k$ is in the conditioning set S. The path between $X_i$ and $X_j$ is also blocked when the path contains a collider $X_i⟶X_k⟵X_j$ and the collider $X_k$ (or any of its descendants) is not in the conditioning set S. As a consequence, two variables $X_i$ and $X_j$ are d-connected conditional on a set of variablesS if there is a collider-free path between them that does not traverse any member of S, or if there is a path between them where a collider is in the conditioning set S.

Two simple path-tracing rules (Pearl 2013) yield analytical expressions for covariances between variables in a graph.7 The resulting expressions for the covariances can be substituted into other formulas.

The first path-tracing rule applies to standardized variables (i.e., variables that have been normalized to have zero mean and unit variance). Let ${\pi }_i=c_{1\left(i\right)}·c_{2\left(i\right)}·\dots ·c_{n\left(i\right)}$ be the product of the $n\left(i\right)$ path coefficients $c_{j\left(i\right)}$ along a path i that d-connects two standardized variables A and B, say. Path coefficients can either be structural coefficients or covariances. The first rule states that the covariance between A and B is the sum of the products of the path coefficients along all d-connected paths between A and B, i.e., ${\sigma }_{AB}={\mathsf{\Sigma }}_i{\pi }_i$.

The second path-tracing rule extends the first path-tracing rule to non-standardized variables. The product ${\pi }_i$ associated with a path i of non-standardized variables A and B must be multiplied by the variance ${\sigma }_{X_{j\left(i\right)}}^2$ of the variable $X_{j\left(i\right)}$ from which path i originates. Double arrows serve as their own origin. Thus, when A and B are non-standardized variables, then ${\sigma }_{AB}={\mathsf{\Sigma }}_i{\pi }_i{\sigma }_{X_{j\left(i\right)}}^2$.

It is instructive to use the path-tracing rules to derive the covariance between $X_1$ and $X_2$ conditional on $X_3$ in Figure 1a–c, because the results show how conditioning on a third variable may affect the covariance between the other two variables. Equation (1) expresses the covariance between $X_1$ and $X_2$ conditional on $X_3$,

$${\sigma }_{X_2{X}_1\mid X_3}={\sigma }_{X_1{X}_2}-\frac{{\sigma }_{X_1{X}_3}{\sigma }_{X_3{X}_2}}{{\sigma }_{X_3}^2},$$

(1)

in terms of the unconditional covariances. For convenience, let us assume that $X_1$, $X_2$, and $X_3$ are standardized multivariate normally distributed random variables.8 Thus, ${\sigma }_{X_1}^2={\sigma }_{X_2}^2={\sigma }_{X_3}^2=1$.

In Figure 1a conditioning uncovers the causal effect of $X_1$ on $X_2$. Fixing $X_3$ blocks the path $X_1\leftarrow X_3\to X_2$. Path-tracing yields ${\sigma }_{X_1{X}_2}=\beta +\alpha \gamma$, ${\sigma }_{X_1{X}_3}=\alpha$ and ${\sigma }_{X_3{X}_2}=\gamma$. Plugging these expressions into (1) yields ${\sigma }_{X_2{X}_1\mid X_3}=\beta$.

In Figure 1b the variables $X_1$ and $X_2$ are independent. Thus, ${\sigma }_{X_1{X}_2}=0$, but conditioning on the common outcome $X_3$ creates dependence between $X_1$ and $X_2$. Intuitively, information about one of the causes makes the other cause more or less likely, given that we know the outcome. Here, ${\sigma }_{X_1{X}_3}=\alpha$, ${\sigma }_{X_3{X}_2}=\beta$, and (1) yields ${\sigma }_{X_2{X}_1\mid X_3}=-\alpha \beta$.

In Figure 1c the variable $X_3$ mediates the effect of $X_1$ on $X_2$. The unconditional covariance is ${\sigma }_{X_1{X}_2}=\alpha \beta$. Conditioning on $X_3$ breaks this link, and ${\sigma }_{X_2{X}_1\mid X_3}=0$.

3. Effect Indicators

In empirical studies it is common that a model for the dependent variable contains one or more explanatory variables of interest and some additional control variables that should help to identify causal effects of the explanatory variables of interest. Here we are interested in the causal effect of a latent variable L. In this paper, I always denotes an indicator of the latent variable. In this section, I is an effect indicator. Later, in Section 4 and Section 5, the letter I will denote a background indicator that is affected by a background variable B.

Let us now consider a linear structural model

$$Y=\alpha +\beta L+\gamma X+u$$

(2)

where Y is the dependent variable, L is a latent variable, X is a column vector of control variables, $\gamma$ is a row vector of coefficients, and u is an error term. The coefficient $\beta$ measures the effect of L on Y.

If L were observable, OLS would provide a consistent estimate for $\beta$ if in the population there is no exact linear relationship between the regressors and the error u has mean zero and is uncorrelated with each of the regressors.9 However, here we cannot observe L.

A standard solution to this problem is to find an indicator I of the latent variable of the form

$$I=\lambda L+e$$

(3)

where the error e is assumed to be uncorrelated with L. Most latent variables have no natural scale. It is, therefore, common to set $\lambda =1$, so that the observable indicator and the latent variable have the same scale.

Rearranging (3) and plugging in for L in (2) yields

$$Y=\alpha +\delta I+\gamma X+ϵ$$

(4)

where $\delta$ = $\beta /\lambda$ and $ϵ=u-\delta e$.10 It is easy to show that the indicator I is correlated with the compound error $ϵ$ and therefore endogenous. Thus, OLS is inconsistent.

Let us now turn to IV estimation of model (4). For simplicity, let us assume that the structural model (2) has only a single control variable X and that all variables are demeaned such that $\alpha =0$. Let Z be an instrument for the latent variable L. The IV estimator for $\delta$ in the auxiliary model (4) is (Bowden and Turkington 1984)

$${\delta }_{Y.IX}^{IV}=\frac{{\sigma }_X^2{\sigma }_{ZY}-{\sigma }_{ZX}{\sigma }_{XY}}{{\sigma }_X^2{\sigma }_{ZI}-{\sigma }_{ZX}{\sigma }_{XI}}.$$

(5)

When Z is uncorrelated with X (i.e., ${\sigma }_{ZX}=0$) then Equation (5) collapses to the simple IV estimator

$${\delta }_{Y.I}^{IV}=\frac{{\sigma }_{YZ}}{{\sigma }_{IZ}}$$

(6)

that arises when model (4) is estimated without X.11

Figure 2 depicts five causal graphs where I is an effect indicator of the latent variable L. Figure 2a shows a case where the error e in I and the error u in the structural model (2) are uncorrelated. This is the standard assumption made in applied work. One path connects Z and Y via L, and one path runs from Z via L to I. Hence, ${\sigma }_{YZ}=\pi \beta {\sigma }_Z^2$ and ${\sigma }_{IZ}$ = $\pi \lambda {\sigma }_Z^2$. Moreover, ${\sigma }_{ZX}=0$ because the only path between Z and X is blocked by Y. Thus, the simple IV estimator applies. Plugging the expressions for ${\sigma }_{YZ}$ and ${\sigma }_{IZ}$ into (6) yields

$${\delta }_{Y.I}^{IV}=\frac{\beta }{\lambda }$$

(7)

and hence $\beta$ by imposing $\lambda$ = 1 in (3).12

Figure 2b relaxes the standard assumption of uncorrelated errors because the errors e and u are correlated. Furthermore, X is now a confounding variable, and the latent variable L in the structural model is endogenous because of neglected other joint causes of L and Y. These complications appear to be substantial, but they have no effect because L and I are colliders. In particular, ${\sigma }_{ZX}=0$. The simple IV estimator still applies, and there is no need to control for the confounding variable X.

Figure 2c shows a case where X is an outcome of Z and Y. Including X in the regression would now be harmful because the “back-door” path between Z and Y would be opened. Z is only a valid instrument for I without controlling for X. Path-tracing verifies that the simple IV estimator (6) works, but the IV estimator (5) that takes X into account does not.

In Figure 2d the latent variable affects the dependent variable directly and indirectly via the mediating variable X. Now, the IV estimator ${\delta }_{Y.IX}^{IV}=\beta /\lambda$ yields the direct effect of the latent variable L. The simple IV estimator yields ${\delta }_{Y.I}^{IV}=(\beta +\varphi \gamma )/\lambda$, which is the total effect (i.e., the direct + the indirect effect) of L on Y. Hence, identification of the direct effect of the latent variable requires controlling for the mediating variable X.

In the former cases the instrument Z caused the latent variable L. Figure 2e shows a situation where the instrument Z is a second effect indicator of L. This apparently minor difference to the former cases has important consequences. First, the errors e and u may be correlated but the error v in Z must be uncorrelated with both errors. Second, the latent variable L must now be exogenous in the structural model (i.e., there must be no double arrows between L and Y). Third, one must control for all L – Y confounding variables. Then the ratio $\beta /\lambda$ is identified. While conditioning L – Y confounders is necessary for identification, conditioning on L – Y mediators (such as the X variable in Figure 2d) is only necessary if one wants to disentangle direct and indirect effects of the latent variable and not to obtain the total effect. Thus, IV estimates of the effect of the latent variable that are based on two effect indicators require stronger assumptions than estimates where the instrument causes the latent variable.

4. Background Indicators

As already explained, background indicators are, in contrast to ordinary indicators, also systematically affected by variables that are not part of the original structural model. Background variables could be joint causes of the latent variable and the indicator, or they could be variables that mediate effects of the latent variable to the indicator.

Figure 3 shows four cases with background indicators. For clarity, the graphs now abstract from error terms and additional control variables because these issues have already been discussed in the previous section.

Figure 3a,b describe cases that could occur in studies on the link between financial development and economic growth. In these examples Y is economic growth and L is financial development, which is the latent variable we are interested in. The variable I is a ratio of bank credit to GDP, B is a background variable such as international financial integration, and Z is an instrument for financial development. Empirical studies have for instance used the origin of the legal system of a country as an instrument for the development of its financial system (Levine et al. 2000).

In Figure 3a the background variable B causes the latent variable L and the indicator I. The covariance between Z and Y is ${\sigma }_{YZ}=\pi \beta {\sigma }_Z^2$, and the covariance between I and Z is ${\sigma }_{IZ}=\pi \lambda {\sigma }_Z^2$. The resulting IV estimate is therefore

$${\delta }_{Y.I}^{IV}=\frac{{\sigma }_{YZ}}{{\sigma }_{IZ}}=\frac{\beta }{\lambda }.$$

(8)

As can be seen, this estimate is not affected by the background indicator. The usual practice of setting $\lambda =1$ may be more difficult to justify, however.

Figure 3b shows a situation where the latent variable affects the indicator directly and indirectly via the mediating background variable B. The covariances are now ${\sigma }_{YZ}=\pi \beta {\sigma }_Z^2$ and ${\sigma }_{IZ}=\pi \lambda {\sigma }_Z^2+\pi {\theta }_2{\theta }_1{\sigma }_Z^2$. The IV estimate becomes

$${\delta }_{Y.I}^{IV}=\frac{\beta }{\lambda +{\theta }_2{\theta }_1}.$$

(9)

Thus, the presence of B biases the simple IV estimate. This bias can only be removed by controlling for B, as can be verified by computing the IV estimate ${\delta }_{Y.IB}^{IV}$ using (5). Remarkably, in case (b) the background variable B must be included in the regression, even though B does not affect the dependent variable Y in the structural model.

Figure 3c,d shows two cases that could for example occur in studies about effects of uncertainty on economic activity. Here, Y is economic activity, L is the unobservable uncertainty, I is stock market volatility, a frequently used indicator of uncertainty, and B is a background variable.

Figure 3c,d depict a situation, as considered in Romer (1990), where a stock market crash or extreme stock market volatility becomes an additional source of uncertainty in an economy. Certain events B such as terrorist attacks, wars, or other bad events may raise uncertainty in the economy. Without a stock market there would be no further source of uncertainty. However, here a stock market exists, and the events B may also affect the uncertainty of stock traders about the future course of the economy. This uncertainty is reflected in the volatility of the stock market. Please note that the traders may sit anywhere (i.e., in large international financial institutions) and may not necessarily belong to the economy of interest. While people may not own stocks themselves, they interpret the stock market as a predictor of their future income, and they become nervous when they see extreme stock market volatility. Stock market volatility now becomes an additional source of uncertainty that amplifies the uncertainty in the economy even further.

As already mentioned, background indicators may easily get confused with ordinary effect indicators. Figure 3c depicts such a case. The background variable B captures exogenous events that simultaneously drive uncertainty L and stock market volatility I, but volatility amplifies uncertainty further. Variables that cause only the latent variable do not work as instruments here because such variables are necessarily uncorrelated with the indicator. Thus, one is tempted to use the exogenous variable B that is correlated with the indicator I as an instrument.

Using B mistakenly as an instrument for I yields ${\sigma }_{YB}={\theta }_2\beta {\sigma }_B^2+{\theta }_1\lambda \beta {\sigma }_B^2$ and ${\sigma }_{IB}={\theta }_1{\sigma }_B^2$. The resulting IV estimate

$${\delta }_{Y.I}^{IV}=\frac{{\sigma }_{YB}}{{\sigma }_{IB}}=\left(\lambda +\frac{{\theta }_2}{{\theta }_1}\right)\beta$$

(10)

is inconsistent. The estimate captures three distinct effects, namely the effect $\lambda \beta$ of I on Y, the effect ${\theta }_2\beta$ of B on Y, and the strength ${\theta }_1$ of the effect of B on I. The estimate tends to the causal effect of I on Y when ${\theta }_2$ is small. When ${\theta }_1$ is close to zero the estimate blows up, because B becomes a weak instrument.

What does OLS yield when stock market volatility amplifies uncertainty? Since ${\sigma }_{YI}=\lambda \beta {\sigma }_B^2+{\theta }_1{\theta }_2\beta {\sigma }_B^2$ the OLS estimate

$${\delta }_{Y.I}^{OLS}=\frac{{\sigma }_{YI}}{{\sigma }_I^2}=\lambda \beta +\left({\theta }_1{\theta }_2\beta \right)\frac{{\sigma }_B^2}{{\sigma }_I^2}$$

(11)

is also biased and inconsistent because the background variable B has been omitted. The second term in (11) reflects this bias.

Regressing Y on I and B removes the omitted variable bias in (11), but the resulting estimate ${\delta }_{Y.IB}^{OLS}=\lambda \beta$ is the causal effect of I on Y. In this example one would therefore estimate the causal effect of stock market volatility on output rather than the effect of uncertainty on output.

Let us now assume that ${\theta }_1={\theta }_2=\lambda =1$. In this case, exogenous bad events affect the uncertainty of traders and the public to the same extent and stock market volatility fully amplifies uncertainty. Let us further assume that the effect of uncertainty on output is negative, as theory predicts.13 The IV estimate given in (10) becomes $2\beta$ and the OLS estimate (11) is $(\beta +r\beta )$ where r denotes the ratio of ${\sigma }_B^2/{\sigma }_I^2$. Both quantities overestimate the magnitude of the (negative) effect of uncertainty, but OLS can get close to $\beta$ when r is small. In contrast, a weaker link (i.e., ${\theta }_1<0$) between B and I would inflate the IV estimate further.

Figure 3d shows a case where Z is indeed a valid instrument for stock market volatility I. Even if such an instrument could be found it would not solve the problem. Path-tracing yields ${\sigma }_{YZ}=\pi \lambda \beta {\sigma }_Z^2$ and ${\sigma }_{IZ}=\pi {\sigma }_Z^2$. The resulting IV estimate ${\delta }_{YI}^{IV}=\lambda \beta$ would capture the causal effect of stock market volatility on output rather than the effect of uncertainty on output.

5. Background Indicators as Instruments

We have seen that background indicators complicate the identification and estimation of effects of latent variables. In fact, identification becomes virtually impossible without an additional effect indicator for the latent variable when the background indicator causes the latent variable.

Figure 4 shows a case where we have two indicators for the latent variable L. The first indicator I is a background indicator. The second indicator E is an ordinary effect indicator. The graph abstracts again from error terms and control variables. All issues concerning the inclusion or exclusion of control variables discussed in Section 3 apply here as well.

The background indicator I can now be used as an instrument for E. The IV estimate is

$${\delta }_{Y.E}^{IV}=\frac{{\sigma }_{YI}}{{\sigma }_{EI}}=\frac{\beta (\lambda {\sigma }_I^2+{\theta }_1{\theta }_2{\sigma }_B^2)}{\phi (\lambda {\sigma }_I^2+{\theta }_1{\theta }_2{\sigma }_B^2)}=\frac{\beta }{\phi }$$

(12)

and yields $\beta$ by setting $\phi =1$. The background indicator I is also a valid instrument when the causal link goes from L to I or when B mediates the effect of L on I. There is no need to control for the background variable, but it must be kept in mind that one must control for all confounding or mediating variables that belong into the structural model when the background indicator is caused by the latent variable.

6. Simulations

The following simulation experiment considers the impact of uncertainty on aggregate consumption growth. The goal of the simulations is to illustrate some of the theoretical results. As mentioned earlier, economic theory predicts that uncertainty about future income reduces consumption, since the value of postponing consumption decisions increases with increasing uncertainty. In the simulations it is, therefore, assumed that higher uncertainty lowers aggregate consumption growth. Since uncertainty cannot be observed directly, consumption growth is regressed on the logarithm of stock market volatility, which is assumed to be an indicator of uncertainty. As is usual for macroeconomic series, the linear relationships between the variables are assumed to hold on the logarithmic scale. The estimated regression coefficient for the effect of uncertainty therefore measures the elasticity of consumption growth with respect to uncertainty in percentage terms.

6.1. Setup

The setup of the simulation experiment is very simple. A process

$$\ln \left(B_t\right)={\omega }_0+{\omega }_1(\ln \left(B_{t-1}\right)-{\omega }_0)+e_t^B$$

(13)

represents the flow of exogenous events that cause uncertainty. The parameter ${\omega }_0$ captures the average level of this process, and the parameter ${\omega }_1$ determines how fast the process moves towards its average. The random variable $e_t^B$ represents new events at time t. This variable is identically and independently distributed (iid) and follows a normal distribution with zero mean and variance ${\sigma }_B^2$, i.e., $e_t^B$∼ iid N(0,${\sigma }_B^2$).

Logarithms are used to create an index of exogenous events that always has a positive numeric value. The basic idea is that adverse events receive larger numerical values than less adverse events. The autoregressive structure of Equation (13) reflects the idea that adverse events can trigger further adverse events.

$B_t$ plus unsystematic noise $e_t^U$∼ iid N(0, ${\sigma }_U^2$) creates uncertainty of the amount

$$U_t=\ln \left(B_t\right)+e_t^U$$

(14)

at time t.

The simulation experiment considers three different models. The first model ($m1$) corresponds to Figure 2a.14 Here the logarithm of stock market volatility

$$V_t=U_t+e_t^V$$

(15)

is an ordinary effect indicator. The random noise $e_t^V$ in $V_t$ is iid N(0, ${\sigma }_V^2$). Please note that stock market volatility $S{V}_t=exp\left(V_t\right)$ itself is always positive by construction.

Consumption growth is generated as

$$C_t^{m1}={\eta }_0-{\eta }_1(U_t-{\omega }_0)+e_t^C$$

(16)

with $e_t^C$∼ iid N(0, ${\sigma }_C^2$). Thus, people reduce consumption when uncertainty exceeds its average level of ${\omega }_0$ and expand consumption when uncertainty is below average.

The second model ($m2$) corresponds to Figure 3c. Uncertainty has now two sources that originate from the same background variable. The background variable $B_t$ affects uncertainty directly and indirectly via stock market volatility

$$V_t=\ln \left(B_t\right)+e_t^V.$$

(17)

Consumption growth is now given by

$$C_t^{m2}={\eta }_0-{\eta }_1[(\ln \left(B_t\right)+e_t^U-{\omega }_0)+(V_t-{\omega }_0)]+e_t^C$$

(18)

Thus, consumption growth slows down when the uncertainty that originates directly from adverse events is above the level ${\omega }_0$ and (or) when the observed level of stock market volatility is above ${\omega }_0$.

The third model ($m3$) combines ($m1$) and ($m2$). People ignore lower levels of stock market volatility, but they get nervous when volatility is high. Thus, stock market volatility is a standard effect indicator as long as volatility remains below a critical level $lc$ and consumption is determined by Equation (16). However, when volatility exceeds $lc$ then volatility becomes a background indicator that causes uncertainty. In the latter case consumption follows Equation (18). Hence, in ($m3$) consumption growth is generated as

$$C_t^{m3}=(1-d)·C^{m1}+d·C^{m2}$$

(19)

where $d=1$ when $S{V}_t>lc$ and zero otherwise.

The above models are intended as very simple examples. Nevertheless, an attempt is made to obtain simulated data with realistic statistical properties. The parameters reported in

Table 1. Parameters

Equations	Parameters
(13)	${\omega }_0$ = 2.0, ${\omega }_1$ = 0.90, ${\sigma }_B^2$ = 0.2
(14)	${\sigma }_U^2$ = 0.1
(15), (17)	${\sigma }_V^2$ = 0.3
(16), (18), (19)	${\eta }_0$ = 0.7, ${\eta }_1$ = −0.5, ${\omega }_0$ = 2.0, ${\sigma }_C^2$ = 0.3

produce series that have statistical properties similar to US stock market volatility and US aggregate consumption growth.

The upper part of

Table 2. Stock market volatility and consumption growth: statistics for US data and simulated data.

Variable	Obs	Mean	Std	Min	Max	AR(1)
US data 1985q2–2011q4
Volatility	107	9.96	5.68	4.05	40.5	0.55
Consumption growth	107	0.70	0.56	−1.31	1.88	0.41
Simulated data, 1000 repetitions
(numbers are averages across repetitions)
Model $m1$
Volatility	200	8.66	4.96	1.85	32.0	0.52
Consumption growth	200	0.70	0.37	−0.33	1.72	0.30
Model $m2$
Volatility	200	8.62	4.84	1.90	31.1	0.55
Consumption growth	200	0.70	0.55	−0.77	2.17	0.54

shows summary statistics for quarterly US consumption growth and quarterly stock market volatility for the period 1985q2–2011q4. The lower part of Table 2 reports the same statistics averaged across 1000 simulated volatility and consumption growth series obtained with models $m1$ and $m2$.

In the simulations the starting value in (13) is always ln$\left(B_1\right)={\omega }_0$. In each repetition 300 observations are generated. Then the first 100 observations are discarded to remove possible effects of the starting value. The remaining 200 observations are used in all further calculations.

Most statistics for the US data and the simulated data in Table 2 are quite similar. Only the minimum of simulated consumption growth tends to be somewhat too high, and the maximum of simulated stock market volatility tends to be somewhat too low compared to the US data. It must be remembered, however, that the US data cover the crisis of 2007–2009 where volatility skyrocketed, and consumption dropped dramatically.

The experiment considers three regressions of the type

$$C_t=\alpha +\beta L_t+{ϵ}_t.$$

(20)

In these regressions the estimated $\beta$ coefficient provides an estimate for the parameter ${\eta }_1$ = −0.5 of the negative effect of uncertainty on consumption growth. First, consumption growth is regressed on the true but unobservable amount of uncertainty (i.e., $L_t=U_t$). The results from this OLS regression provide a benchmark to evaluate the performance of the alternative estimators in terms of simulation variability. Next, consumption growth is regressed on the logarithm of stock market volatility (i.e., $L_t=V_t$) using OLS. Finally, the same equation is estimated with two stage least squares (2SLS).

In the 2SLS regression the instrument for $V_t$ is a dummy variable $Z_t$ that captures “important exogenous events” that cause uncertainty. This dummy variable is constructed as in Bloom (2009) and Baker and Bloom (2012). In the simulations $Z_t=1$ when ln$\left(B_t\right)$ exceeds the 75% percentile of its empirical distribution, otherwise $Z_t=0$.

6.2. Results

Figure 5 shows empirical distributions of the estimated coefficient $\beta$ in (20). The distributions are based on samples of 200 observations, generated as described above, and 1000 repetitions.

Table 3. Medians of estimated coefficients for simulated models.

Model	OLS, $\mathit{L}=\mathit{U}$	OLS, $\mathit{L}=\mathit{V}$	2SLS
$m1$	−0.499	−0.340	−0.504
$m2$	−0.499	−0.836	−1.004
$m3a$	−0.500	−0.571	−0.810
$m3b$	−0.499	−0.497	−0.714

shows the medians of these distributions. Medians are reported because in finite samples the expectation of 2SLS estimates of $\beta$ in (20) based on a single instrument does not exist (Kinal 1980).

The upper left graph in Figure 5 shows the distributions for $\beta$ from model $m1$. OLS is inconsistent as to be expected, and the estimates are biased towards zero when stock market volatility is substituted for uncertainty. 2SLS is consistent, but the estimates are more dispersed than in the OLS regression where consumption is regressed on the true amount of uncertainty.

The results for model $m2$ where $V_t$ is a background indicator are displayed in the upper right half of Figure 5. Now, OLS and 2SLS clearly overestimate the negative effect of uncertainty on consumption when $V_t$ is used as an indicator. The median of the estimates is about −0.8 for OLS and −1 for 2SLS (see Table 3), which is in line with the theoretical results in Equations (11) and (10).

The lower part of Figure 5 shows results for two versions of model $m3$. In $m3a$ stock market volatility becomes an additional determinant of uncertainty when volatility exceeds the 75% percentile. Thus, 25% of the observations are determined by model $m2$ and 75% are determined by model $m1$. As can be seen, OLS and 2SLS again overestimate the negative effect of uncertainty, but OLS tends now to be much closer to the true value of −0.5 than 2SLS.

In model $m3b$ only 10% of the observations come from $m2$. The rest comes from model $m1$. The 2SLS estimates are again quite far away from the true value, but the estimates of OLS with stock market volatility and OLS with the true amount of uncertainty are now very similar. This happens because the OLS bias (compare columns two and three in Table 3) under $m1$ and $m2$ goes into different directions and nearly cancels out under this weighting of the models $m1$ and $m2$. Other weightings of models $m1$ and $m2$ and other parameter settings may of course lead to different results. Overall, the simulations provide a simple example for a situation where IV approaches overestimate the negative impact of uncertainty on economic activity when stock market volatility is a background indicator that becomes in certain periods an additional cause of uncertainty.

7. Conclusions

Background indicators of latent variables have until now been neglected although they might easily be confused with ordinary effect indicators. This paper studied simple linear models to gain a conceptual understanding of background indicators.

The analysis showed that background indicators produce inconsistent estimates of effects of latent variables in empirically relevant cases. In the simulation experiment, for instance, the estimated effects of uncertainty are too large when stock market volatility is a background indicator of uncertainty. Background indicators may be useful instruments, but they should not replace latent variables in a structural model. The results also suggest that the choice of indicators should, just like the choice credibility of instruments, be guided by theoretical considerations and careful judgment.

Future work could extend the analysis to nonlinear models. Analytical results are then of course more difficult to obtain. Another possible extension would be to investigate the usefulness of causal search algorithms for identifying background indicators. These issues are, however, beyond the scope of this paper and are left for future research.