**3. Methodology**

The broader research design involved a three-way data collection approach (Figure 3). At its core, the research design built on the triangulation of qualitative and quantitative datasets, which is well recognised as a method for informing theory-led research development [47,48]. In what Creswell [47] describes as a sequential explanatory design, the literature review informs the survey questions and analysis that has informed the structure and approach of the interviews discussed in this article. In this way, Merriam and Grenier [49] suggest that "the interviews help the researcher understand the responses to the survey [14] as well as provide additional insights into the phenomenon of interest".

As shown in Figure 3, the development of a prototype SDG measurement model was to be based on the triangulation of learning from the literature review, the survey of 325 engineers and the subsequent interviews of 40 senior executives. Only the interview stage is shared in this paper. A primary advantage of the semi-structured interview method is that it allows an adaptive–responsive approach to ensure the best improvisation to delve deeper into relative areas of importance based on the participants' responses [50] and it also allows for participants' verbal expressions to be captured [51].

*Sustainability* **2019**, *11*, x FOR PEER REVIEW 7 of 30

**Figure 3.** The research design of mixed-method sequential explanatory design, adapted from Creswell [47]. **Figure 3.** The research design of mixed-method sequential explanatory design, adapted from Creswell [47].

### As shown in Figure 3, the development of a prototype SDG measurement model was to be based on the triangulation of learning from the literature review, the survey of 325 engineers and the *3.1. Using the Realist Evaluation Methodology to Structure the Survey*

subsequent interviews of 40 senior executives. Only the interview stage is shared in this paper. A primary advantage of the semi-structured interview method is that it allows an adaptive–responsive approach to ensure the best improvisation to delve deeper into relative areas of importance based on the participants' responses [50] and it also allows for participants' verbal expressions to be captured [51]. *3.1. Using the Realist Evaluation Methodology to Structure the Survey*  The study adopted the critical realism perspective of ideological philosophers, such as Bhaskar [52], to inform the choice of the realist evaluation approach primarily because of its practical utility and widespread use in social science research [53]. Taking Bhaskar's view [52], critical realism assumes that certain events exist and people then apply different perspectives and meaning to their interpretation of the truth.

### The study adopted the critical realism perspective of ideological philosophers, such as Bhaskar *3.2. Interview Question Design*

*3.3. Derivation of the Questions* 

opportunities [12].

which 40 agreed to be interviewed.

*3.4. Access* 

*3.5. Sample Size* 

and widespread use in social science research [53]. Taking Bhaskar's view [52], critical realism assumes that certain events exist and people then apply different perspectives and meaning to their interpretation of the truth. *3.2. Interview Question Design*  The semi-structured interviews were designed to measure attitudes in relation to the research question and its subsidiary three sub-questions (shown in Figure 4). The sub-questions focused on The semi-structured interviews were designed to measure attitudes in relation to the research question and its subsidiary three sub-questions (shown in Figure 4). The sub-questions focused on three areas: the perceived value and importance of measuring SDGs (i.e., the outcomes), their current approach and capability (i.e., the mechanism) and their identification of the challenges and opportunities (i.e., the context), such as skills, tools, processes, structures and methods [54]. NVivo© was chosen as the web-enabled data collection tool. *Sustainability* **2019**, *11*, x FOR PEER REVIEW 8 of 30

[52], to inform the choice of the realist evaluation approach primarily because of its practical utility

**Figure 4.** The nodal evaluation framework for the sequential explanatory design from which the semistructured interview questions were derived. **Figure 4.** The nodal evaluation framework for the sequential explanatory design from which the semi-structured interview questions were derived.

which highlighted a knowledge gap. The importance of understanding why the gap existed and how to close the gap had also been identified by a previous survey of 325 engineers [14], in which 88% of responses affirmed that stakeholders wanted to increase their ability to measure SDGs on projects. This was strengthened by a response rate of only 34% stating that they had a "fit-for-purpose" mechanism to measure the SDG impacts [14]. The sub-questions 1–3 shown in Figure 4 were derived from the adoption of the realist evaluation's context–mechanism–outcome (C–M–O) configuration [55,56], which is widely used across clinical research (Pawson et al. 2005) and increasingly also across the social sciences [53]. Pawson and Tilley specifically recommend the C–M–O strategy so that "programme theories can be tested for the purposes of refining them" [55,57]. In this regard, the investigation is not about what works but asks instead "what works for whom in what circumstances and in what respects, how?" [55,57]. The third level of questions for the interviews (shown in the right column of Figure 4) combines the Pawson and Tilley C–M–O framework [55,57] with the survey results [14]. For example, the four contextual questions that were derived from the SWOT analysis were all topical responses from the surveys that engineers had identified as either "blockers" or

The interviews aimed to gain access to 40 CEOs or heads of sustainability. Given the GDPR issues around accessing the names of the senior executives of global companies, the research partnered with the Institution of Civil Engineers (ICE). The ICE vetted the research scope and agreed to provide the personal data on the basis of the work aligning with GDPR legalities. The lead researcher contacted a total of 85 organisations at the level of CEO and heads of sustainability, of

Sampling was achieved purposefully by partnering with UK's leading construction standards body, the Institution of Civil Engineers (ICE), to identify and select leaders in construction companies
