Next Article in Journal
An Innovative Control Framework for District Heating Systems: Conceptualisation and Preliminary Results
Next Article in Special Issue
Enough Metals? Resource Constraints to Supply a Fully Renewable Energy System
Previous Article in Journal
Exploring the Policy Implications of the Surface Mining Control and Reclamation Act
Previous Article in Special Issue
Decreasing Metal Ore Grades—Is the Fear of Resource Depletion Justified?
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Jumping the Chain: How Downstream Manufacturers Engage with Deep Suppliers of Conflict Minerals

School of Environment, Enterprise and Development (SEED), University of Waterloo, Waterloo, ON N2L 3G1, Canada
*
Author to whom correspondence should be addressed.
Resources 2019, 8(1), 26; https://doi.org/10.3390/resources8010026
Submission received: 14 December 2018 / Revised: 18 January 2019 / Accepted: 22 January 2019 / Published: 26 January 2019

Abstract

:
Global manufacturing firms are engaging distant suppliers of critical raw materials to participate in responsible sourcing. Downstream firms are concerned about risks in mineral supply chains of violent conflict, human rights violations, and poor governance, but they are limited in seeing their suppliers. Descriptive data on 323 smelters and refiners of tantalum, tin, tungsten, and gold (the “conflict minerals”) were complemented by interviews with downstream firms in the electronics industry. Results provided a narrative of supplier engagement, describing tactics used to identify “deep suppliers” at chokepoints in metals supply and to persuade producers into joining due diligence programs. Top-tier firms collaborate through a standards program to overcame barriers of geography and cultural distance in supply chain management beyond the visible horizon. Curiously, manufacturers do not need line-of-sight transparency to lower-tier suppliers. Rather, top-tier firms are “jumping the chain” to engage directly with “deep suppliers” who may—or may not—be their own actual physical suppliers. The research contributes empirical evidence to understanding multi-tier supply chains, examines how power is exercised by top-tier firms managing suppliers, and provides insights on supply chain transparency. Responsible sourcing, based on due diligence guidance and standards, is becoming expected of companies that are involved in supply chains of raw materials.

1. Introduction

Transparency has become a modern expectation of business [1,2]. Big businesses consult with local communities and engage with international non-governmental organizations; firms report on sustainability efforts to investors, to the public, and to other stakeholders. Yet, firms struggle to see past their immediate suppliers, to understand the sources of raw materials, and to know what risks are present multiple tiers into the supply chain [3,4]. Some sectors, like food and pharmaceutical, are more advanced—driven by regulations and imperatives of quality, health, and safety—but in manufacturing sectors, like electronics, automotive, toys, and aerospace, such efforts are just beginning [5,6]. Thousands of suppliers feed raw materials and components into global manufacturing networks to make each product [4]—and modern devices and equipment require a diverse array of rare materials [7]. As such, manufacturers have typically managed only to the “visible horizon”, that is they can “see” only a couple tiers into their supply chains [8]. Limited transparency also poses risks of supply disruption, both physical disruption and reputational disruption. Without knowing one’s suppliers, there is concern that things will be out of compliance to regulations or fail in quality. More broadly, it limits sustainable supply chain management and the mitigation of environmental impacts and social problems that may be present in distant global supply chains. Recent actions specifically to address “conflict minerals” requirements have begun to reduce this opaqueness in the case of four metals, and have opened opportunities for manufacturers to increase transparency and encourage improvements in social conditions in mining regions by performing “due diligence” [6,9].
This research looks at “responsible sourcing” of minerals and metals: how multinational manufacturing firms manage supply chains to improve supply chain transparency and reduce negative impacts at lower-tier suppliers and in supply chains. Downstream companies are driven by regulation in the United States (U.S.) (and forthcoming in Europe) and by corporate social responsibility (see, for example [10]), supported by evolving market expectations (see, for example [11]). Specifically, this project draws on data from both producer and end-user companies of tantalum, tin, tungsten, and gold (3TG) (Figure 1), which are defined by U.S. regulation as “conflict minerals”. Previous research has examined assurance programs and reporting efforts by downstream firms to manage upstream 3TG metal smelters and refiners [5,12,13], and has described characteristics of supplier firms [14].
Given the expectations of transparency; given the visible horizon problem in multi-tier supply chains; and, given the importance of critical raw minerals, including several of the conflict minerals, this paper seeks to answer the question: How do global manufacturing firms engage with suppliers in mineral supply chains to enable responsible sourcing? We empirically investigate how top-tier firms have exercised power in multi-tier supply chains to implement sustainable supply chain management and how lower-tier suppliers of minerals and metals have responded to the pressures of sustainable practices.
Raw material supply chains are a relatively new topic for research. Minerals and metals have not been studied to the degree that forestry, food, fisheries, and agriculture have [15,16]. However, responsible sourcing of abiotic resources is emerging rapidly [5,17,18], and this paper makes an empirical contribution in this area. Practically, the analysis presented herein provides insight that may support supply chain management solutions for a larger set of important materials: two of the four conflict minerals (tantalum and tungsten) are commonly characterized as critical raw materials [7,19] that present supply-risk yet are paramount in technologies for a low-carbon economy. Most raw material criticality assessments use data at the national scale [19,20], and few researchers have paid attention to managing real supply chains at the firm-level [20,21,22,23], where material choices are made. Looking at how businesses and governments addressed the conflict mineral problem, and develop responsible sourcing, can guide high-level policy and private-sector governance of minerals and raw materials [19,24,25]. Whereas, technical avenues to the critical materials problem, like geological exploration, efficient mining and metallurgy, and materials substitution, are widely touted [7,19], management strategies for mineral governance, like responsible sourcing, are also needed. By better understanding their suppliers, manufacturing firms can “identify and manage critical suppliers” [8] and improve their ability to mitigate sources of supply disruption while maintaining ethical and sustainable sources of raw materials [24].
In this study, data on real firms were used to explore both ends of the mineral supply chain. Upstream, the analysis was on a population of 323 “deep suppliers”—our term for distant lower-tier producers who are positioned at a focal point to mitigate supply chain problems. Here, these firms were smelters and refiners: producers who purchase ore and mineral concentrates from mines and traders, and process these into refined metals and metal chemicals. Downstream, interviews were carried out with six conflict mineral managers in multinational manufacturing firms who are end-users of tantalum, tin, tungsten, and gold. The results showed both expected and novel tactics used by top-tier firms to reach deep suppliers and manage risks in mineral supply. Manufacturers work collaboratively through industry associations to identify, validate, and engage lower-tier suppliers. This includes emails and letter-writing, but also more extreme tactics, such as direct site visits by multi-national firms to small producers in remote regions. Downstream firms also provide financial incentives to deep suppliers to motivate their implementation of due diligence management systems. Surprisingly, it was revealed that manufacturers do not need line-of-sight visibility to lower-tier suppliers in order to manage their practices; rather, top-tier firms are “jumping the chain” to engage directly with deep suppliers who may—or may not—be their own actual physical suppliers.
In the next section, this paper reviews scholarship and practices in mineral supply chains. The Methods section describes the mixed-methods approach and data set, followed by Results, which consider the 3TG supply chains collectively and separately. The Discussion section redresses the research question, considers theoretical contributions, and then discusses practical implications for responsible sourcing of raw materials more generally.

2. Literature Review

This study draws on several fields of research: business scholarship, specifically firm-level operations research in sustainable supply chain management; political science and policy studies, where there is growing interest in private and public sector governance of minerals and metals; sustainability standards, including assurance and certification approaches; and, sustainability science and industrial ecology, specifically on critical raw materials and how firms assess and manage critical raw materials. Together, these perspectives frame how the conflict minerals problem has been managed and the development of due diligence approaches in mineral supply chains.

2.1. Sustainable Supply Chain Management

Building from Hart’s classic natural-resource-based view of the firm [1], and recognizing that sustainability actions need to match a company’s strategic and financial objectives [2], sustainable supply chain management research has emerged since the early 2000’s based on supply chain theory and methods [2,8,26,27]. Most work emphasizes environmental strategies for green products or environmental management of risks of suppliers [27], often overlooking social aspects in supply chains [27,28]. The concept of the “focal company” refers to the top-tier firm in a supply chain who controls design, directs production, and often faces customers directly [27]. Focal firms are frequently brand-name manufacturers with high visibility and reputational status. They thus experience a higher level of scrutiny by stakeholders [1] and they are held to a higher level of responsibility for environmental and social problems [27]. To meet transparency expectations, top-tier firms report on their own sustainability practices, but also look to their suppliers to contribute. Big companies engage and work with suppliers to coordinate supply chains both vertically (“up” and “down” chains) and horizontally across supply networks [2]. General strategies for sustainable supply chain management are assessment and collaboration [29], and more specifically may include communication, education and development, and compliance approaches [28].
In the modern global economy, long complex dynamic supply chains present a “visible horizon” problem [8] for sustainable supply chain management. Large manufacturers may have 1000 first-tier suppliers, 8000 second-tier suppliers, and 30,000 third-tier suppliers [4]. Of interest here are lower-tier suppliers, also referred to as sub-suppliers [30] or extreme upstream suppliers [31], which a top-tier firm is unable to “see” or engage directly. Identifying and engaging lower-tier suppliers is a key difficulty for sustainable supply chain management [30]. Manufacturers are often unaware of who their suppliers are and what are the sources of raw materials used in their own products [32]. Moreover, their power over suppliers diminishes as the distance upstream into the supply chain increases [3]; a manufacturer typically will have direct contractual control only of tier 1 suppliers although may have some influence on suppliers at tier 2. For mineral supply chains, the concern is particularly acute, because some of the greatest negative social and environmental impacts are at or around mines [3], which may be 8 or 10 tiers removed from the end-product [13,33,34] (see Figure 1).
Although there is scant research on managing lower-tier suppliers [30], literature suggests direct and indirect means which top-tier firms can apply [3,29] and research shows that working with strategic partners, like standards programs or third parties, is useful [3,30,31]. Sauer and Seuring proposed a “cascaded approach” to multi-tier sustainable supply chain management specific to mineral supply chains [35]. In the current work, we add to this discussion, based on our empirical examination of supply chains of the four 3TG metal industries. Research looking at the structure and shape of multi-tier supply chains suggests that beyond the visible horizon there will be a tendency for overlap in multi-tier supply chains, creating “diamond-shaped” supply chains that present a sensitivity to disruption risk [36]. In mineral commodity supply chains, such overlapping supply chains are significant: even though a manufacturer may have thousands of fabrication and assembly suppliers at the third-tier [4], there are limited numbers of commodity processors (e.g., makers of metal alloys and chemicals) and raw materials producers (e.g., producers of basic chemicals and refined metals). Consequently, there are chokepoints [5], where material is moving through a limited number of specialized facilities. In some cases, particularly for critical raw materials, there will be fewer than 50 facilities that process the entire global supply of one metal [33]. Sauer and Seuring have considered how in mineral supply chains these companies can act as “upstream focal firms” [37] that have the ability to oversee upstream mineral extraction and processing. Our research looks at chokepoints in 3TG supply chains, and responds to scholars who have considered theoretical factors in multi-tier sustainable supply chain management [3,8,35]. Chokepoints present a constriction in complex global supply chains where there are few actors and fewer sites, thus providing strategic opportunities for efficient engagement, education, development, and standardization.

2.2. Governance of Mineral and Metal Supplies

Governance of minerals and raw materials has emerged as an important concern [24] for both public and private sectors. Society is increasingly relying on greater diversity and varieties of materials to satisfy modern wellbeing, while also transitioning to a low carbon economy [7,19,38]. Europe, the United States, Japan, Korea, and other nations have identified “critical raw materials” that are economically crucial yet that also face supply risks. National agencies have assessed raw material criticality [19,20], and support research on technical solutions, including geological exploration, efficient mining and metallurgy, and materials substitution [7,19]. New trade relationships and strategic material stockpiling are other national strategies that support military needs and important industries.
Traceability of minerals is generally low when compared to biotic commodities. Traceability of food, for example, is necessary if there is a product recall [39]. Or consider wine, which from taste alone can be traced to a location or producer, or bananas that remain intact from farm to table and can be clearly marked. Chemical tests performed at the molecular level are effective at tracing food, fibre, and wood. Even minerals, “geochemical fingerprinting” of structure and trace elements can be used [40]—but only to the smelter where minerals are converted into metal form. Once in metal form, chemical traceability is not feasible.

2.3. Critical Raw Materials Management

Minerals and metals present particular challenges for firms seeking transparency in their supply chains. Tracking and tracing of minerals sources are difficult for business reasons, like the number of actors in supply chains, the complexity of international commerce, including trade of intermediate materials, and business confidentiality; and, for physical reasons, like mixing of mineral ores, mixing of primary materials with recycled sources, chemical transformation of minerals to metals, and physical conversions of form like melting [5,13,33,34]. Given concerns about critical raw materials, and acknowledging it is at the firm-level that material engineering and design decisions are made, firm-level approaches to dealing with critical raw materials are less well studied, including few case studies [23,41], methodological suggestions [20,21], and business strategies [22].
Sustainability standards and certifications are a growing approach used by business to govern supply chains. Suppliers are expected to implement standards of sustainability performance and management systems that have been written by downstream buyers. Conformance of suppliers is assured via third party auditing, and it is often presented as supplier certification. Some sectors, like forestry, food, and pharmaceutical are relatively advanced in this mechanism [16], where health, safety, and quality requirements necessitate vertical coordination along supply chains. In sectors like electronics, automotive, toys, and aerospace, supply chain sustainability standards and programs are just beginning and are relatively understudied, with few exceptions [42]. Certification approaches that are relevant to mineral extraction and metal supply chains are have been reviewed [5,18,25,33]. Efforts on diamond certification involve national authority [42], whereas business-led initiatives are newer. Some industry-specific studies have been done for other minerals and metals, including mention of steel [43], aluminum [5,18], and gems [44], but the most research has been on conflict minerals (see for example [5,13,33]).

2.4. Conflict Minerals

The core problem of conflict minerals is that extraction activities in the eastern Democratic Republic of the Congo (DRC) are financing conflict and associated with forced labor and human rights violations [5,6,13,45,46]. Section 1502 of the United States Dodd-Frank Wall Street Reform and Consumer Protection Act (Dodd-Frank Act) defined tantalum, tin, tungsten, and gold as “conflict minerals” in 2010. Starting in 2014, U.S. publicly traded companies were regulated to report to the U.S. Securities and Exchange Commission (SEC) regarding the use of conflict minerals in their products [47]. It is important to clarify that the U.S. regulation concerns only reporting of 3TG sources and due diligence measures: it does not restrict imports or control the use of raw materials. Of course, by reporting publically on sources, U.S. firms are motivated to develop more responsible supply chains. In 2021 the European Union Conflict Minerals Regulation takes effect and also has firm-level reporting requirements [48]. Although not a regulation, there is a parallel guideline published by the China Chamber of Commerce of Metals, Minerals, and Chemicals Importers & Exporters (CCCMC), regarding metal trade for Chinese firms. Importantly, these government efforts mean that all sources and all supply chains of each the four metals are subject to scrutiny, requiring downstream firms to be transparent about the origins of tantalum, tin, tungsten, and gold used in their products. This motivates firms to look far beyond manufacturing activities in the United States or Europe, and beyond a focus on mining in Central Africa.

2.5. Due Diligence

The United States and EU rules, and the Chinese guideline, refer to the Organisation for Economic Cooperation and Development OECD Due Diligence Guidance for Responsible Supply Chains of Minerals from Conflict-Affected and High-Risk Areas (OECD guidance) [9], which outlines policies, due diligence frameworks, and management systems for mineral supply chain actors. Under the OECD guidance, companies that are involved in mineral supply chains are asked to consider a wide range of concerns that are associated with all stages of mineral resource extraction, metal processing and manufacturing. All actors in mineral supply chains, from miners to end-users, are encouraged to implement the five-steps of due diligence described in the OECD guidance:
  • STEP 1: Establish strong company management systems
  • STEP 2: Identify and assess risks in the supply chain
  • STEP 3: Design and implement a strategy to respond to identified risks
  • STEP 4: Carry out independent third-party audit of refiner’s due diligence practices
  • STEP 5: Report annually on supply chain due diligence
The OECD five-step process compares to the definition for due diligence that is provided by Hofmann, Schleper, and Blome, as an approach of “gathering of internal and external information and gaining a sound knowledge of the company, its industry, financial condition, customers, competitors, suppliers, business processes, technology and, above all, management; [and] sharing relevant upstream information with downstream partners” [6].
The OECD guidance uses the term “conflict-affected and high-risk areas” (CAHRA) to refer to regions where there is probability of serious physical harm to people, including violent conflict, sexual violence, and non-state armed groups, but also includes concerns, such as forced labor, child labor, torture, and financial crimes such as money laundering. CAHRA are assessed at national and sometimes subnational levels using various indicators of conflict, poor governance, and human rights violations. The OECD guidance acknowledges the importance of the chokepoint at smelters and refiners, which OECD refers to as the “control point” in mineral supply chains. The due diligence approach encourages firms to monitor material flows [45], and collaborate to provide supply chain transparency [6]. The OECD guidance has led to numerous business-led programs and standards that support due diligence and responsible sourcing in mineral supply chains.

3. Data and Methods

A parallel convergent mixed method was used, where both descriptive variables and qualitative interview data were analyzed separately, and then integrated. Descriptive data were provided by the Responsible Minerals Initiative, a global industry association based in the U.S. that runs a due diligence program on mineral supply chains. The program provided details on the 323 known smelters and refiners of tantalum, tin, tungsten, and gold (Table 1). Data on upstream suppliers were complemented by interviews with downstream manufacturing firms. Semi-structured interviews were completed with six current and former members of the program’s smelter engagement team. Together, these approaches allowed us to produce a narrative of engagement, including nuances for each of the four 3TG metal industries, detailing external forces and tactics used by the initiative, and describing how downstream manufacturing firms identified and communicated with upstream metal producers.
The domain of conflict minerals provides a valuable and a rich source of data for applied research on responsible sourcing. Activity in due diligence is particularly advanced in 3TG supply chains, as compared to other metals and to other commodities. Data are available as far back as 2008 on supply chains, standards, and downstream firms concerned about conflict minerals.
The three main due diligence programs, which cross-recognize each other’s listings, operate for the benefit of downstream metal users: (1) the Responsible Minerals Initiative, which is described below; (2) the Responsible Jewellery Council, which has more than on thousand member companies from miners to manufacturers to retailers; and, (3) the London Bullion Market Association, whose members includes over one-hundred miners, refiners and other actors in the global market for precious metals. Smaller regional programs on conflict-free gold are operated at the Dubai Multi Commodities Center and the Shanghai Gold Exchange.
The 323 suppliers that are considered in the current study constitute the population of 3TG smelters and refiners (as of late 2017) known to the three main due diligence programs. Notably, the significant majority of suppliers are conformant to due diligence standards (Figure 2). For tantalum, tin, and tungsten, more than 80% of suppliers are participating in due diligence programs. For gold the number is lower, with about 75% conformant. For gold, it should be noted that this value is the fraction of known of industrial gold refiners (i.e., those producing greater than about 1 tonne per year); however, many hundreds of small and very small (e.g., less than one kilogram per year) refineries are known, but are assumed not to supply industrial manufacturing networks. Note also, for all four metal industries, there is an observable variation in the population, as firms go out of business or new firms emerge. There is also the possibility that the programs have not identified and confirmed all operating facilities, most notably black-market operators.
The Conflict-Free Sourcing Initiative was founded in 2008 by members of two industry associations, the Electronic Industry Citizenship Coalition and the Global e-Sustainability Initiative, largely involving multinational brand name electronics firms [49]. The roots of the effort go back to 2007 when a working group was struck to respond to claims made by civil society groups [50]. By 2017, when the name was changed to the Responsible Minerals Initiative, the business initiative had over 350 members from companies and associations from ten industries (including electronics, automotive, retail, aerospace, apparel, telecommunications, and jewellery). The initiative aims to support company raw material sourcing decisions including regulatory compliance and responsible sourcing from conflict-affected and high-risk areas. The manufacturers and brand-name firms at the downstream end of the metals supply chain paying for membership in the initiative, and they are supported with tools to achieve and information to report on responsible sourcing. This relies on companies at the upstream end of the supply chain: metal smelters and refiners who are encouraged to “participate” in the Responsible Minerals Assurance Process (formally the Conflict-Free Sourcing Program) by implementing due diligence management systems based on the OECD guidance [9]. The program developed due diligence standards for each the four metal industries. Participating companies pay the costs of implementing their own due diligence systems and usually pay for assurance audits. The Responsible Minerals Initiative provides training materials and guidance, manages third-party stakeholders, and maintains a list on their website of smelters and refiners who are conformant to each due diligence standard [49].
Central to the current study was the Responsible Minerals Initiative smelter engagement team, composed of individuals from about fifty member firms who performed outreach to metal smelter and refinery companies. The team was created in 2013 but its efforts became more earnest in 2014 and 2015 after the U.S. Dodd–Frank Act rule reporting requirements came into effect.

3.1. Descriptive Data on Smelters and Refiners

The first stage of the research design involved investigating the pattern of smelter and refiner participation into the program. The master smelter database, provided by the Responsible Minerals Initiative, describes approximately 3000 entities, names, and brands that are associated with 3TG suppliers. Over the years, the Responsible Minerals Initiative determined more than 2000 of these names not to be actual smelters or refiners. As of late 2017, about 400 names remained under investigation but they were of low likelihood to be eligible smelters or refiners. The remaining 323 facilities constituted the population of known and confirmed smelters and refiners and, of these, 87% participated in a due diligence program and, as of late 2017, 78% had achieved conformance (see Table 1).
Information was consolidated and formatted into timelines for each of the four metal industries. Documents from the program included training materials, the smelter database, templates used for emails and letters, program performance metrics, and summary reports. (In a parallel study, our research group assessed business characteristics for 212 of these facilities, including firm size, location, and management system experience [14].) Key information on the 323 facilities included dates that smelters and refiners started participating in the program and outreach efforts that were made by member firms on behalf of the program to engage with suppliers and encourage them to participate in the program. Central to the analysis was the status of each facility: the date of commitment to participate, audit date, and date of conformance. Timelines were annotated with dates of external events (like regulation) and activities internal to the initiative (like creation of the smelter engagement team). The four timeline figures were used as a reference to support interviews with conflict mineral managers in downstream manufacturing firms.

3.2. Interviews with Downstream Firms

Semi-structured interviews with conflict mineral managers in downstream firms sought to expose how manufacturers engaged with, and persuaded upstream metal companies to participate in, due diligence programs. Interviewees were recruited through a combination of convenience sampling and purposive sampling. Based on the recommendation of the Responsible Minerals Initiative manager, twelve candidates were invited to participate in the study, with six interviews accepting and interviewed between January and March 2018. Interviewees were current or previous members of the supplier engagement team and experts in conflict minerals. These individuals typically had 10–15 years’ work experience in supply-chain or corporate social responsibility functions in multinational electronics firms. Interviewees were drawn from a cross-section of Responsible Minerals Initiative member companies, and they had experience working in different regions and different 3TG industries.
The theoretical basis used in designing the interviews was from Sauer and Seuring, who provide a framework for supply chain management of mineral supply chains [37], which was selected given its roots in sustainable supply chain management scholarship [26]. Their categories include government interventions, strategic orientation, supply chain continuity, collaboration, risk management, and proactive management. The timelines from the descriptive data analysis were provided to interviewees ahead of time as a starting basis for interview discussions. Interview questions helped to contextualize the timeline analysis, and they were designed to expose nuances and challenges of lower-tier supplier engagement (Appendix A). Interviews were 30–60 minutes over the telephone, which were then transcribed and imported into QSR NVivo, a data analysis software. Following Miles and Huberman [51], first-order concepts were identified using open coding, which were then grouped into second-order themes through axial coding. We then discussed emergent concepts and the connections between them in relation to the extant literature, specifically Sauer and Seuring’s framework, with new concepts being created where necessary.
A number of measures were taken to address concerns regarding the validity and reliability of data and results. Construct validity was enforced by using a preexisting research framework. Our dyadic approach linked data on upstream sellers of raw materials to independent data collected from downstream buyers in the supply chain. Internal validity was supported by selecting key informants with first-hand knowledge of the engagement processes. External validity was enforced given inclusion of the whole population of suppliers across the four parallel case industries. Reliability was assured given the sequential roles of the researchers in undertaking the research, as well as extensive discussions related to emergent concepts, which were discussed between researchers until consensus was reached. Furthermore, the use of a mixed method design allowed for the comparison of qualitative and quantitative data [52] from both the interviews and the timeline analysis, revealed a convergence of results. Fuller information on the methods, including more data on the timelines for all four metal industries, is provided in the master’s thesis completed by one of the authors [53].

4. Results

The industry timelines (Figure 3, Figure 4, Figure 5 and Figure 6) provide graphical summaries of supplier engagement for the four metal industries, showing patterns initial participation, growth in participation, and abatement of new participation. In the case of tantalum, the program achieved 100% smelter participation (allowing for some ebb and flow as companies do change management or ownership). For tin and tungsten industries, the total participation exceeded 80% by 2016 and continued to climb gradually; whereas, for gold the total participation seemed to have plateaued around 70% in 2015 (see Figure 2). Based on these results and supplemented with information from the interviews (identified as P1–P6), a narrative was formed on smelter and refinery participation in due diligence programs.
About 2007, manufacturers realized they would need to understand sources of 3TG raw materials in their supply chains. Some of the larger electronics firms began sending enquiries to their suppliers, in hopes that their requests would penetrate through multiple tiers. Several issues became apparent:
  • tracing specific chains of metals all the way back to mines was largely infeasible (as discussed above, for physical and business reasons, see for example [34]);
  • identification of mineral processors was confusing because there was blurring of roles and names of mines, smelters, refiners, alloy makers, metal casters, fabricators, traders, and brands; and,
  • end-product manufacturers in electronics share from many of the same 3TG metal suppliers.
Based on this, it was logical that downstream firms collaborate to better understand their lower-tier suppliers and to manage responsible sourcing. The Responsible Minerals Initiative was created and supplier engagement began. Early consultant analysis [34,54] suggested that refiners and “smelters were the pinch point in the supply chain” [P4]. They purchase mineral concentrates from mines or through traders, convert them to refined metals and metal chemicals, which then are sold to downstream manufacturers of parts and components. Smelters and refiners also purchase post-industrial and post-consumer sources that are recycled in the same facilities as process primary feedstocks. Smelters and refiners thus constitute a finite group of identifiable facilities (see Table 1), mostly large-scale capital intensive metallurgical operations. “The smelters, the refiners, that we work with are pretty [deep in] our supply chain, so they are not our immediate next supplier, they are maybe 8 or 9 down the supply chain“ [P3].
Engagement of smelters and refiners was part of a three-stage process: (1) identification of potential facilities, (2) validation of alleged facilities to determine the legitimacy of smelters or refiners at the chokepoint, and (3) outreach to encourage facility participation in the due diligence program.
1. Identification
To identify metal smelters and refineries, the Responsible Minerals Initiative developed a standardized supplier survey for members in 2011. The survey provided common definitions, standard smelter and refinery names, and fields to characterize suppliers (location, capacity, ownership, etc.). This process also relieved survey fatigue experienced by suppliers. With the creation of the smelter engagement team in 2013, the program “started to be more tactical and strategic about engagement” [P4]. Supplier identification efforts were coordinated: downstream firms shared and aggregated survey results, then met to coordinate the identification of potential smelters and refiners. However, because surveys needed to be relayed from individual member firms back up the chain to identify metal processors, and then returned downstream via the same chain, interviewees noted that there were poor return rates (in the order of 1%). It was “tricky because we are so far removed from the smelter itself and even our direct suppliers are removed from the smelter itself so that can be challenging twisting through the supply chain” [P6]. Curiously, this approach meant that manufacturers identified their 3TG suppliers without actually knowing how their supply chains were connected. Supplier surveys were anonymized at each tier of the supply chain to preserve business confidentiality between competitive suppliers and prevent line-of-sight visibility to smelters and refiners. Survey results were additionally anonymized by the program, who managed the consolidated database.
2. Validation
Validation was necessary after suppliers were identified. Numerous product brand names, marketing and distribution companies, differences in ownership and location, and confusion about what actually constitutes a metallurgical processor complicated the process of identification and qualification. The smelter engagement team clarify which smelters and refineries were targeted (e.g., a facility needed to have the technical ability to process primary mineral concentrates) and performed additional enquiries through industry associations to confirm processors. Nonetheless, with enquiries aggregated among downstream firms and repeated annually, the efforts began to “build supply chain visibility” [P6]. Over the years, the collaborative effort developed a reliable database of qualified smelters and refiners for each of the four metals, which is updated regularly and provided to Responsible Minerals Initiative members.
3. Outreach
Priority for outreach was to facilities that were identified most frequently in member supplier surveys. “Smelters… that weren’t participating, would get letters, and lots of letters, and finally if you start to get enough letters from all these big brand name companies, I think that helped drive some of the participation. And so if you look at both tungsten and tin, you see that bump in 2013 about the time SET got started” [P3]. “After we conduct the survey we find smelter contact information and directly go talk to them, and…engage with the smelters. So we either try to email them, try to call them, and then meet them in person. We find that’s the most effective way to get them engaged and this can be done by going directly to the smelter facilities” [P6].
Efforts were coordinated to encourage constructive communication and to avoid overloading prospective participants. Depending on the type of company and the region involved, a plan for each supplier was developed. This included coordinated emails, letter writing, and social media, each urging the smelter to participate in the program. Messages could be escalated depending on the responses or commitments received (or not received) from the supplier. Importantly, a single-point-of-contact person was designated for each facility, to mitigate overloading a particular supplier with requests or mixed messages, and to provide a friendly liaison who could encourage program participation. “[W]e found that sometimes when too many companies are trying to reach the smelter or communicating with the smelter it can cause confusion and they eventually stop responding … it was probably better to assign one member company person to engage with the smelter” [P6].
Escalating their efforts of coordinated persuasion, manufacturers began to visit suppliers in-person at smelter facilities around the world. Depending on the culture and language and the nature of firms involved, the team would work with translators and a member of the engagement team might do a site visit. Other tactics included attending metal industry conferences and working with industry associations. This action conveyed the gravity and urgency of the conflict mineral problem, and was very effective: “So in terms of how smelters become active I think the most important thing is being very engaged and having not only your company brand but establish, but trying to establish a face-to-face relationship with the smelters” [P6]. “Thus downstream firms overcame barriers of distance, “breaching language, breaching communication or going to those places physically” [P6].
Somewhat surprisingly, top-tier manufacturers were visiting upstream companies who were not their own suppliers. For example, one target group was tin smelters in Indonesia, many of which are small in size. At the extreme, this meant a representative from a U.S. multinational electronics corporation travelled to the island of Belitung, Indonesia to knock on the door of a family-owned, 20-employee tin smelter. Another effort focused on tungsten facilities in China, many of which are located in Ganzhou, China. Gold refiners in Korea were another target group, which include numerous small operations doing recycling from manufacturing industries in that country.
According to a survey by the Responsible Minerals Initiative covering about one-third of the audits done from 2015–2018, metal suppliers expressed that they participated in the program because of their own company policy (85%), because of customer requests (80%) and because of requests from end-use manufacturers (50%). The last point aligns well with data in the timelines (see Figure 3, Figure 4, Figure 5 and Figure 6) showing that new participation of suppliers grew by 35%, 85%, 90%, and 80%, respectively for tantalum, tin, tungsten, and gold, following the creation of the supplier engagement team in 2013.
The program offered supplier development resources and also provided financial assistance to suppliers. Education and training were delivered in at least eight different languages, including online, seminars at conferences, and workshops for targeted groups, like tin producers in southern China. A fund was created, financed by individual member firms, and used to offset the costs of a supplier’s first audit, significantly reduced the financial barrier to smaller facilities to participate in the due diligence program. More than half of the conformant facilities benefited from the fund, which distributed approximately $2 million up to 2018: “you combine that with the face-to-face interaction and the hand holding of getting them ready for the audit then they’re more likely to be successful” [P6]. Interviewees and program managers expressed general satisfaction in the performance of the program in reaching suppliers over ten years of operation.

4.1. Tantalum

Smelters and refiners in the tantalum industry were quick adopters of due diligence systems for responsible sourcing (Figure 3), as the majority of producers achieved conformance to the program in the first two years. Several factors were involved: electronic capacitors account for a high proportion of tantalum use, the DRC is a major region of metal supply, capacitor firms are closely aligned with the electronics industry, many midstream and downstream firms are U.S.-based and were therefore immediately subject to the Dodd–Frank Act rule, most electronics corporations already had strong corporate social responsibility commitments, and the upstream tantalum industry association rallied successfully around the issue.
As apparent in Figure 3, the supplier engagement team did not contribute significantly to engagement in the tantalum industry. Unlike the other three metal industries, “the electronics industry had the leverage and the purchasing power to influence [and]… apply the pressure that we could” [P4]. After a couple of the leading capacitor manufacturers joined the program, and with the support of brand-name computer firms that faced reputational risks there was rapid acceptance in the industry for responsible sourcing standards written by the downstream initiative. “The tantalum industry was very a vicious industry without much collaboration. But when this came out, and this is where we saw a lot of collaboration occurring” [P4].
Of interest for tantalum, one interviewee referred to more advanced responsible sourcing efforts that were built off the collaborative responsible sourcing initiative. A “closed-pipe” system was described that directly connects a specific mine in DRC, where conflict was not a problem, to a conformant smelter, for example in China, to a capacitor manufacturer in the U.S., to a top-tier manufacturer of electronics. Thus material was securely and assuredly moved from extraction to end-product.

4.2. Tin

The tin industry, conversely, was not motivated by the Dodd–Frank Act (Figure 4) and the role of the engagement team was significant. Indifference to the U.S. conflict minerals rule was understandable, given that the vast majority of tin processors are outside the U.S. (e.g., Indonesia, China, Peru, Bolivia) and the bulk of tin ore is sourced regionally, far away from the problems of Central Africa. Although several large producers did participate early, there was “slowness given the number of tin smelters that exist … [and] a lot of pushback from Indonesian tin smelters [and] a lot of pushback from [industry associations]” [P4].
The smelter engagement team played an important role in engagement tin smelters and refiners in due diligence programs. “What happened was these smelters started receiving letters…asking them what they know about responsible sourcing, have they done anything in the past” [P3]. However, it took more significant efforts to achieve commitments from tin industry actors. “[T]in smelters started getting active when we as member companies started visiting smelters for the program … I think the [engagement] team played a major role, face-to-face contact” [P3]. Regional outreach efforts resulted in participation by blocks of companies starting in 2012, including major refiners in Thailand, Malaysia, Peru and Bolivia. Indonesia and China were high-focus areas. “[We] recognized that its very very important, especially in Indonesia culturally to have that face to face relationship [and] stay in touch with the smelter” [P6]. Participation of small companies in Indonesia was particularly advanced in 2015 after the government-run Indonesia Commodity & Derivatives Exchange (ICDX) made compliance to the tin due diligence standard a requirement for tin export. In China, the world’s largest tin refining nation, the program engaged with larger state-owned firms and with government representatives, who provided an initial door for acceptance in that country. The program continued to work on the participation and the conformance of tin smelters and refiners in China as late as 2018.

4.3. Tungsten

Tungsten smelters and refiners took longer than the other metal industries to become active in due diligence efforts (Figure 5). Although a small number of U.S. and European tungsten producers participated early-on, there was generally low interest: “Tungsten was really late to the table and such a small amount of tungsten actually came out of the region, they just didn’t really want to engage” [P4]. Program members constituted a relatively small portion of the tungsten market. “The electronics industry just did not have a lot of leverage over tungsten” [P4]. Moreover, given that a tiny fraction of tungsten is sourced from Central Africa (less than 2%), the lack of interest by tungsten producers was understandable.
A significant breakthrough occurred in 2013. The engagement team became more active. Numerous site visits were made by program representatives to tungsten facilities, many in China. Knowledge was gained both by the downstream manufacturers and by companies in the metal industry; interviewees spoke of trust-building to address concerns with “business confidential information [and] lack of awareness” [P5]. Concurrently, a new tungsten industry association was formed to facilitate responsible sourcing (the Tungsten Industry-Conflict Minerals Council). At the end of 2013, an agreement was struck between tungsten council and the Responsible Minerals Initiative. Tungsten producers who are members of the council are provided funding by the downstream program for facility audits and they are given a three-year (instead of one-year) audit cycle, and the tungsten due diligence standard provides streamlined procedures for the tungsten industry.
Notably, after the new agreement came into effect, competitive pressures in the tungsten industry appeared to motivate other tungsten producers, even those who were not council members, to participate in the due diligence program. Given that approximately 80% of tungsten production takes place in China, interviewees observed that the program was particularly successful in gaining traction in that country—far from the U.S. Dodd–Frank Act and European pressures.

4.4. Gold

Although the gold timeline (Figure 6) looks similar to the other 3TG materials, the gold industry operates unlike other markets. As observed by one interviewee: “gold is a completely different animal” [P6]. Gold behaves more like currency than a metal. It is mined wherever possible, all around the world, and all but the smallest country has a gold refinery, often associated with the national mint. The value per mass is high, thus “it’s really hard to track and the quantities are much smaller for bigger profit” [P6]. Gold is readily recycled, resulting in significant mixing of old and new sources. Because of its value “it’s also used as currency, its used to wash money” [P4]. And, as several interviews noted, “they’re not paying the taxes on it, so miners actually get more per gram of gold through illegal channels than they do through legal channels” [P4].
With respect to encouraging participation in the Responsible Minerals Initiative due diligence program, “gold smelters and refiners were the most challenging to engage, and where [supplier engagement] tactics were the least successful” [P1]. “Gold is one of the hardest ones, because we don’t really have that much gold in the electronics industry, so it’s hard for us: we don’t really have any leverage to convince them” [P6]. For example, it was especially difficulty in convincing refiners who source gold from mines in China to “join an American program that determines whether they source from Africa” [P2].
To make gains on responsible sourcing, the Responsible Minerals Initiative relied on programs that were developed by two other industry associations, the Responsible Jewellery Council and the London Bullion Market Association. Although a significant volume of tantalum and tin go to electronics, about 90% of gold goes to non-industrial uses, such as in jewellery and bullion (including coins, gold bars, and ingots). To achieve greater reach relevant to all gold end-uses, the three associations agreed to cross-recognize their due diligence standards. The London Bullion Market Association is particularly relevant, as it includes more than one-hundred large gold refiners that, since 2014, must each maintain a responsible gold certificate that supports due diligence with respect to risks, including conflict, human rights abuses, terrorist financing practices, and money laundering [55]. This certification requirement led to a clear uptick in conformant facilities, starting in 2014 (see Figure 6). These partnerships allowed for electronics firms to overcome their inability to apply market pressure onto gold refiners.
Responsible sourcing remains an on-going challenge in the gold industry. From a transparency perspective interviewees noted that the commodity exchanges represent an important barrier. For example: “Within China, the Shanghai Gold Exchange, the gold would go in and go out, there was no tracking of who got what gold. … if you tried to chase the gold supply chain, it was always stopped at the exchange, and so you really didn’t know who your refiners were” [P4]. Non-conformant facilities are known to be all over the world (Mexico, Middle East, China, India, etc.) and they are often in regions where there is little or no market incentive to participate in due diligence programs.

5. Discussion

This study explored how global manufacturing firms engaged with suppliers in mineral supply chains to enable responsible sourcing. The research responds to Carter, Rogers, and Choi, who asked how organizations might “manage physical supply chains that reside beyond the visible horizon” [8] (p. 94). Evidence revealed how top-tier firms in electronics and other sectors overcame barriers of geographic distance, physiological distance, and cultural distance in identifying and engaging with 3TG suppliers. General strategies for sustainable supply chain management, like communication, education, and development, and compliance approaches are relevant to all suppliers [28], but for suppliers over the visible horizon [8] management needs to include engagement steps, including identification, validation, and outreach.
The concept and value of a supply chain chokepoint at smelters and refiners [13] has been confirmed. The chokepoint is where there is a concentration of firms in the upstream supply chain where sustainable management practices can influence lower-tier suppliers. This observation supports theory on diamond-shaped supply chains [36] and specifically confirms what Seuring and Sauer refer to as “upstream focal firms” [5,37], who control the integrity of mineral feedstocks entering mineral supply chains.
A novel contribution of this study is what we call the “deep supplier”. A deep supplier is defined as a lower-tier supplier—beyond the visible horizon of top-tier firms—whose position at a supply chain focal point affords them leverage over their suppliers. In the context of 3TG metals, the management and purchasing actions of deep suppliers was shown to have a significant effect on the sustainability of the mining practices and hence contribute to overall supply chain sustainability. We believe this concept could have application beyond the 3TG metals, to other industries whose structure also reveals lower-tier supply chain focal points.
Surprisingly, lack of supply chain transparency does not present an impossible barrier for multinational manufacturers to manage deep suppliers. We observed top-tier firms “jumping the chain” to engage with deep suppliers, who are beyond their visible horizon and who may—or may not—be physical suppliers to all top-tier firms. The did this collaboratively, working through the standards program, a business-led initiative. Although individual manufacturers could conceivably invest greater resources to discover more about their mineral supply chains, it was both effective and sufficient for top-tier firms working together to jump-the-chain to manage deep suppliers.

5.1. Contribution to Theory

This study contributes empirical evidence to theory on sustainable supply chain management in multi-tier supply chains. Figure 7 depicts a conceptual framework of engagement with deep suppliers. Whereas, the theoretical work of Tachizawa and Wong [3] suggests four management practices by which top-tier firms engage with lower-tier suppliers (direct, indirect, “work with third party” and “don’t bother”), we have identified a potential intermediate practice, to “work with second party”, which more accurately describes the role of companies working in business-led efforts, like the Responsible Minerals Initiative. The members of the initiative were highly active in parts of the operation of the initiative, including efforts to engage suppliers. “Work with a second party” captures the practice of jumping-the-chain, whereby a top-tier firm works with the initiative and in collaboration with competitors to achieve engagement. This differs slightly with Sauer and Seuring [35], who describe a mechanism of cascaded multi-tier sustainable supply chain management that links between downstream and upstream parts of mineral supply chains, in that, in our conception, the role of the second party is pivotal. Results are supportive of Hofmann, Schleper, and Blome, who describe due diligence in multi-tier supply chains [6].
Our results contribute empirically to the limited body of research on engaging lower-tier suppliers in sustainability management. Gong, Jia, Brown, and Koh suggest a number of supply chain learning stages [31], which were apparent in our study, including top-tier firms working in breadth with partners and working in depth to learn more about lower-tiers. By sending requests to their immediate suppliers as a means of indirect engagement, manufacturers learned the identity of deep suppliers. Thus, even with limited knowledge of lower-tiers, by partnering and collaborating focal companies were able to apply a direct approach to manage deep suppliers. Additionally, although well observed in the direct management of first-tier suppliers [29,56,57], we add to the understanding of how focal companies work directly with lower-tier suppliers and with strategic partners to establish governance mechanisms to manage distant suppliers [30,31]. Beyond standards and compliance, “contributive” strategies [57] include training, financial incentives, and other assistance intended to develop supplier risk management capacity. Interviewees identified more “pro-active” strategies [57] undertaken by manufacturers for supply chain sustainability and risk mitigation, for example “closed-pipe” material supply networks (see Figure 7) provide dedicated conflict-free sources of tantalum to end-users who are highly dependent on this critical material [5,58].
Results also confirm contingency variables that Tachizawa and Wong suggest affect supply chain relationships in multi-tier supply chains [3]: each of the four metals is “critical” to electronics and other high-tech products and manufacturing; top-tier manufacturers are “dependent” on the concentration of smelters and refiners at the chokepoint; there is significant “stakeholder pressure” and reputational risk for top-tier firms; “industry dynamism” of smelters and refiners is low, as these facilities tend to be technically complex, capital intensive, and permanent; there is a significant physiological, geographic, and cultural “distance” from mostly-Western top-tier firms to many smelters and refiners in developing countries; and, top-tier firms have limited in their familiarity and industry “knowledge” of smelting and refining at deep suppliers. To mitigate this last variable and to engage deep suppliers, the Responsible Minerals Initiative relied significantly on metal industry associations and other upstream parties for metal industry expertise.
The study indicates how top-tier firms exercise power in multi-tier supply chains and how lower-tier suppliers responded to pressures of sustainable practices. Results support prior considerations on how the power of multinational firms is focused to influence lower-tier suppliers [3,6]. The extent to which downstream buyers influence upstream producers differs according to leverage available. In the case of tantalum, given that electronics applications account for the majority of use, top-tier firms used their economic power to leverage metal producers to implement responsible sourcing. For tin and tungsten, where market leverage was lower, power was exerted more softly through non-economic persuasion of deep suppliers. Coordinated letter-writing and site visits from “big brand name companies” helped to overcome supply chain distance and improve industry knowledge. To reach and motivate gold industry actors, even more indirect efforts were needed, primarily via partnering with third parties in the gold bullion and jewellery industries that had more direct power to influence gold refiners.
There is varying understanding of supply chain transparency. Hofmann, Schleper, and Blome describe four practices that increase transparency along supply chains [6]: certification of firms, chain-of-custody along the value chain, traceability of materials, and due diligence of firms. Using their terminology, full transparency in the supply chain would include clear line-of-sight upstream, and this would require chain-of-custody traceability of raw materials backwards from end-users to source. However, in this study, top-tier firms described a more limited transparency that provides identification of deep suppliers but without line-of-sight traceability through the supply chain. To encourage due diligence management at deep suppliers, manufacturers gathered information to identify smelters and refiners, but they did not have enough knowledge on the operating structure of those supply chains to their supply chains link-by-link. Thus, in practice, firms are prioritizing due diligence over traceability. This finding is consistent with Kim and Davis who showed that very few corporations filing under the Dodd–Frank Act rule claim to know whether their products are “DRC conflict-free” [32]. Knowing one’s suppliers by name is not sufficient to know the source of materials entering one’s specific products.
Traceability appears to be more complex and costlier than due diligence alone. Materials that were produced by lower-tier suppliers can be tracked forward through multiple tiers in the supply chain to downstream manufacturers, but firms need separate instruments and more developed systems to trace materials backwards, for example, to confirm suppliers in the chain, or to know the upstream sources of food that is subject to a health recall [39]. For minerals traceability, Apple, a large electronics firm, began tracing its supply chains of tantalum, tin, tungsten, and gold in 2010. This involved looking upstream from manufacturing back to smelters. However, it was not until the end of 2016 that Apple could claim that all its known 3TG suppliers were participating due diligence programs [10]. Traceability requires significant information and more sophisticated systems. Further research is necessary to tease apart and better understanding the nuances of responsible sourcing concepts, including transparency, due diligence, tracking, traceability, and chain-of-custody.

5.2. Implications for Practice

Responsible sourcing has emerged as an expectation of producers and users of metals and minerals. Transparency can improve confidence on sources of materials, which may improve security of supply, by knowing more about both physical flows and business information on actors in global markets. Without knowing one’s suppliers, there is concern that things will be out of compliance to regulations or fail in quality but, more broadly, it limits sustainable supply chain management and the mitigation of environmental impacts and social problems that may be present in distant global supply chains. Results here have suggested that simply by being known to downstream customers (and therefore visible to other stakeholders), there is pressure on deep suppliers to improve practices.
This study provides insights that may support responsible sourcing and supply chain management for a larger set of important materials. Two of the four conflict minerals (tantalum and tungsten) are commonly characterized as critical raw materials [7,19] that are paramount in low-carbon and other technologies yet also present geopolitical supply-risks. The Responsible Cobalt Initiative due diligence standard targets an important critical metal that also presents responsibility concerns. The London Metal Exchange expects responsible sourcing standards to be in place for the major base metals [11]. The exchange specifies physical standards and it is the main global price-setting platform for aluminum, copper, zinc, nickel, lead, tin, molybdenum, and cobalt.
Moreover, the goals of responsible sourcing are expanding. Initial concerns were on conflict (and focused on the DRC), but the OECD guidance broadens consideration to “conflict-affected and high-risk areas”, which cover a variety of human rights, conflict, and governance concerns [9]. The cobalt standard aims to improve responsible sourcing that includes labor conditions, like the prevention of forced labor and better health and safety [59]. Other programs hit on additional aspects of sustainable development, notably in its responsibility standard the Aluminium Stewardship Initiative refers extensively to environmental objectives and to the rights of indigenous peoples [60].
Several study informants made note of the success of supplier engagement and due diligence implementation in China. Reasons for this success were several, and they may inform other efforts in responsible sourcing, like those for sustainable wood and fisheries that have been less successful in China (see [5]). First, given that China is important not just to upstream processing of metals (see Table 1), but also to midstream manufacturing and downstream assembly of electronics, member firms could exercise market leverage (particularly of tantalum and tin suppliers). Second, was the ability to bridge cultural distance by member companies with significant local presence. Third, firms invested significant individual and collaborative resources, including repeated site visits and connections to partner organizations such as Chinese industry groups and government agencies. It appears that Chinese authorities accepted the value of responsible sourcing and, perhaps more importantly, accepted the value of third-party assurance of responsible sourcing. The success carried to cobalt supply chain responsibility, which started operation in 2018 as a collaboration of the Responsible Cobalt Initiative, the Responsible Minerals Initiative and the China Chamber of Commerce of Metals, Minerals & Chemicals Importers & Exporters [59]—which is important given that China is a major cobalt processor and a maker of electric vehicle batteries.
The current research has elucidated strategies and mechanisms that top-tier firms use to identify suppliers of material resources and encourage lower-tier suppliers to implement due diligence systems. Top-tier firms are collaborating and “jumping the chain” in order to engage deep suppliers. Results have shown the considerable efforts that top-tier firms have made to discover the identity of companies who are suppliers of 3TG metals: coordinated outreach, face-to-face visits, and direct financial support. Compare this to raw material criticality assessments, which generally use data at the national scale [19,20]. Few researchers have paid attention to managing real supply chains at the firm-level [20,21,22,23] at the firm-level resolution shown here for 3TG sources.
Whereas, technical avenues to the critical materials problem, like geological exploration, efficient mining and metallurgy, and materials substitution, are widely touted [7,19], management strategies for mineral governance are less discussed. Firms need to manage risks in mineral supply chains, regardless of whether risks are associated with supply disruption, with conflict or with environmental hazards. One approach is simply to change the sources of raw materials, to shift sourcing away from high risk countries and companies. However, to do this, firms need to know where materials are actually sourced, and this is difficult due to complex long supply chains, multiple processing tiers, independent traders, and long transportation distances. Another difficulty for minor metals, which is a key contribution to the criticality of raw materials, is that there are often a limited number of producers or production concentrated within a region. For example, most tungsten, which is classified as both a critical raw material and a conflict mineral, is mined and processed in one region in China.
In managing risks in their supply chains, top-tier firms have begun to develop systems and risk management approaches, and they participate in audit and certification processes. By better understanding their suppliers, manufacturing firms can “identify and manage critical suppliers” [8] and improve their ability to mitigate sources of supply disruption while maintaining ethical and sustainable sources of raw materials [24]. If a top-tier firm has better knowledge of lower-tier suppliers, it can better assess risks and implement strategies to manage risks.
More broadly, we discern a “responsible sourcing regime” for global governance of minerals and metals supply chains. Businesses are undertaking efforts in responsible sourcing that is guided by high-level norms and policy, which is executed through private-sector governance of minerals and raw materials [19,24,25]. Three levels are apparent: (1) principles and broad objectives like those in the OECD guidance on due diligence; (2) standards and requirements defined by industry-led programs, but also in government regulations like the U.S. and Europe conflict mineral rules; and, (3) company management systems. Firms need to select which responsible sourcing standards they should follow depending on their needs and capacities, and given the particulars of each industry and their position in the supply chain (upstream, midstream, downstream). Consequently, companies at all stages in the supply chain, and across a growing diversity of resource industries, are implementing responsible sourcing policies, procedures, management processes, and reporting systems.

6. Conclusions

Top-tier manufacturing firms collaboratively manage suppliers of critical metals to increase supply chain transparency and implement due diligence to reduce negative social impacts. We used data on real firms to look at both ends of the mineral supply chain. Upstream, we analysed a population of 323 “deep suppliers”—our term for lower-tier metal producers who are critically positioned to mitigate the conflict mineral problem. Downstream, we conducted interviews with six conflict mineral managers in multinational manufacturers who are end-users of tantalum, tin, tungsten, and gold.
Results showed both expected and novel tactics used to reach suppliers and manage risks in mineral supply. Manufacturers work collaboratively through industry associations to identify, validate, and engage lower-tier suppliers—targeting deep suppliers and persuading them to conform to responsible sourcing standards. Surprisingly, we found that manufacturers do not need line-of-sight visibility to lower-tier suppliers in order to do sustainable supply chain management; rather, global manufacturing firms “jump the chain” to engage directly with deep suppliers at the supply chain chokepoint. This work has contributed empirical evidence to understanding multi-tier supply chains, showing how power is exercised by top-tier firms to manage deep suppliers and to reach suppliers both directly and indirectly, and has helped to understand mechanisms for supply chain transparency.
Due diligence has emerged as an approach that is expected of companies, both upstream and downstream, involved in mineral supply chains where there is a risk of conflict, human rights, governance, or other concerns. For tantalum, tin, tungsten, and gold, the majority of smelters and refineries have implemented due diligence management systems. Responsible sourcing programs like the Responsible Minerals Initiative, the Responsible Jewellery Council, and the London Bullion Market Association have engaged hundreds of companies around the world.
The major limitations of this study are associated with the framing of the research and potential bias in data. The timelines that were developed relied on information provided by one industry association and cross-checked against industry and public information. We did not consult with suppliers or with other due diligence programs that may have differing perceptions of engagement practices. There was a potential selection-bias associated with interviewees. These persons may have skewed positive perspectives regarding their own efforts and programs.
Responsible sourcing, particularly of minerals and metals, is new and consequently numerous avenues for future research are available. Manufacturers have shone a light on deep suppliers, encouraging improvements in social aspects of companies and communities in which they operate. Theoretical work is recommended on the responsible sourcing regime for global governance of minerals and metals supply chains. Specifically:
  • Further investigation might consider environmental conditions or management performance of lower-tier suppliers who have no previous experience in corporate social responsibility. What have due diligence management systems done to change deep suppliers?
  • There is currently significant company implementation of the five-step process defined in the OECD guidelines. Consequently, future researchers should look for new data and public reports by various companies positioned at points along the supply chain.
  • As data become available on due diligence efforts in other industries, and with different objectives, new research questions and comparisons can be considered for conflict minerals, critical raw material, and base metals.
  • On a more theoretical level, concepts like transparency, responsible sourcing, and due diligence have just started to gain research interest [6]. These concepts and their practical implementation need additional clarification in future research.
  • The impacts of governance initiatives related to mineral and metals are poorly studied, partially because they are relatively young but also given a lack of data and methods [25]. Practical research is possible based on longitudinal data that are available since the Dodd–Frank Act was passed in 2010 on firms and industries, and at national and global scales.
Lastly, it should be emphasized that responsible sourcing and due diligence practices of companies cannot be easily correlated to tangible outcomes regarding mitigation of violence, improved human rights, or governance progress. Continued research, including field work in the DRC and other regions, is necessary to assess real circumstances and guide improvements in mining areas and communities.

Author Contributions

Conceptualization, S.B.Y.; Formal analysis, S.F.; Investigation, S.F.; Methodology, S.B.Y. and M.O.W.; Resources, S.B.Y.; Validation, S.B.Y. and M.O.W.; Writing—Original Draft, S.F. and S.B.Y.; Writing—Review & Editing, S.B.Y. and M.O.W.

Funding

This research received no external funding.

Acknowledgments

The authors acknowledge the cooperation of the Responsible Minerals Initiative.

Conflicts of Interest

The authors declare that S.B.Y. worked as a paid third-party advisor to the Responsible Minerals Initiative. The Responsible Minerals Initiative did not fund the research and had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results.

Appendix A

Interview questions:
  • Can you share the story of how this metal/regional group of smelters or refiners became active participants in the Conflict-Free Sourcing Initiative?
  • What were external factors that enabled these smelters to participate?
  • What were external factors that impeded these smelters to participate?
  • What deep supplier engagement tactics did your team try that worked? Why?
  • What did you try that did not work? Why?
  • Do you have any comments or insights regarding the timeline graphs?

References

  1. Hart, S.L. A Natural-Resource-Based View of the Firm. Acad. Manag. Rev. 1995, 20, 986–1014. [Google Scholar] [CrossRef]
  2. Carter, C.R.; Rogers, D.S. A framework of sustainable supply chain management: Moving toward new theory. Int. J. Phys. Distrib. Logist. Manag. 2008, 38, 360–387. [Google Scholar] [CrossRef]
  3. Tachizawa, E.; Wong, C.Y. Towards a theory of multi-tier sustainable supply chains: A systematic literature review. Supply Chain Manag. Int. J. 2014, 19, 643–663. [Google Scholar] [CrossRef]
  4. Kim, Y.H.; Davis, G.F. 80% of Companies Don’t Know If Their Products Contain Conflict Minerals. Available online: https://hbr.org/2017/01/80-of-companies-dont-know-if-their-products-contain-conflict-minerals (accessed on 5 January 2017).
  5. Young, S.B. Responsible sourcing of metals: Certification approaches for conflict minerals and conflict-free metals. Int. J. Life Cycle Assess. 2015. [Google Scholar] [CrossRef]
  6. Hofmann, H.; Schleper, M.C.; Blome, C. Conflict Minerals and Supply Chain Due Diligence: An Exploratory Study of Multi-tier Supply Chains. J. Bus. Ethics 2015. [Google Scholar] [CrossRef]
  7. Greenfield, A.; Graedel, T.E. The omnivorous diet of modern technology. Resour. Conserv. Recycl. 2013, 74, 1–7. [Google Scholar] [CrossRef]
  8. Carter, C.R.; Rogers, D.S.; Choi, T.Y. Toward the Theory of the Supply Chain. J. Supply Chain Manag. 2015, 51, 89–97. [Google Scholar] [CrossRef]
  9. OECD. OECD Due Diligence Guidance for Responsible Supply Chains of Minerals from Conflict-Affected and High-Risk Areas, 3rd ed.; OECD Publishing: Paris, France, 2016; ISBN 978-92-64-25238-7. [Google Scholar]
  10. Apple Supplier Responsibility. Available online: https://www.apple.com/supplier-responsibility/ (accessed on 24 October 2018).
  11. LME. Responsible Sourcing: LME Position Paper; The London Metal Exchange: London, UK, 2018. [Google Scholar]
  12. Young, S.B.; Dias, G. LCM of Metals Supply to Electronics: Tracking and Tracing “Conflict Minerals”; Social Science Research Network: Rochester, NY, USA, 2011. [Google Scholar]
  13. Young, S.B.; Dias, G. Conflict-free minerals supply-chain to electronics. In Proceedings of the Electronics Goes Green 2012+ (EGG), Berlin, Germany, 9–12 September 2012; pp. 1–5. [Google Scholar]
  14. Na, Y. Corporate Social Performance of Firms in Conflict Mineral Global Supply Chains. Masters’s Thesis, University of Waterloo, Waterloo, ON, Canada, 2016. Available online: http://hdl.handle.net/10012/11041 (accessed on 8 August 2018).
  15. Cashore, B.W.; Auld, G.; Newsom, D. Governing through Markets: Forest Certification and the Emergence of Non-State Authority; Yale University Press: New Haven, CT, USA, 2004. [Google Scholar]
  16. Steering Committee of the State-of-Knowledge Assessment of Standards and Certification. Toward Sustainability: The Roles and Limitations of Certification; RESOLVE Inc.: Washington, DC, USA, 2012. [Google Scholar]
  17. ICMM. Demonstrating Value—A Guide to Responsible Sourcing; International Council on Mining and Metals: London, UK, 2015; p. 44. [Google Scholar]
  18. Mori Junior, R.; Franks, D.M.; Ali, S.H. Sustainability certification schemes: Evaluating their effectiveness and adaptability. Corp. Gov. Int. J. Bus. Soc. 2016, 16, 579–592. [Google Scholar] [CrossRef]
  19. Blengini, G.A.; Nuss, P.; Dewulf, J.; Nita, V.; Peirò, L.T.; Vidal-Legaz, B.; Latunussa, C.; Mancini, L.; Blagoeva, D.; Pennington, D.; et al. EU methodology for critical raw materials assessment: Policy needs and proposed solutions for incremental improvements. Resour. Policy 2017, 53, 12–19. [Google Scholar] [CrossRef] [Green Version]
  20. Graedel, T.E.; Barr, R.; Chandler, C.; Chase, T.; Choi, J.; Christoffersen, L.; Friedlander, E.; Henly, C.; Jun, C.; Nassar, N.T.; et al. Methodology of Metal Criticality Determination. Environ. Sci. Technol. 2012, 46, 1063–1070. [Google Scholar] [CrossRef]
  21. Kolotzek, C.; Helbig, C.; Thorenz, A.; Reller, A.; Tuma, A. A company-oriented model for the assessment of raw material supply risks, environmental impact and social implications. J. Clean. Prod. 2018, 176, 566–580. [Google Scholar] [CrossRef]
  22. Gaustad, G.; Krystofik, M.; Bustamante, M.; Badami, K. Circular economy strategies for mitigating critical material supply issues. Resour. Conserv. Recycl. 2018, 135, 24–33. [Google Scholar] [CrossRef]
  23. Duclos, S.J.; Otto, J.P.; Konitzer, D.G. Design in an era of Constrained Resources. Mech. Eng. Mag. Sel. Artic. 2010, 132, 36–40. [Google Scholar] [CrossRef]
  24. Ali, S.H.; Giurco, D.; Arndt, N.; Nickless, E.; Brown, G.; Demetriades, A.; Durrheim, R.; Enriquez, M.A.; Kinnaird, J.; Littleboy, A.; et al. Mineral supply for sustainable development requires resource governance. Nature 2017, 543, 367–372. [Google Scholar] [CrossRef]
  25. Auld, G.; Betsill, M.; VanDeveer, S.D. Transnational Governance for Mining and the Mineral Lifecycle. Annu. Rev. Environ. Resour. 2018, 43, 425–453. [Google Scholar] [CrossRef]
  26. Seuring, S.; Beske, P. Putting sustainability into supply chain management. Supply Chain Manag. Int. J. 2014, 19, 322–331. [Google Scholar]
  27. Seuring, S.; Müller, M. From a literature review to a conceptual framework for sustainable supply chain management. J. Clean. Prod. 2008, 16, 1699–1710. [Google Scholar] [CrossRef]
  28. Yawar, S.A.; Seuring, S. Management of Social Issues in Supply Chains: A Literature Review Exploring Social Issues, Actions and Performance Outcomes. J. Bus. Ethics 2015. [Google Scholar] [CrossRef]
  29. Gimenez, C.; Tachizawa, E.M. Extending sustainability to suppliers: A systematic literature review. Supply Chain Manag. Int. J. 2012, 17, 531–543. [Google Scholar] [CrossRef]
  30. Grimm, J.H.; Hofstetter, J.S.; Sarkis, J. Exploring sub-suppliers’ compliance with corporate sustainability standards. J. Clean. Prod. 2016, 112, 1971–1984. [Google Scholar] [CrossRef]
  31. Gong, Y.; Jia, F.; Brown, S.; Koh, L. Supply chain learning of sustainability in multi-tier supply chains: A resource orchestration perspective. Int. J. Oper. Prod. Manag. 2018, 38, 1061–1090. [Google Scholar] [CrossRef]
  32. Kim, Y.H.; Davis, G.F. Challenges for Global Supply Chain Sustainability: Evidence from Conflict Minerals Reports. Acad. Manag. J. 2016, 59, 1896–1916. [Google Scholar] [CrossRef]
  33. Young, S.B.; Zhe, Y.; Dias, G. Prospects for sustainability certification of metals. Metall. Res. Technol. 2014, 111, 131–136. [Google Scholar] [CrossRef]
  34. Resolve. Tracing a Path Forward: A Study of the Challenges of the Supply Chain for Target Metals Used in Electronics; Conflict-Free Sourcing Initiative; Resolve Inc.: Washington, DC, USA, 2010; p. 50. [Google Scholar]
  35. Sauer, P.C.; Seuring, S. Extending the reach of multi-tier sustainable supply chain management—Insights from mineral supply chains. Int. J. Prod. Econ. 2018. [Google Scholar] [CrossRef]
  36. Ang, E.; Iancu, D.A.; Swinney, R. Disruption Risk and Optimal Sourcing in Multitier Supply Networks. Manag. Sci. 2017, 63, 2397–2419. [Google Scholar] [CrossRef]
  37. Sauer, P.C.; Seuring, S. Sustainable supply chain management for minerals. J. Clean. Prod. 2017, 151, 235–249. [Google Scholar] [CrossRef]
  38. De Koning, A.; Kleijn, R.; Huppes, G.; Sprecher, B.; van Engelen, G.; Tukker, A. Metal supply constraints for a low-carbon economy? Resour. Conserv. Recycl. 2018, 129, 202–208. [Google Scholar] [CrossRef]
  39. Sarpong, S. Traceability and supply chain complexity: Confronting the issues and concerns. Eur. Bus. Rev. 2014, 26, 271–284. [Google Scholar] [CrossRef]
  40. Franken, G.; Vasters, J.; Dorner, U.; Melcher, F.; Sitnikova, M.; Goldmann, S. Certified Trading Chains in Mineral Production: A Way to Improve Responsibility in Mining. In Non-Renewable Resource Issues; Sinding-Larsen, R., Wellmer, F.-W., Eds.; Springer: Dordrecht, The Netherlands, 2012; pp. 213–227. ISBN 978-90-481-8678-5. [Google Scholar]
  41. Ashby, M.F. Materials and Sustainable Development; Butterworth-Heinemann: Oxford, UK, 2015; ISBN 978-0-12-802562-8. [Google Scholar]
  42. Haufler, V. The Kimberley Process Certification Scheme: An Innovation in Global Governance and Conflict Prevention. J. Bus. Ethics 2009, 89, 403–416. [Google Scholar] [CrossRef]
  43. Benn, S.; Giurco, D.; Brown, P.J.; Agarwal, R. Towards Responsible Steel: Preliminary Insights. Resources 2014, 3, 275–290. [Google Scholar] [CrossRef] [Green Version]
  44. Macedo, D.; Mori Junior, R.; Carvalho, L.S.L.S.; Mizusaki, A.M.P. Sustainability certification scheme for the dimension stone industry in Brazil: A proposal for an initiative based on the northwest region of Espírito Santo State, Brazil. J. Clean. Prod. 2018, 182, 896–909. [Google Scholar] [CrossRef]
  45. Bleischwitz, R.; Dittrich, M.; Pierdicca, C. Coltan from Central Africa, international trade and implications for any certification. Resour. Policy 2012, 37, 19–29. [Google Scholar] [CrossRef] [Green Version]
  46. Fritz, M.M.C.; Tessmann, N. Management of Conflict Minerals in Automotive Supply Chains: Where to Start from? In Social and Environmental Dimensions of Organizations and Supply Chains: Tradeoffs and Synergies; Brandenburg, M., Hahn, G.J., Rebs, T., Eds.; Greening of Industry Networks Studies; Springer International Publishing: Cham, Switzerland, 2018; pp. 153–169. ISBN 978-3-319-59587-0. [Google Scholar]
  47. Securities and Exchange Commission. Dodd-Frank Act Rulemaking: Specialized Corporate Disclosure. Available online: https://www.sec.gov/spotlight/dodd-frank/speccorpdisclosure.shtml (accessed on 4 December 2018).
  48. European Commission. Conflict Minerals Regulation Explained. Available online: http://ec.europa.eu/trade/policy/in-focus/conflict-minerals-regulation/index_en.htm (accessed on 14 November 2018).
  49. RMI. Responsible Minerals Initiative. Available online: http://www.responsiblemineralsinitiative.org/ (accessed on 2 November 2017).
  50. Young, S.B.; Fonseca, A.; Dias, G. Principles for responsible metals supply to electronics. Soc. Responsib. J. 2010, 6, 126–142. [Google Scholar] [CrossRef]
  51. Miles, M.B.; Huberman, A.M. Qualitative Data Analysis; Sage Publications: Thousand Oaks, CA, USA, 1994. [Google Scholar]
  52. Creswell, J. A Concise Introduction to Mixed Methods Research; Sage Publications: Thousand Oaks, CA, USA, 2014. [Google Scholar]
  53. Fernandes, S. Deep Supply-Chain Engagement in Conflict Minerals. Master’s Thesis, University of Waterloo, Waterloo, ON, Canada, 2018. Available online: http://hdl.handle.net/10012/13412 (accessed on 9 August 2018).
  54. GHGm. Social and Environmental Responsibility in Metals Supply to the Electronics Industry; Electronic Industry Citizenship Coalition and the Global e-Sustainability Initiative. 2008. Available online: http://www.responsiblebusiness.org/media/docs/publications/SERMetalsSupplyreport.pdf (accessed on 9 September 2008).
  55. London Bullion Metals Association. LBMA—Responsible Sourcing. Available online: http://www.lbma.org.uk/responsible-sourcing (accessed on 14 April 2018).
  56. Quarshie, A.M.; Salmi, A.; Leuschner, R. Sustainability and corporate social responsibility in supply chains: The state of research in supply chain management and business ethics journals. J. Purch. Supply Manag. 2016, 22, 82–97. [Google Scholar] [CrossRef]
  57. Gosling, J.; Jia, F.; Gong, Y.; Brown, S. The role of supply chain leadership in the learning of sustainable practice: Toward an integrated framework. J. Clean. Prod. 2016, 137, 1458–1469. [Google Scholar] [CrossRef]
  58. Taka, M. Emerging Practice in Responsible Supply Chain Management: Closed-Pipe Supply Chain of Conflict-Free Minerals from the Democratic Republic of Congo. Bus. Soc. Rev. 2016, 121, 37–57. [Google Scholar] [CrossRef]
  59. RMI. Cobalt Due Diligence. Available online: http://www.responsiblemineralsinitiative.org/emerging-risks/cobalt/ (accessed on 2 January 2019).
  60. ASI. ASI Home—Aluminium Stewardship Initiative. Available online: https://aluminium-stewardship.org/ (accessed on 9 September 2018).
Figure 1. Schematic supply chain of tantalum, tin and tungsten to top-tier firm, showing indicative flows of raw material to and from smelters and refiners. The top-tier firm and smelters and refiners are focal companies in a “diamond shaped” supply chain. Note: the gold supply chain is qualitatively different.
Figure 1. Schematic supply chain of tantalum, tin and tungsten to top-tier firm, showing indicative flows of raw material to and from smelters and refiners. The top-tier firm and smelters and refiners are focal companies in a “diamond shaped” supply chain. Note: the gold supply chain is qualitatively different.
Resources 08 00026 g001
Figure 2. The fraction of global smelters and refiners conformant to international due diligence standards. Includes suppliers listed by the Responsible Minerals Initiative, the Responsible Jewellery Council, and the London Bullion Market Association (N = 323 facilities at end of 2017).
Figure 2. The fraction of global smelters and refiners conformant to international due diligence standards. Includes suppliers listed by the Responsible Minerals Initiative, the Responsible Jewellery Council, and the London Bullion Market Association (N = 323 facilities at end of 2017).
Resources 08 00026 g002
Figure 3. Timeline of tantalum industry metal producers joining due diligence program, to 100% of known facilities engaged.
Figure 3. Timeline of tantalum industry metal producers joining due diligence program, to 100% of known facilities engaged.
Resources 08 00026 g003
Figure 4. Timeline of tin smelters and refiners joining the due diligence program, to about 95% of known facilities engaged.
Figure 4. Timeline of tin smelters and refiners joining the due diligence program, to about 95% of known facilities engaged.
Resources 08 00026 g004
Figure 5. Timeline of tungsten smelters and refineries joining the due diligence program, to 96% of facilities engaged.
Figure 5. Timeline of tungsten smelters and refineries joining the due diligence program, to 96% of facilities engaged.
Resources 08 00026 g005
Figure 6. Timeline of gold refiners joining Responsible Minerals Initiative, Responsible Jewellery Council and London Bullion Market Association due diligence programs, to about 70% of large gold facilities engaged.
Figure 6. Timeline of gold refiners joining Responsible Minerals Initiative, Responsible Jewellery Council and London Bullion Market Association due diligence programs, to about 70% of large gold facilities engaged.
Resources 08 00026 g006
Figure 7. Types of supplier engagement.
Figure 7. Types of supplier engagement.
Resources 08 00026 g007
Table 1. Population and due diligence status of known tantalum, tin, tungsten, and gold (3TG) smelters and refineries (as of late 2017).
Table 1. Population and due diligence status of known tantalum, tin, tungsten, and gold (3TG) smelters and refineries (as of late 2017).
TantalumTinTungstenGold1TOTAL
Known facilities, worldwide448346150323
Facilities in China1817282487
Facilities participating in due diligence programs 447844114280
Percent participating100%94%96%76%87%
Facilities conformant to due diligence standards397340101253
Percent conformant89%88%87%67%78%
1 For gold the population is limited to industrial size gold refiners.

Share and Cite

MDPI and ACS Style

Young, S.B.; Fernandes, S.; Wood, M.O. Jumping the Chain: How Downstream Manufacturers Engage with Deep Suppliers of Conflict Minerals. Resources 2019, 8, 26. https://doi.org/10.3390/resources8010026

AMA Style

Young SB, Fernandes S, Wood MO. Jumping the Chain: How Downstream Manufacturers Engage with Deep Suppliers of Conflict Minerals. Resources. 2019; 8(1):26. https://doi.org/10.3390/resources8010026

Chicago/Turabian Style

Young, Steven B., Shannon Fernandes, and Michael O. Wood. 2019. "Jumping the Chain: How Downstream Manufacturers Engage with Deep Suppliers of Conflict Minerals" Resources 8, no. 1: 26. https://doi.org/10.3390/resources8010026

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop