1. Introduction
The literature on living labs (LLs) has increasingly acknowledged the importance of combining user-centred and open innovation approaches in the development of innovations and technologies.
The paradigm at the base of the concept of the LL takes its roots from two main predecessors: the Scandinavian cooperative (later translated to the participatory U.S. design) of the 60s and 70s and the European social experiments with Information Technologies (IT) in the 1980s. LL literature often ascribes its actual birth to Professor William Mitchell at the Massachusetts Institute of Technology (MIT) [
1], acknowledging him as “the grandfather of Living Labs” [
2] for his influential role in Europe. However, as highlighted by Leminen and Westerlund [
3], the origins of the term can be attributed to a group of American researchers in the early 1990s who started using the terms “living lab” and “living laboratories” in their studies.
The concept of the LL evolved in subsequent years, receiving strong interest from policymakers and academics. While the number of LLs has increased, it is still difficult to identify a widely accepted definition of the LL in the literature [
4,
5,
6]. The LL has been described as a research methodology [
7,
8], an experimental environment [
9,
10], an innovation approach [
11], an innovation network [
12] and an infrastructure shared by different stakeholders [
13]. As a result, widely different experiences coexist under the name “LL” [
14].
Each LL is driven by different actors [
9], assumes a plurality of network structures [
15] or adopts different methodologies and tools [
16]. LLs can be articulated as different types [
17,
18] that cover different topics, subject specialities, experts and contexts, such as information and communications technology (ICT) innovation, urban sustainability [
19,
20,
21] and campus life [
4].
LLs have been strongly supported by the European Network of Living Labs (ENoLL), a non-profit organisation aimed at promoting the diffusion of LLs across Europe, monitoring LL best practices and disseminating LL results. More than 400 LL experiences have been recognised by the ENoLL over the years; these LLs are heterogeneous in terms of application, context and approach. Many of them are linked to funded projects and often seem to become inactive when the projects end. Of the LLs labelled as active on the list available on the ENoLL website, many concern the healthcare field or at least report “health and well-being” as one of their work domains and areas of interest. This is not surprising. In the last several decades, decision-makers, professionals and citizens have shown a burgeoning interest in developing effective approaches to managing emerging opportunities and challenges in the healthcare field. This is reflected in an overwhelming range of programs and initiatives dedicated to healthcare innovations in different contexts (hospital-based, home-based and wearable technologies).
The European concept of the LL, strongly supported and disseminated by the ENoLL, places user involvement at the centre, clearly emphasising the “user-centred” characteristic of the LL paradigm. However, other types of LL exist. Schuurman and colleagues [
17] extrapolated from the literature four different types of LL: (i) the original “American” LL, (ii) the LL as an extension of testbeds, (iii) the LL as supporting context research and co-creation and (iv) the LL as focusing on collaboration and knowledge support activities. Besides the first three types, which all perfectly fit the “European stream,” the fourth category occurs in parallel, focusing more on multi-stakeholder collaboration and knowledge sharing, which are cardinal for the success of LLs [
22]. As a result, this category has less emphasis on the deepening of end-user involvement.
In healthcare, collaboration among stakeholders is considered a fundamental pillar in the process of conceiving and developing technological innovations. Technologies for health and healthcare, no matter how novel or mature, are indeed always embedded in complex socio-technical systems and immersed in dense networks of relations among different stakeholders in the healthcare ecosystem. In particular, to leverage the opportunities offered by new medical and digital technologies to create products and solutions that improve quality of life, different actors interact with each other to design technologies, creating a large number of interconnections and synergies in the process. Different professionals are constantly involved, and often more than one organisation is required for a single case to ensure that different perspectives are covered [
23,
24]. To add complexity, the health technology assessment discipline imposes strict rules for the healthcare community that require a multi-perspective approach and micro-dynamic collaborations. Moreover, the patient is assuming an increasingly central role in the innovation process. The literature on empowerment suggests that people will be in charge of managing their personal data on health and well-being, and patient involvement in the innovation process is commonly associated with significant benefits in terms of functionality, usability and fit with market needs [
25]. In sum, all these factors make innovation in healthcare a very complex process in which healthcare organisations must cooperate with external actors, involving the end-users in a multidisciplinary approach [
26].
With these considerations in mind, LLs, especially those focused on collaboration and knowledge support activities, seem to fit such a complex socio-technical system [
27,
28], as the concept behind the LL highlights the importance of the network and aims at creating collaborative links among users, researchers, producers, and public and private organisations, emphasising the coexistence of heterogeneous actors and stakeholders [
6,
12,
15,
29,
30]. Moreover, Haukipuro and colleagues [
31], inspired by the findings of their study on an eHealth accelerator, proposed the LL approach as a design element in the accelerator model because of its proven usefulness in the development of new products and services in the field.
Even though LL literature in the healthcare context is increasing, there are still few studies on the subject. Among them, some scholars have attempted to identify a list of factors that can be used to build and manage an LL in healthcare [
14,
32,
33,
34,
35,
36]. Van Geenhuizen, for example, dedicated particular attention to the challenges related to the management of stakeholders’ networks and multi-stakeholder cooperation [
35,
36], and Callari and colleagues investigated the needs and requirements of the involvement of end-users as participants in LL initiatives [
37]. This is in line with literature on LL implementation in other contexts [
38].
Despite the fact that collaboration with stakeholders has been widely recognised as a key aspect of LLs, especially for the fourth type of LL, the vast majority of LL literature has focused on the user involvement and co-creation dimension of the LL approach, and only a few studies have examined stakeholders’ needs. Accordingly, this paper aims at exploring an LL experience mainly focused on collaboration and knowledge sharing in healthcare to answer the following research questions (RQs):
- RQ1:
What are the main stakeholders’ needs in building an LL (for technological innovation) and in contributing to its sustainability over time?
- RQ2:
How can the members of an LL experience the LL approach within their project activities in order to improve the technological innovation process?
To address these questions, the authors report on the EMPATIA@Lecco Project, a regional project funded by the Cariplo Foundation and the Lombardy Region, which involves clinical and technological centres of excellence in the field of rehabilitation that provide patients with a variety of different technologies for neurorehabilitation. Of paramount importance to the project is the establishment of a very complex collaborative network in a high-tech healthcare context: the Lecco Innovation Living Lab (LILL).
The paper is organised as follows: the second section describes the research approach and methodology used, the third section describes and discusses the key findings, and the final section describes the theoretical and practical implications of our findings.
3. Results
This section reports the results of our qualitative research about (1) stakeholders’ awareness of the LL mission, (2) the identification of stakeholders’ needs for the LILL’s development and their contribution to its sustainability over time in a healthcare context and (3) the definition of activities that allow the participant to experience the LL approach to fostering technological innovation.
3.1. Stakeholders’ Awareness of the LL Mission
The first category of findings concerns the level of awareness about the mission of the LILL. The interviewees stated that the LILL was born from collaborations between clinical and research actors in Lecco’s geographical territory, which are mostly linked to funded research projects or gentlemen’s agreements. Nevertheless, they declared that the management of the network during projects is extremely complex and unstructured. The LILL describes itself as an evolution of the existing consortium and states that its goal is to become a unique entity, facilitating and simplifying high-level interconnections to accelerate the process of innovation and the introduction of products to the market. This broad idea was interpreted and explained by our interviewees. One said, “The LILL can be considered a large box in which you can find several colours. They can all be used together or only some of them to retrieve the final product.” Another interviewee also stated, “LILL can offer professionals the possibility to operate with updated infrastructures and multidisciplinary competencies. It is not only experimentation, but it is a matter of entering into a project perspective and creating together.” They added, “It is an environment where everyone is free to expose themselves to others.” Despite the interviewees’ different points of view, they agreed on the importance of common interests in the LILL network, recognising the positive impact of receiving adequate visibility (15/15 interviewees), gaining financial benefits (15/15 interviewees), reinforcing collaborations among stakeholders and improving the impact of scientific output (15/15 interviewees). This unanimous agreement reflects the cultural affinity of the group that makes it extremely cohesive.
With the aim of increasing participant awareness about LLs and their key elements, the first workshop presented the different typologies of LLs, and their traditional features were discussed. Two workshop templates were proposed; they focused on the main objective of the LILL, the mission of the LILL and the three key components of LLs in general (
Supplementary Materials).
All of the participants agreed in considering the LILL, under development in the EMPATIA@Lecco Project, a facilitator for multi-stakeholder collaboration and knowledge sharing following the classification proposed by Schuurman and colleagues [
15]. In line with LLs in other contexts, the LILL allows the integration of both internal and external knowledge dealing with the open innovation paradigm [
12,
16], and it is strategic for the implementation of public, private and people partnerships (PPPPs) [
51] to develop and deliver technological innovation [
13]. During the workshop, all the categories proposed in the study guide were confirmed, and none of the indicated categories were defined as inappropriate or negligible. The workshop confirmed that the multi-stakeholder network dimension was the most relevant one, emphasising the role of relationships among its members, governance of the collaborative and the management of the sharing of technologies and knowledge/competencies.
The workshop also confirmed the involvement of end-users as a core aspect of the innovation process. Nevertheless, the involvement of patients from the beginning of the innovation process means dealing with stringent regulations. This is the reason why understanding how to manage the network in terms of governance and relationships between members with different institutional nature was identified by the participants as the priority for an LL based on complex networks such as these.
3.2. Identification of Stakeholders’ Needs
Based on the interviewees’ responses, the main stakeholder needs in building an LL and ensuring its sustainability over time are reported in
Table 3.
The stakeholders’ needs are described in more detail below.
Unstructured collaborations are strongly influenced by personal relationships, which sometimes showcases non-cooperative behaviours that negatively affect the entire innovation process. Incorrect management of interpersonal conflicts due to different backgrounds, value systems and hierarchies of roles may lead to the degradation of personal relationships. One of our respondents noted the importance of introducing the LL as a neutral and safe place, highlighting the need for trust and communication among LL actors. In addition, they said that the degree of commitment among the partners has an impact on establishing a common vision and goals. One of the interviewees said, “I realised that this type of organisation works if there is someone who strongly believes in it. Being enthusiastic is the trigger for good collaboration.” Another stated, “I’m always ready to focus more on human relationships than on management schemes. Sometimes I find difficulties in interacting professionally with people with whom the human relationship is weaker.” In light of this, it is clear that trust is the foundation for building and maintaining relationships over time. The interviewees further noted that improving the level of shared commitment is the key to establishing synergistic relationships and, consequently, attracting the entire network. Indeed, the stakeholders’ commitment to the project and trust in one another are directly related.
Some of the most cited issues related to network dynamics focus on how the LL is managed at both strategic and operational levels. Many respondents highlighted aspects such as access to infrastructure, conditions of use and responsibility and ownership and property rights. One of the research partners stated, “In order to organise a set of rules to manage the relationship, it is absolutely necessary to identify the spaces that will be used and the existing infrastructures to be shared, while considering issues of safety and responsibility and fees, if necessary.” In addition, the clinical partners shed light on the need to define rules to manage the risk of increasing workloads and their impact on clinical routine practice. Although the workload seemed to be their major concern, the clinicians reported their willingness to share technologies and competencies for the sake of the LL.
The aim of structuring the network is to simplify relations between stakeholders. Nevertheless, nowadays, interactions are still managed without standardised systems or infrastructures. Most interviewees considered not having a shared platform to be a barrier to overcome. One of our interviewees said, “Having a tool to manage sharing knowledge is so relevant because it is necessary to make data and information homogeneous. We are far from it. Despite the relevance of these aspects, implementing a knowledge-sharing tool or platform may not be easy, but we have to think about it.”
Many respondents identified differences between the institutions’ identities and organisational structures as a critical factor. As already mentioned, the LILL involves a highly complex network of actors, including universities, research institutes, hospitals and other clinical partners. Each of these actors has its own institutional identity. One of the clinical stakeholders explained, “Compared to research institutes, our company is a private company, so we must take a different approach because it is the owner of the clinic that makes the decisions.” Considering and managing these differences between institutional identities is an essential step in building the LL and ensuring its sustainability.
Many interviewees reported that collaboration in such complex networks can be limited by colleagues’ lack of knowledge about competencies or infrastructures. In this context, mapping enabling technologies was recognised as relevant by almost all the interviewees. In addition, the technical skills within an organisation rapidly evolve, and their continuous updating, if not monitored, was perceived as an obstacle. In this context, the nature of the actors involved in the network must also be considered. As mentioned previously, the LILL ecosystem is rich in clinical excellence and research in the field of rehabilitation, and in some cases, those who manage these institutes, being very proud of their work, tend to overestimate their organisational skills. These cultural aspects and continuous technological updating are aspects that must be managed.
One particular issue for LLs in healthcare is how to involve the end-user (in this case, the patients). This is because regulation is always supervised by clinical institutions. Currently, patients can only be recruited by health professionals and only rarely can they be reached outside clinical facilities. Therefore, creating ad hoc protocols for patient involvement could be a major challenge.
All the interviewees agreed on the fact that the development of a network will make it easier to reach a wider audience with the innovation process. Researchers would like to involve patient associations or the specific communities of interest (elderly, children, volunteers) in different geographical areas to recruit users who, thanks to ad hoc informed consent, may participate in different projects.
According to all the interviewees, the LILL should have a physical space. The interviewees claimed that they need an emblematic space to make the network tangible, saying that “when you have a physical space, you know what you can do” and that “what you don’t see may easily disappear.” The place should represent the relationship among partners. As one of the research partners explained, “it gives a concrete vision to a specific objective”, becoming the interface between the internal network and the external world. Therefore, its design must be considered a priority for this kind of LL.
3.3. Structuring Activities to Experience the LL Approach
The second workshop was mainly based on the results of the first one. The templates proposed for the discussion were focused on the first LL key element: the multi-stakeholder network. First, the stakeholders’ needs identified from the interviews were validated by the workshop participants without adding any other relevant needs. In addition to the validation, the discussion revealed a clear hierarchy among the needs, with certain ones prioritised. The ranking of the needs that was created in the second workshop is as follows: first, improving stakeholders’ commitment and building trust; second, defining guidelines/rules; third, mapping competencies/technologies; and fourth, using tools and/or platforms for sharing knowledge and infrastructure.
The second objective of the workshop was to co-create and plan activities to satisfy the stakeholders’ needs while experimenting with the LL approach. First, to ensure the multidisciplinary nature and the involvement of the different stakeholders in each phase of the innovation process, specific working groups (WGs) were established for each technological innovation. Each WG was composed of both clinical and research partners and participated in the development of the technology throughout the whole innovation process, from conceptualisation to testing and, eventually, commercialisation. The technologies developed by each WG are listed in
Table 4. Twelve of the WGs developed a novel technology, while six of them focused on developing and testing novel clinical protocols and pathways. The creation of WGs to participate in the entire innovation process was an activity that strengthened trust and knowledge sharing within the network.
Second, in order to meet the needs related to managing the sharing of technology and knowledge/competencies and the governance of the collaborative, two WGs were created to work on how to share research assets. These WGs (
Table 5) worked on two pilot applications focusing on 3D printers and sensors, which were considered distinctive assets for the LILL. For both research assets, a database was created as a starting point. Then, thanks to the joint work, it was possible to work on the creation of clear and standardised rules for the management of the research-sharing infrastructure. We first understood and defined the possible administrative arrangements among the LILL members, who had different institutional natures, governance styles and preferred bureaucratic procedures. We then mapped the possible service processes (linked to the shared use of these two research assets) that the LILL could offer. Finally, as the last step, standardised utilisation rules were created based on the constraints previously analysed.
4. Discussion and Conclusion
In line with the complexity and the strong need for multi-stakeholder collaboration that characterises the innovation process in healthcare, this study focused on LLs as facilitators for multi-stakeholder collaboration and knowledge sharing. Beginning with a review of the literature, with a particular focus on LLs in healthcare, we found, to the best of our knowledge, no detailed analysis that considers stakeholders’ needs within LLs that are mainly focused on collaboration and knowledge sharing for the technological innovation process in such a complex socio-technical system. Therefore we had two main objectives: first, we aimed to examine stakeholders’ needs in building this type of LL for fostering technological innovation; second, we aimed to share how to plan specific activities to answer emerging needs. To achieve these goals, we reported on the EMPATIA@Lecco Project and adopted an empirical approach based on a single case study: the LILL.
This paper makes an initial contribution by identifying from the literature a set of key elements and categories used as a guide for the entire study (
Table 1). In particular, we confirmed the concurrency of the three atomic elements of an LL [
6]. Among the three key elements, the multi-stakeholder network dimension was revealed to be the most relevant. This finding seems to diverge from the more traditional European connotation of LLs that focuses on the involvement of the end-user. A likely reason can be found in the typology of LLs. Indeed, following the classification by Schuurman and colleagues [
17], the LILL recognises itself as a “facilitator for multi-stakeholder collaboration and knowledge sharing.” In this context, this finding is in line with the study by Buitendag and colleagues [
22], who highlighted collaboration and knowledge support as cardinal for the success of this type of LL. Moreover, it is sustained by the particular and complex socio-technical system where the LILL is immersed in: healthcare. The dense network of relations among the different stakeholders in the innovation process and the strong need to collaborate to produce technological innovation for health both emphasise the importance of this element.
Beyond the identification of elements and categories, this study contributes by identifying a set of eight stakeholder needs (reported in
Table 3) and defining an action plan to implement activities within the research and innovation processes to meet these needs. While the need identification phase concerned all elements and categories, including the involvement of end-users and the real-life environment, the second phase was limited to activities related to the multi-stakeholder network dimension as the priority for this type of LL. Two other research sessions were scheduled to investigate and co-design activities related to the remaining two elements; however, due to the COVID-19 emergency, we were forced to put these sessions on hold.
Our findings reveal that switching from a traditional research network, where the collaborations among the different actors are often informal and intermittent, to a real LL network is not always an intuitive step; we found that this transition involves a long and complex process of network and relationship structuring. In line with this consideration, our study suggests a clear hierarchy in stakeholders’ needs related to the multi-stakeholder network dimension. First of all, the findings confirm the importance of “human relationships” among members, highlighting the need for commitment and trust within the network. The stakeholders clearly report the need to feel protected within the LL, which should be presented as a “neutral and safe island.” This cannot disregard a careful and accurate development of rules at both operational and governance levels and an awareness of the technologies, infrastructure and skills available to the LL network. Moreover, as confirmed by our findings, when different types of stakeholders are involved, it is of paramount importance to consider and manage the different institutional natures of the actors. This is particularly true when it comes to public institutions that, at least in Italy, suffer from bureaucratic restrictions and limitations. Therefore, the actions implemented to enforce proper regulation of the LL network should inevitably pay special attention to these diversities.
In line with the literature, this specific typology of LL is predominantly long-term [
17]. However, setting up an LL network able to involve prolonged engagement with stakeholders is not easy, and despite that a lot has been done to suggest and set up activities aimed at improving end-user involvement, there are still relatively few guidelines about how LL networks are organised in practice, especially in complex systems [
38]. In line with this consideration, and beginning with the priority needs, we were able to contribute by identifying and designing the following activities. First, eighteen WGs were created to develop specific technological innovations. These multidisciplinary and multi-stakeholder WGs are intended to follow the innovation through the entire process, from conceptualisation to commercialisation, and their composition should remain as stable over time as possible. In this case, the team dimension is able to play an essential role in building and enforcing trusting relationships among members. Moreover, additional WGs were established and dedicated to the management and governance of shared research, competencies, infrastructures and assets among LL members, starting from two pilot applications, 3D printers and sensors, which were considered distinctive assets for the LILL. For each application, the accurate assets and competence mapping among members and the creation of specific databases helped the members promote open and shared use among the network of these assets and the related competencies. Moreover, these pilot applications helped the consortium co-create specific rules and guidelines for the collaboration that could also be generalised and further extended at both project and governance levels, pushing the LL network members to evaluate and choose the most suitable administrative arrangements.
In conclusion, reflecting on these findings, we suggest some practical tips that may help researchers and practitioners to switch from a traditional collaborative network to an open LL network for technological innovation in healthcare based on sharing research resources and infrastructure. First, the transition should pay particular attention to human relationships and should encourage trust among members. To this purpose, we suggest planning specific team-building activities and arranging multidisciplinary and stable WGs that follow the innovation through its entire lifecycle. In this context, beginning from well-established models in the literature, we suggest developing or adopting specific toolkits able to measure key indicators of a successful collaborative network (e.g., trust). This could help LLs make the network increasingly successful. Moreover, increasing the awareness of LL actors about the set of competencies/technologies available to LLs would help enable the effective circulation of ideas and information within a complex structure of actors. Finally, rules and guidelines to structure a “safe” and trusting relationship should include topics such as range of inclusion (especially what assets, infrastructures and technologies can be shared), access rights, safety and responsibility terms, payment and compensation policies and intellectual property rights. To support effective design and implementation of these rules and guidelines, we suggest starting from a pilot application and generalising them in an inductive approach.
5. Limitations and Future Investigations
Although this study contributes by fostering policies that support collaborative research in the field of technological innovation in healthcare, it suffers from some limitations.
First, the paper mainly focuses on just one of the three identified key LL elements, namely the multi-stakeholder network. As already discussed, while the first phase of the study (the stakeholders’ needs identification) also included the other two elements in part (the involvement of end-users and the real-life environment), the recent COVID-19 emergency forced the activity design phase (phase II) to be limited to the multi-stakeholder network only. We are aware that an LL must incorporate all three dimensions; therefore, further research will be dedicated to investigating and planning activities for the other two LL elements (the involvement of end-users and a real-life environment).
Moreover, this study is based on a single case study and endorses a qualitative approach. A larger number of cases are necessary to enrich and improve the quality of the data and to allow for a conclusion regarding LLs in a healthcare context. Therefore, future studies need to quantitatively investigate the findings using a multiple case study approach.
Finally, since the paper suggests activities aimed at satisfying the identified needs and improving the innovation process, the satisfaction analysis of stakeholders’ needs based on the activities implemented should be the next research step to enable understanding of how the analysis of practices in LLs could supplement the theory, allowing the development of models and practical methods to apply to LLs that share the same problems.