3 Part 3: Big project and researcher’s guide: I am building a new project and want to start from scratch to engage a diversity of citizens and stakeholders
Highlights
- We provide a theoretical and scientific background to assist in your funding applications for projects related to Mission Ocean & Waters.
- Citizen participation is not necessary for all types of problems, and precautions should be taken for when, why and how to engage them.
- Knowledge and interest among citizens about Mission Ocean & Waters must be created through processes that are perceived as credible, salient and legitimate to be translated into action.
- The steps of citizen engagement, from informing to empowering, are presented as a tool to understand when citizen participation is needed and not, and which level of participation is appropriate.
- Based on the above, we provide tools to guide you through your project planning, including: guiding questions to consider before planning and stakeholder mapping templates (see Table 7 and Table 8), a range of citizen engagement tools (Table 9) and help towards strategic planning and evaluating your impact (Table 10, Table 11, and Table 12).
3.1 Introduction to engaging citizens with Mission Ocean & Waters
The five EU Missions — Cancer, Soil, Climate, Smart Cities, and Ocean & Waters — are designed to be ambitious and inspiring. They aim to tackle complex societal challenges using a whole-of-society approach, requiring collaboration across disciplines, sectors, and communities. Rather than being sector-specific, these Missions take a problem-oriented approach, mobilizing both resources and people to address the wicked problems of our time. Wicked problems are complex, dynamic challenges that are difficult to define clearly, have no single solution, and where actions taken often generate unforeseen consequences. For Mission Ocean & Waters, the collective goal is clear: Restore our Ocean and Waters by 2030. This Mission opens the door to diverse funding opportunities—not just for conventional ocean science, but for projects of all types and scales that can contribute to this goal. Solutions must be broad, inclusive, and grounded in real-world action.
Wicked problems are such that scientific evidence, or knowledge, alone is not enough to answer them. Problems like climate change, biodiversity loss, and food insecurity are good examples. These issues are global, complex, and often contested—requiring collective action and broader societal involvement. As a result, the way to go about addressing these types of problems and advancing the Missions involves engaging a wider range of social actors, especially of civil society.
This toolbox is not about redefining the Mission; it’s about helping your project contribute to it effectively. The problem has already been framed: Restore our Ocean and Waters by 2030, via three overarching objectives, applied across four regional Lighthouses (European sea and river basins), see Figure 5 below.
The transformation that is needed to achieve the Mission will affect people’s lives both directly and indirectly. Therefore, success hinges on active engagement, not passive acceptance. People must become agents of change, not just recipients of policy. To be meaningful, the Mission’s goals must be: a) known and understood; b) supported at all levels (EU, national, regional, and local), and c) seen as credible, relevant and legitimate.
This approach involves broadening how challenges and solutions are defined — by including diverse forms of knowledge beyond academic science and working closely with local actors. One example is when local authorities use data from coastal citizen science groups as part of ongoing environmental monitoring. In support of this, the Mission sets out eight specific citizen engagement targets, which are listed in Appendix 4.
The objective your project focuses on might not be the most pressing for every community in a given region. Claiming that your goal is ‘the most important’ across a large sea or river basin can hinder citizen engagement —especially among national or international stakeholders/policy makers— and potentially weaken your funding prospects.
So, when using this toolbox, tailor your approach to the local context, and be clear about your focus before applying for funding. This will help ensure you’re asking for the right resources to meet your goals.
By increasing local knowledge, understanding, and concern around the Mission’s objectives, your project can spark bottom-up initiatives that support the broader goals. A collaborative approach —grounded in local relevance— can empower communities across scales, from individuals to policymakers,. To achieve this, consider localizing top-down objectives to enhance relevance; transferring power and ownership to communities; and designing participatory processes linked to real institutions or decision-making bodies. So, in project design we must consider why, who, when and how to engage these different participants.
This toolbox is here to support your project's citizen engagement strategy in line with Mission Ocean & Waters. It offers practical guidance to help you navigate participation goals effectively—so that together, we can restore our ocean and waters by 2030. This is illustrated below in Table 5.
| Expected outcomes by 2025 |
|---|
| Tried and applied deliberative democracy mechanisms and social innovation practices for the co-design and co-implementation of solutions for the restoration of the aquatic environment. |
| Developed and piloted frameworks and processes for participatory governance and deliberative democracy, including an EU-wide network of assemblies to enable effective citizen and stakeholder involvement in the lighthouses. |
| Up-scaled the European Research Area funded pilot citizen science campaign ‘Plastic Pirates – Go Europe’ together with further Member States. |
| Involved the European solidarity corps in restoration projects. |
| Promoted apps allowing citizens to collect data and observations and will promote (digital) data collection and participatory research involving citizens for the monitoring and restoration of ocean and waters; the collected data will be harmonised and made publicly available through the Digital Twin Ocean, EMODnet and/or the Copernicus Marine Service. |
| Provided knowledge and methodological frameworks to support the revision of the International Ocean Governance agenda. |
| Expected outcomes by 2030 |
| All European citizens have the opportunity to engage in the preservation and restoration of oceans and waters through participative means, volunteering and citizen science. |
| All European citizens are empowered to be actors in the preservation and restoration of oceans and waters through social innovation, awareness raising, education and training. |
| Promoted EU-wide annual ocean literacy campaigns, in cooperation with the EU4Ocean Coalition to strengthen public awareness and overcome the emotional disconnect with the ocean and waters. |
| Launched regular citizen science campaigns as a part of novel participatory research initiatives to increase the reach, quality and impact of scientific initiatives and boost the environmental awareness of the participants. |
3.1.1 Why engage with the Mission? The theory and terminology behind post-normal science
Utilising a theoretical grounding to engage citizens with Mission Ocean & Waters will help in your application for funding and maximise the success of your project going forward. The Mission aims to tackle uncontrollable and wicked problems at societal level across Europe, and with it comes a range of challenges and risks associated with engaging citizens.
This toolbox, and specifically the detail provided in this part of toolbox, is based on a theoretical approach called ‘post-normal science’ and has been developed by the PREP4BLUE project team, drawing on their expertise as well as insights from earlier participatory projects, literature and handbooks. Below, we briefly introduce what post-normal science means, along with some key terms. This will help explain why citizen participation is central to the Mission Ocean & Waters agenda and how you can apply it in practice.
In the traditional view, knowledge is synonymous with research or science. Since science is often perceived as objective and autonomous from politics, scientific experts are useful for legitimizing advice and action – for instance in relation to achieving the objectives of Mission Ocean & Waters. This is based on the belief that a strict and formal separation between science and society is both possible and necessary. In this view, science must be ‘pure’ and autonomous to function as an objective source of advice on controversial issues. As such, engaging citizens can be problematic, as this would allow different agendas to influence ‘pure science’. Accordingly, it is necessary to look for other theoretical foundations as the Mission is aiming to including citizens to solve challenges. The theoretical foundation of this toolbox is loosely based on the theory of post-normal science.
The insight of post-normal science goes beyond the traditional idea that science is both certain and value-free. Post-normal science represent a form of science for policy that address issues where facts are uncertain, values in dispute, stakes high and decisions urgent. This philosophy of so-called post-normal science states that for conflict-ridden and complex societal challenges where scientific knowledge is uncertain, democratic approaches are needed to assess what knowledge is relevant, and who manages the validity and relevance of this knowledge (Table 6). This resonates with the challenges that the Mission aims to tackle, including climate change and environmental pollution: what to do, and how to cope with multiple opinions and uncertainties while being under pressure by the public, market forces and political goals?
| Focus on: | Approach using: |
|---|---|
| Solving real-world problems | Issue-driven inquiry |
| Acknowledging uncertainty | Extended peer communities |
| Building mutual trust | Participatory processes |
Post-normal science acknowledges that uncertainty is more than a technical number or a methodological issue. There are of course several ways to distinguish between different types of uncertainty, including uncertainty that can be controlled through quantification and uncertainty that cannot be controlled because these specific problems are sufficiently complex and involve so many competing interests that ‘more’ knowledge will not necessarily reduce the uncertainty in the problem. Uncertainty that cannot be controlled makes the premises for risk analysis unclear and can thus be an additional source of conflict. This may be relevant when the uncertainty cannot be sufficiently reduced with new knowledge. Note that even quantifiable uncertainty can be a subject of conflict. For example, decisions based on quantifiable risk can be fraught with conflict because interest groups can have different preferences for which risk one is willing to take.
The way uncertainty is related to two types of problems is central to this toolbox, and is defined as follows:
- Controllable problem: reducible uncertainty where agreement and consensus on norms are settled. The uncertainty at hand can be described through quantitative measures. Here, normal scientific risk analysis can be sufficient, for example, forecasting for waves and levels of toxins in mussels. See Appendix 3 for a more detailed example.
- Uncontrollable problem: irreducible uncertainty with no consensus and little agreement on norms and standards. Context where simple probabilistic risk analysis or standard statistical methods are not able to fill all knowledge gaps, and we lack knowledge about what we do not know, for example, climate change impacts such as sea level rise and associated consequences including coastal erosion. See Appendix 3 for a more detailed example.
The Mission aims to solve a large number of complex problems that have different types of uncertainties related to them. For the challenges that needs to be tackled to achieve the Mission, we argue that it is useful to distinguish between controllable problems (A) and uncontrollable problems (B). A concept related to uncontrollable problems that is used in the Mission, is the aforementioned ‘wicked problems’ in which high stakes, risks and/or high uncertainty are involved in a policy-relevant issue, a characteristic of the ‘post-normal condition’—that is, a circumstance in which scientific facts and social values are difficult to untangle.
3.1.2 Why engage with citizens? The theory and terminology behind citizens
From the very beginning, the EU Missions have been designed with the underlying principle that their success will depend on the participation of citizens, appropriate to the issue at hand,. This goes hand in hand with the philosophy of post-normal science. There are several reasons why a more participatory approach including citizens can be understood as necessary. One reason is a normative one, often referred to as the ‘deliberative turn’. The deliberative turn is defined as follows in Dryzek, 2002: “The deliberative turn represents a renewed concern with the authenticity of democracy: the degree to which democratic control is substantive rather than symbolic, and engaged by competent citizens.” The deliberative turn argues that we should democratize knowledge and expertise, not only regarding who consumes it, but also who produces it. Hence, participatory approaches are needed to assess what knowledge is relevant and who manages the validity and relevance of that knowledge. In this view, all (not just scientists) can have relevant knowledge and experience that can be useful for the Mission.
The term ‘citizen’ can be quite vague and is used differently across different fields (legal, political), projects, and policy areas. In general, when used in this toolbox, ‘citizen’ emphasises the non-specialist, non-elite nature of the individuals in question. This creates some distinction from the sometimes-overlapping term stakeholder (also often used throughout Mission Ocean & Waters literature). Stakeholders, by contrast, may be either specialist, elite, have access to the Mission activities due to their employment, or some other form of contextual privilege. They also tend to be represented as organisations or interest groups, while citizens tend to be engaged as individuals. That said, the two concepts often overlap and, of course, individual stakeholders can also be citizens, and citizens may be stakeholders. And the tools provided in this toolbox can be applied to either or both.
A number of loosely linked research approaches to what participation entails have developed in recent decades. Here, we understand citizen participation to occur when individuals from diverse backgrounds and expertise engage with knowledge-production and/or decision making in a collective endeavour. This can be a range of activities, including knowledge-production initiatives, political events in which decisions are to be made, or the conception, development and implementation of a societal Mission. Citizen engagement and citizen participation is used interchangeably in this guide. It may also be referred to as community engagement, citizen involvement, public engagement or civic engagement.
Note that citizen participation does not necessarily require formal citizenship, but refers to the general public or residents, in a specific area. Citizen participation is crucial not only to grant legitimacy, credibility and salience to a Mission, but also to realize democratic values and social justice. Moreover, citizen participation allows for a wider and more diversified knowledge base, which is important to cope with the uncertainty and ambiguity inherent to addressing the Mission, and to ensuring the salience of the solutions proposed.
3.2 Types of engagement to consider, depending on risk and desired outcome: Steps of participation from informing to empowering
Before planning any project, leaders like you must ask some key questions to ensure that your goals are achievable. In the case of engaging citizens in the Mission, we should first ask: When should we involve citizens and/or stakeholders? Why are we seeking their participation? And finally—and most importantly—given the type of problem we're addressing or the form of participation we’re inviting: How likely is it that this will lead to meaningful outcomes?
These questions are not only strategic—they are ethical and epistemic. The answers shape whose voices are heard, what kinds of knowledge are valued, and how risk and uncertainty are handled. In complex and uncontrollable situations, such as climate adaptation or health crises, it becomes crucial to reflect on who is included, whose knowledge counts, and how different forms of uncertainty are mapped and negotiated throughout the process—from problem framing to final decisions.
Moreover, in contexts marked by irreducible uncertainty, normative disagreement, and a lack of consensus on standards, open public debate isn't just helpful - it’s necessary. It enhances the legitimacy of the process and ensures that diverse perspectives are accounted for, even when agreement is elusive. A pertinent example is the Covid-19 pandemic, where decisions on public measures had to be made amidst deep uncertainty and competing values. The way participation was handled shaped both the perceived justice of outcomes and the public’s willingness to accept them.
In short, meaningful participation depends not only on when and why we involve people, but on how thoughtfully we navigate uncertainty, inclusion, and legitimacy throughout.
3.2.1 What is citizen participation?
Participation may entail a range of involvements, for example, from differing levels of communication (receiving information or voicing opinions) to directly impacting how a research process unfolds or what the outcomes are. While the avenues for participation vary in function and intensity, it is a widespread agreement that participation should grant a greater degree of power to citizens. The principles of participation are typically illustrated as a ladder which describe a spectrum of engagement depths and their corresponding levels of citizen power (see Figure 6 below). In this toolbox, we visualise the ladder of participation as a matrix to better reflect the relationship between what people can expect with different forms of engagement. In the matrix, increasing levels of engagement means greater citizen power. To the far right of the matrix – or at the top of the ‘ladder’ – citizens have the power to define the problem, develop the solution and the process to get there. Different types of ladders have served as a basis for informing processes of citizen participation and as inspiration for further developing guides for participation.
The matrix can be used to assess the level of engagement for different participatory processes. While there may be good reasons to include citizens, it is important to underline that not all problems require the greatest levels of involvement – this depends on the type of problem at hand. Different types of problems demand different participatory strategies. This toolbox distinguishes between controllable problems—those with clear risk profiles and known solutions—and uncontrollable problems—those characterised by complexity, uncertainty, or ambiguity. In theory however, higher engagement levels and more decision-making power delegated to citizens should lead to greater perceptions of legitimacy and public trust in the decision-making process. Since high levels of engagement requires a substantial commitment by citizens, ensuring the relevance of the problem to be solved is key. Inviting citizens to participate in defining the problem, may thus enhance the success of your citizen engagement initiative.
There are both benefits and limitations to different participatory approaches. For instance, sharing of responsibility (e.g., to ensure that participation is more than lip service), classification of who relevant stakeholders or citizens (together referred to as ‘actors’, due to the parts they play) are, as well as addressing the vested interests and power differences implicated in a given process. In reality, multiple challenges often arise with participatory approaches: who to include and how to include citizens in different processes; are they interested in participating at all? This is often referred to as ‘stakeholder’ or ‘engagement fatigue’ in participatory processes. Reasons for this type of fatigue varies, but is typically related to time constraints, language barriers, different priorities, poor personal reward or little capacity/power to influence decisions.
Risks are an intrinsic part of human life and must also be considered when designing your project. In modern times, many risks that society faces are the unintended consequences of the development and application of new technologies such as global warming and pollution. Other issues are beyond our understanding and control, and uncertainty cannot necessarily be reduced. There are many ways to conceptualize risks. We suggest categorizing different risk phenomena as simple, complex, uncertain and ambiguous risks. These exist on a continuum and should be understood as such also for the Mission-related initiatives. Our knowledge about systems or technologies varies. Simple or linear risks can be described as those that are better understood and easier to model than others and can therefore be better risk managed (if the resources are available). For these issues, one can calculate risks on the basis of established scientific models and historical patterns of performance, for example, weather patterns, sea currents and so on. Other issues are more complex or even uncertain, for example, new technology or tightly coupled systems that increases complexity and non-linearity and hence risk. For instance, the effects of new fisheries gear technology on the ecosystem can cause effects that were impossible to predict. With ambiguity, we here refer to the plurality of legitimate viewpoints for evaluating decision outcomes and justifying judgements about their tolerability and acceptability. Note that with new knowledge, methods and experience, a risk may change from ambiguous to any of the other categories. The Covid-19 pandemic is an example of an ambiguous risk which is (better) controlled with new knowledge, experience and methods. How to judge the different types of risk are culturally contingent – they are cultural products since they depend on perceptions about what is probably, unlikely, serious or absurd. Accordingly, there is no one correct answer or interpretation of risks, nor solutions.
3.2.2 Visualising your project as steps of participation: From informing, to empowering, considering project goals and risks involved.
In order to support the process of choosing what type of involvement is necessary for different Mission-related problems, we will use the two types of problems introduced in Section 3.1.1. above; A) controllable and B) uncontrollable problems, as a rough diagnostic tool. The more uncontrollable the problem that a project is tackling, the more ambiguous the scope of risk becomes, and the type of participation we require can be related to this continuum – in the type of knowledge we require, the relevant actors to provide it and ultimately the level of participation. We particularly recommend active, two-way participation when dealing with uncontrollable problems—especially because these situations often require involving different types of actors, depending on the nature of the problem.
To help with this, we propose a diagnostic tool to help visualise the ‘steps of participation’, from informing to empowering participants, which can be defined to reflect the type of information a problem or project requires; from which relevant actors. Figure 7 below helps to visualise the concept that controllable problems are related to simple risk and can be used to help assess when it is most appropriate to inform, consult or empower citizens. Uncontrollable problems span a continuum of complex, uncertain, and ambiguous risks. The goal of engaging citizens in the Mission is to empower them to take responsibility and action toward the overarching aim: restoring our ocean and waters. But The Mission itself is a complex and uncontrollable challenge, with a broad and sometimes ambiguous scope of risk. So, where do different parts of your project fit along this continuum, and what ‘step’ (or steps) of the citizen participation ladder should you be aiming for?
Note that citizen participation is always possible at all levels of risk. The controllable problem goes down a continuum to uncontrollable problems from the left to right; while the expected level or type of participation is illustrated going from the bottom up. If the expected participation is knowledge input as one-way information (inform) it suffices to include scientists in the participatory processes. Moving further to the right towards uncontrollable problems, the expectations for the type of participation changes and involves consultations with civil society, including feedback to the process to scientists/policy makers. This depends on the problem at hand, however, as practice experts such as fishers, farmers, etc., may have relevant knowledge input.
3.2.3 Managing expectations of citizen participation
Two of the expected outcomes of Mission Ocean & Waters with respect to citizen participation includes the application and development of deliberative democracy mechanisms – that is, the inclusion of citizens in deliberative processes (Table 5). In this section we will briefly address common expectations of what can be achieved by participatory processes and the already mentioned deliberative turn (see Section 3.1.2).
In general, deliberative democracy has faith in consensus and that “public reason-giving is the best way to uncover what is good and true”. The deliberative turn has been criticized by many, and it is important to maintain realistic expectations of what can be achieved and what challenges can arise. One assumption of deliberative democracy is that broad participation in decision-making will bring about more legitimate and effective policy outcomes. For example, ensuring citizen participation in Mission Ocean & Waters initiatives should lead to increased legitimacy. But legitimacy is difficult to measure since it is not directly observable; and even if something is perceived as legitimate, it can be both inefficient and inequitable. Another assumption is that broad participation will ensure consensus. But failing to acknowledge dissensus can lead to shallow or disappointing outcomes,, especially in the post-normal context (see Table 6), and when the end-result creates winners and losers,. Hence, we warn against holding consensus as the ‘holy grail’ of success. Still, one can aim for consensus as an elusive target but create a space in which there is high tolerance for respectful conflict. Such an approach involves making explicit the multiple values underlying the conflict, as well as generating an atmosphere of respectful disagreement. As such, arenas for participation should be organized in line with the ideals of deliberative democracy, even if they may be hard to put to work in real life. For instance, it is an ideal that that the deliberation process between citizens should take place in a space free from manipulation and the exercise of power. However, people will have different relations to each other and the authorities no matter where you are and who you place together – some will have formal power, and some will have informal power.
3.3 Who? Tools for helping to decide which citizens to involve, and why
In this section we describe the process to be taken after deciding what level of participation is needed. The advice provided here is based on experiences from participatory processes realized in several projects.
As addressed in the previous sections, there are many good reasons for supporting citizen participation, and it is important to think critically about which level of participation is necessary and what expectations will come along with each concrete case. Citizen participation has some practical and analytical weaknesses which are important to consider. For instance, it is practically impossible for all citizens to participate directly in workshops or meetings; most people have little time and no desire to participate in technical decision making such as wave forecasts.
Thorough preparation in advance of actual instances of citizen engagement is crucial for successful implementation. The complexity of socio-environmental-economic challenges of our times have led to increased demands for citizens to participate in decision making, policy production, governance, and research. While this is positive from a democratic and social justice perspective, demands for time and engagement from citizens are increasing. Therefore, it is essential to carefully consider the reasons for calling citizens to participate, as well as how their engagement will unfold. This mitigates ‘engagement fatigue’ and lays the ground for a more productive and successful process. The guiding reflection questions in Table 7 are meant to support in the preparations and considerations for citizen participation initiatives.
A key aspect of preparation is relationship building and communication with the target community/stakeholders. This is essential to ensure that the future process is understood and requires more than sending periodic email updates, invites and reminders. For example, community leaders and key stakeholders could be identified, sought out, and engaged in some preparatory activities like stakeholder mapping of specific target groups, or communication strategies to the general civil society. Trust is built through such interactions as well as (perhaps especially) the informal chatting that takes place around such activities. Such an approach creates partnerships with key stakeholders, community leaders, or local figureheads that can be tasked with promoting the future engagement process themselves. This usually leads to much deeper engagement from the target community, a better understanding of the issues as people themselves verbalise them, and generally a more successful process.
3.3.1 Guiding Questions
It is important to consider several aspects including:
- Power – focus on who is in a position to influence in the given context. Power can take different forms: a) Utilitarian power is based on control over material resources or incentives (e.g., funding agencies, industries with economic leverage); b) Normative power stems from moral authority, cultural values or perceived legitimacy (e.g., environmental NGOs, Indigenous communities); c) Coercive power involves the ability to enforce rules or impose sanctions (e.g., regulatory bodies, law enforcement). It is equally important to identify actors who may lack power yet are deeply affected by the issue at hand.
- Legitimacy, focusing on who has a legitimate right to influence. This can be based on tradition (fishers, for instance) or employment (aquaculture, for instance), how representative they are (formal vs informal).
- Urgency/need for immediate attention
- Economic status. Stakeholders can have an urgent need to influence problems that have an irreversible element (threaten life, reduce quality of life, threaten economic security, threaten biodiversity, or destroy cultural heritage). This aspect also includes vulnerable groups; and
- Practicalities: in general, practicalities cannot be ignored since budget, time and practical consideration will limit the selection of stakeholders. This includes issues such as: what is realistic? Do we have easy access to stakeholders? Are stakeholders willing to participate? Are there any risks?
Table 7 below provides some guiding reflection questions to help prepare your project. It is not meant to lead to a final answer, rather to instigate reflections and guide the process of defining your goals for citizen participation.
| Guiding questions/suggestions | Comments | |
|---|---|---|
| Framing your project | What is the focus area of the project? | For instance, coastal zone planning or waste disposal? |
| What type of problem are you dealing with? | Controllable / Uncontrollable (See Part 3, Section 3.1.1 if you are uncertain) | |
| What is the scope of risk? | Simple/complex/ uncertain/ambiguous (see Section 3.1.3 and Figure 7). | |
| What do you hope to obtain by including citizens in your project? | Define your goals, objectives and expected results, for different parts within your project. (see participation goals in Figure 6) | |
| Planning who should participate | Map your participants, to define the different relevant actors you need to provide different types of input, at different levels of participation. | See Figure 7 and use the participant mapping template below (Table 8) to guide this. More detailed stakeholder mapping tools are available in Appendix 1. |
| Consider the Leave No One Behind principle | After mapping your participants, consider who might be left behind? Why? And is it appropriate to try to overcome these barriers of engagement? If so, how? | |
| If activities have a high level of complexity in terms of engagement, you may divide them into sub-problems with corresponding sub-activities | This will allow stakeholder identification and engagement at sub-activity level. | |
| Place activities in a timeline. Do some activities depend on the implementation of other activities? | At what stage should citizens be engaged in my project? Consider barriers, including stakeholder fatigue and external demands on their time. | |
Pre-planning for evaluation What is your desired impact? | Consider methods carefully | Are the methods selected appropriate? (see Part 5). |
| How will you know if planned engagement and methods are working well? | Think about essential metrics early – will you evaluate this qualitatively or quantitatively? | |
| What is the desired impact of the engagement process on project results? | How will you evaluate this? You can use different types of tools to gather this information e.g., e-mail, survey or workshop. | |
| What is the desired impact of engagement for participants? | How will you evaluate this? You can use different types of tools to gather this information e.g., e-mail, survey or workshop. | |
| How can you learn through the project, review and adapt methods / approaches / participants? | How? |
3.3.2 Participant mapping
Mapping participants (Table 8 on the following page) is important in order to get an overview of who you aim to include, and who you actually manage to include. Given the Leave No One Behind principle, effort should be taken to ensure gender and equality issues are reflected upon. For instance, if you are alone with small children, it can be difficult to participate in meetings during the afternoon; and if you don’t have a car, you may not travel far, and there may be identity/religious/historical reasons for avoiding buildings such as churches. It is also important to consider the ethics of their inclusion, whether it is appropriate to ask for their time and whether your method of inclusion or dissemination may fuel local conflict, which could risk the success of the project or reputation of your problem.
A more detailed stakeholder mapping template, which considers power and legitimacy more thoroughly, is available in Appendix 1.
| Participant type | Name | Organization, network or interest group | Contact details (e-mail) | Brief summary of their stake or agenda | Motivation to participate | Type of input required (knowledge / experience & reflections / co-production and responsibility) | Level of participation (inform, consult, involve, collaborate or empower) | Where in project do you need participation? | When? | Barriers to participation? | Ethical considerations | Engagement types / method? |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Intergovernmental | ||||||||||||
| Public National | ||||||||||||
| Public Regional | ||||||||||||
| Public Local government | ||||||||||||
| Sub-local | ||||||||||||
| Private sector | ||||||||||||
| Non-local NGO | ||||||||||||
| Citizen | ||||||||||||
| Who might be left behind? |
3.4 How? Tools for planning implementation
This section covers a range of different citizen engagement tools with explanations of the step-by-step process of implementing them (preparation, during and after). Many of the methods may apply to both stakeholder and citizen engagement, as these terms often overlap. According to your Mission Ocean & Waters initiative and the problem you are to solve, some tools are more appropriate than others, and this toolbox is not exhaustive. Therefore, we recommend reflecting on the guiding questions of Section 3.3.1 before deciding on your chosen method. We also suggest exploring the wide range of stakeholder engagement methods guides that are available online,.
When implementing a method, it is important to consider the power relations between organizer/researcher and participants, and between participants (when using tools that involve several citizens) (see detailed stakeholder mapping in Appendix 1). When inviting citizens to participate, think about the location that you choose for your activity. Aim for a place where participants feel comfortable. For each tool, we encourage you to reflect on the principle of Leave No One Behind (LNOB) and aim for inclusion and diversity in your informants.
Methods included in this toolbox (see Part 5, Sections 5.1 to 5.7):
- Survey
- Citizen’s assemblies
- Future scenario workshop
- Semi-structured interviews
- Walking interviews
- Participatory mapping
- Strategic ocean literacy as a way of working
In developing an engagement strategy, several key questions need to be addressed – a list of questions that can be useful for choosing the specific tools is provided in Table 7. Table 9 may also guide you in choosing a tool, depending on the type of problem you are dealing with, and the level of participation you are aiming for.
In Table 9 below, the participation level depends on how your project decides to involve the citizens in the process and the level of decision-making power delegated to them. That means that how your Mission Ocean & Waters initiative decides to incorporate citizen input, will determine the level of participation pertaining to each tool. For instance, if you decide to implement a citizens’ assembly, you may also delegate decision-making power in the form of voting, to the participants.
| Problem type / participation level | Controllable problem | Uncontrollable problem |
|---|---|---|
| Inform | Newsletters, flyers, campaigns, websites, social media etc. (traditional ocean literacy) | |
| Consult | Survey , Citizen’s Assemblies | Future scenarios , Semi-structured interviews , Walking interviews , Participatory mapping |
| Involve | Citizens’ Assemblies , Ocean literacy | Future scenarios , Participatory mapping |
| Collaborate | Ocean literacy | Citizens’ Assemblies , Future scenarios , Participatory mapping , Ocean literacy |
| Empower | Ocean literacy | Citizens’ Assemblies , Future scenarios, Ocean literacy |
3.5 Why? Tools planning for impact – monitoring and evaluating citizen engagement
Evaluating the effectiveness and type of the engagement in some way is an important part of the engagement process. Monitoring and evaluating citizen engagement will provide important results, including help planning, learning from the experience, evidence to demonstrate to participants how their effort matters and evidence of value of the research process and research output . Which can, in turn, improve the engagement process.
Recall that in theory, civil society can be included in all type of projects/issues (e.g., defining project goals, knowledge production, advisory processes, and with different degrees of responsibility) with different levels of involvement (e.g., ownership, responsible, collaboration, exclusion). The point of monitoring and assessing citizen engagement is to illustrate how different methods will result in different levels of participation, and that critical reflection about the purpose of participation in any given project is useful. It is key to any participatory project to be explicit about what the aim of the participation is in order to avoid accusations of lip-service rather than real participation.
Monitoring and assessing the engagement processes for the Mission can take various forms. Inclusive and transparent practices are essential. The purpose of the monitoring and assessment exercise should be taken into consideration when choosing the monitoring design. Note that this is also a step that can be a matter of co-creation, reflecting relevant, recognizable, achievable and tangible results. In initiatives which seek to collaborate with or empower citizens, participatory monitoring and evaluation may be most suitable. It is important to consider whether it is the outcomes/impact of the engagement process or the process itself that ought to be evaluated, or both.
Accordingly, two main categories of evaluation can be highlighted:
- Summative approaches that focus more on the outcomes than on the process. For example, to demonstrate to participants how their contributions have been adopted in the Mission perspective. For this purpose, both quantitative and qualitative data can be useful.
- Formative approaches that focus on learning from the engagement process. For example, to describe and illustrate why and how the engagement process did/did not work. In addition, it is important to consider participants perspectives and how they view the outcomes and process.
There are different stages of evaluation: from the outset, throughout the process and final evaluations. Exactly when evaluation should take place is hard to define on general terms, but overall, it is important to consider and plan for monitoring and evaluation early. There is no one-size-fits-all solution, but in the following we describe some important aspects and provide some tools to monitor and evaluate citizens engagement.
Ideally, before inception or very early on in your project, you have considered the guiding questions provided in Table 7 (Section 3.3 above). Recall that as different Mission Ocean & Waters initiatives will aim to solve a variety of problems, they will all require different levels of participation and will relate to different contexts. Using the same tables before, during and after project start can be useful to reflect on your aims, and to better be able to evaluate whether those aims are met during and after the project start. Constant reflection and adaptation are keys to success in co-created projects. So regularly revisit the answers you gave in Table 7 and Table 8, in conjunction with Table 10 to plan your re-iterative evaluation strategy below. Examples of how these tables can be adapted and used are provided in Part 4.
| What do you want to know? | What evaluation methods will you use? | How will the evaluation be conducted? | |
|---|---|---|---|
| Planning process | |||
| Engagement | |||
| Benefits/outcomes |
3.5.1 Evaluation in relation to Mission Ocean & Waters
It is useful to note, that funders often require funded projects to provide a high level, summative evaluation of their approach and impact on wider society that specifically focus on aspects of their funding criteria. As we focus here on supporting the goals of Mission Ocean & Waters, Appendix 4 provides a useful tool for planning and mapping your subsequent impact at high level on The Mission target outcomes, objectives and overarching goal. This simplified way of mapping can be adapted for any project goal, at any level.
For more specific evaluation, we provide two additional tables below that can be adapted to evaluate your impact towards Mission Ocean & Waters:
- Table 11: Example of a table for evaluating outcomes in Mission Ocean & Waters initiatives (adapted from Warburton et al. 2025). The table below is filled out as an example of use.
- Table 12: Table for evaluating citizen engagement at different stages of Mission Ocean & Waters initiatives, with example applications. A detailed example of its use is provided at the end of this Section.
| Goals/purpose of your Mission initiative | Possible Indicators for your initiative | How to obtain data for your initiative | Important assumptions for your initiative |
|---|---|---|---|
| To better inform stakeholders and the general public | Increased understanding and awareness | Questionnaires and interviews with participants before and after the process | That both the awareness and willingness to engage are as a result of the engagement activity, rather than any other factors. |
| Willingness to participate in the future | Questionnaires and interviews after the process, and follow-up interviews at a later date |
In Table 12 on the following page, the axis should be adapted according to your needs. Here, the horizontal axis is related to the stages, and for each of these you should reflect on the depth of engagement. This should be compared to the aims of engagement at the outset of your initiative. The vertical axis is related to Figure 7, the steps of participation.
| How are citizens involved in your initiative? | Stages in your Mission Ocean initiative: | |||||
|---|---|---|---|---|---|---|
| Eg: Knowledge-based policy making process, e.g. engaging fishers in contributing data for fisheries management | Planning /design | Data collection | Data analysis | Advice | Management | |
| Eg: A context outside policy-making, such as local habitat or species restoration projects | Design / creation | Develop-ment | Implemen-tation | Monitoring | ||
| Add your initiative here | Stage 1? | Stage 2? | Stage 3? | |||
| Depth of citizen involvement | Active (involve, collaborate, empower) | |||||
Responsive (consult) | ||||||
| Passive (inform) | ||||||
Examples of how these can be adapted and used are provided in Sections 4.1 and 4.2.
3.5.2 Evaluating impact on societal ocean literacy
Increasingly, funding calls related to the Mission ask for ocean literacy to be embedded within the project. As a result, Appendix 4 provides a simple planning template through which you can plan the goals and anticipated outcomes of your ocean literacy activities and prompts to help start thinking about the best methods of evaluation. Figure 8 gives an example of how this can be used to inspire planning your activities around the known dimensions of ocean literacy (presented as a method in Section 5.7, Figure 13) and suggestions of ways to start more detailed formative evaluation.

