Internally generated data
Each FSC-certified forest must have an annual assessment carried out by an FSC-accredited certification body. In the event that forest management does not meet FSC requirements, corrective actions are requested by certification bodies for forest managers to gain, or maintain, FSC certification. Such actions are called corrective action requests (CARs).
CARs focus on several indicators related to FSC standards, such as ecosystem services, biodiversity, health and safety, etc. For each certification assessment, certification bodies produce a report that contains information about the certified forest management unit, including CARs that have been issued.
We make these reports available in the FSC certificate holder database to allow anybody to access information from certification assessments. The analysis of CARs provides some insights into the impacts resulting from FSC certification. Examples of CARs analysis conducted by independent researchers can be found below.
Podcast
Forest for the future podcast series. Episode 10: Showing the impact of FSC and linking with the research community, interview with Evaluations and learnings officer Franck Troillet.
11.09.2020. How do we make scientific research accessible for ourselves and our stakeholders? That is the focus of this episode featuring Franck Troillet, our Evaluations and learning officer. Franck will let you into his world of impact dashboards, research databases and scientific reporting.
Monitoring Performance and Outcomes
Independent scientific research
With the Impact Dashboard, we offer the possibility to navigate through a compilation of isolated results from scientific studies about the outcomes of FSC-certification across the world’s forests. This interactive and user-friendly tool has been developed with the software Tableau.
FAQs
-
Why an Impact Dashboard?
With the growing pressure on the World’s forests and increasing demand for undisputable proof of positive impact, the ability to verify and communicate outcomes of certification is central to FSC.
It is also important for FSC to understand the effects FSC-certification has on the ground to facilitate future learning and to enable informed and impact-oriented decision making as part of FSC developments, e.g. in the standard setting processes.
FSC has been collecting and analyzing a wide range of scientific studies about FSC over the years as part of monitoring and evaluation activities. To increase internal and external access to the relevant information they contain, we have decided to collate single results from scientific studies to provide a comprehensive but easily accessible list of evidence of the outcomes of FSC-certification.
-
Which scientific studies are covered by the Impact Dashboard?
The scientific community produces a great diversity of studies about the FSC-system, covering various topics and using different scientific methodologies.
For the Impact Dashboard, we decided to focus our selection on studies comparing forests and their values in FSC-certified and uncertified forests. These are the most relevant research papers to allow FSC staff and stakeholders to learn from the effects of FSC-certification.
-
How have we dealt with the varying levels of scientific robustness?
Learning from science requires understanding how to interpret results and what can be learned. This is closely dependent on the type of research design used.
Researchers can use various research designs in the field. They are not all equally robust and do not provide the same level of scientific evidence to draw conclusions about the effect of certification.
We have used an evidence typology which classifies studies according to their research design and help define whether results can have been caused by or are just correlated with certification. This evidence typology has been initially developed by the VIA initiative and is currently used as a guiding methodology for the Evidensia platform and the Conservation Effectiveness initiative.
Using this typology we have been able to divide results into stronger and weaker evidence, allowing us to show more data while still being transparent about the strength of each data point.
-
What are the different categories in the evidence typology?
Below are the definitions for the different research designs:
Empirical study - Randomized controlled trial (RCT): A study that evaluates the outcomes/ impacts of FSC-certification by comparing FSC-certified forests and uncertified forests, before and after an certification, and in which the observations are assigned into certified and uncertified categories randomly, in order to balance the covariate distributions of observed and unobserved factors and eliminate potential biases. RCTs are rare because certified operations are likely not a random selection of forests (selection biais), thus randomization is often not possible. Such studies can show causation between FSC-certification and the outcome, and wording such as “as a result”, “caused”, “lead to”, “reduced”, “increased” can be used.
Empirical study - With matched control, data collected post-certification: A study that evaluates the outcomes/ impacts of FSC-certification by comparing FSC-certified forests and uncertified forests at one point in time after certification, with covariates considered through matching. Matching is done during the development of the research design so that the units of comparison (e.g. forests) are as similar as possible in most important aspects and ideally differ only in terms of the presence of certification status. The matching process ensures that contextual factors other than certification are not influencing the findings. Such studies can show causation between FSC-certification and the outcome, and wording such as “as a result”, “caused”, “lead to”, “reduced”, “increased” can be used.
Empirical study - Control not matched but some confounders taken into account - data collected post-certification: A study that evaluates the outcomes/ impacts of FSC-certification by comparing FSC-certified forests and uncertified forests at one point in time after certification, with consideration of some confounders. Confounders, also called covariates or confounding variables, are factors likely influencing the outcome of the comparisons. They are considered and/or quantified during data collection and integrated into statistical analysis. In some circumstances, statistical analysis can isolate and quantify the effect of each variable and covariable. Such studies can show correlation between certification and outcome relatively reliably, especially in cases where the system is well-understood and most of the potentially biases are measurable. The following wording can be used: “is associated with”, “was found to have”, “is correlated with”, “even when [confounding variable x and y...] are taken into account, certification is correlated with”.
Empirical study - Control not matched, data collected post-certification: A study that evaluates the outcomes/ impacts of FSC-certification by comparing FSC-certified forests and uncertified forests at one point in time after certification, but without consideration of confounders. This type of study can potentially show a true correlation between certification and an outcome, however, it is possible that unknown mechanisms in fact drive the correlation, such as self-selection or another type of systematic bias. Wording that implies any type of causation cannot be used. Instead, wording such as “is associated with”, “was found to have”, “is correlated with” can be used.
Empirical study - No control, data collected before and after certification: A study that evaluate the outcomes of certification in a certified forest but without comparing with an uncertified unit. This type of study compares outcomes before and after certification has been implemented. As a result, it is difficult to assign any outcomes to the actual implementation of the intervention. However, such studies can be very useful in providing an understanding of the potential mechanisms that could link an intervention and outcome. Wording that implies any type of causation cannot be used. Instead, wording such as “was found to have” can be used.
Empirical study - No control, data collected post-certification: A study that evaluate the outcomes of certification in a certified forest but without comparing with an uncertified unit, nor with the status before certification. As a result, it is difficult to assign any outcomes to the actual implementation of the intervention. Such studies have a descriptive profile and do not allow generalization. Wording that implies any type of causation cannot be used. Instead, wording such as “was found to have” can be used.
Empirical study – Qualitative: Empirical, observational description of the cause and effect of an intervention without a sample-based measure of change or difference.
Modelling study - Two scenario comparison: A study that use empirical information about FSC certification to model or extrapolate outcomes of two scenarios at a broader scale or on other dependent variables.
-
How do evidence types relate to levels of scientific evidence?
We have classified studies according to their research design along an evidence typology when utilizing them for the Impact Dashboard.
The following table summarises the evidence types that can be found in the Impact Dashboard and the associated categories of level of evidence:
Evidence type Relative level of evidence Empirical study - Randomized controlled trial (RCT) More robust Empirical study - With matched control, data collected post-certification More robust Empirical study - Control not matched but some confounders taken into account - data collected post-certification Weaker Empirical study - Control not matched, data collected post-certification Weaker Empirical study - No control, data collected before and after certification Weaker Empirical study - No control, data
collected post-certificationWeaker Empirical study - Qualitative Weaker Modelling study - Two scenario comparison Weaker
Research engagement
FSC supports independent research that investigates the effectiveness of its system by providing researchers with access to relevant information (e.g. where to find FSC-related policies, identification of key stakeholders for interviews) and creates dialogue between individuals and groups.
We welcome any draft manuscripts related to FSC prior to publication or submission to scientific journals, for fact-checking and to provide other feedback (e.g. terminology).
Documents
FSC conducts monitoring and evaluation activities intended to help businesses understand our system and the impact it delivers. We produce yearly reports that demonstrate how we are contributing towards the social, environmental, and economic welfare of forests and communities. These reports also showcase ongoing research projects that assess the effectiveness of the FSC system.