Annex C: Package of NRA Tools (World Bank, International Monetary Fund, Council of Europe)

Publication details

Language

English

Country
Topic

World Bank Tool

A combination of threat and vulnerability at the national and sectoral levels. Threat for ML is a function of proceeds of crime, including those generated by predicate offences and international criminal flows. Analyses predicate offences, typologies, materiality of sectors and other factors. 

Inherent and residual risk concepts do not exist in the World Bank’s Generic NRA Tool. Instead, it has “inherent vulnerability” and “final vulnerability” concepts. The “final vulnerability” is a weighted average of inherent vulnerability and deficiencies in AML controls. Therefore, the AML controls impact the risk level as a part of vulnerability, and the final “risk” levels generated by the tool are “residual risk”. As an extension of NRA tool, recently the World Bank has developed a risk monitoring framework for the supervisory authorities. This tool generates both inherent and residual risk level of reporting entities in a sector.

The tool does not include likelihood as a standalone element in risk assessment. However, likelihood is integrated in the design of the vulnerability modules. Likelihood is the basis of Bayesian Networks. The vulnerability modules of the World Bank tool use “cause and effect " and a logical sequence of events like in Bayesian Networks, but they use weights and conditionality instead of probabilities.

Included as part of threat and vulnerability assessment rather than as a separate assessment. The methodology assumes that higher threats and vulnerabilities will also lead to higher consequences. In the tool there is an optional template for the assessment of consequences.

Vulnerability ratings are calculated by the tool based on assessment inputs, as well as the built-in model assumptions, weights, and pre-conditions. Weight and preconditions can be changed by the user countries based on a justification. Threat ratings are determined by expert opinion, which should be supported by qualitative and quantitative information. Pre-defined indicators are provided. In the threat assessment countries can add or change indicators, while this is not possible in vulnerability modules. Threat rating and vulnerability rating are combined in a matrix to give the country's overall risk rating. A second matrix is generated to illustrate the sectoral risks.

Self-assessment tools - country coordinates the stakeholders, collects and analyses the information and data, conducts the assessment, fills in the excel templates and documents justifications and evidence for their views. The country is expected to collect the data on ML cases and typologies, proceeds of crime, capacity and effectiveness of government agencies, activities and compliance of reporting entities.

Provides the tool and excels for completion by country. Provides training, guidance, and review of materials. Risk assessment is done and owned by the country. Countries can have references to the World Bank tool but cannot use the name or logo of the World Bank on their assessment reports or any other documents. Also, these documents should include a disclaimer that explains the limited role of the World Bank team in the assessment. The tool is publicly available, and countries can use the tool without WB technical assistance.

Matrices of overall ML risk in a jurisdiction based on threat and vulnerability, and heatmap of sectoral risks. Country drafts the NRA. The World Bank also provides a risk-based action plan template and guidance on it. The action plan should be completed by the countries.

World Bank Useful Links

Source: Graphic provided by the World Bank

Source: Graphic provided by the World Bank

Source: Graphic provided by the World Bank

International Monetary Fund (IMF) Tool

Source: IMF

Likelihood of ML events occurring successfully multiplied by the consequences of those events.

Methodology measures residual risk ("net risk") - risk remaining after taking into account preventative/mitigating measures and how they reduce risk. The absence of poor controls cannot increase inherent risk, good controls can only reduce it.

 Derived from risk analysis modules containing factors, sub-factors, and their indicators. Uses quantitative (data and objective) and qualitative (subjective and perceptions based) indicators from public and private sources. Each module is scored on a 7-point scale, with higher scores equating to higher likelihood that substantial ML abuse will occur successfully.

Short- and long-term impact of ML abuse successfully occurring. Derived primarily from perceptions of officials, using a structured approach to make informed judgments. Short-term = minimising successful ML over 12-month period, used to analyse sector risk. Long-term = effect of likely level of successful ML on various social/economic/political objectives.

Semi-qualitative focusing on key risk events associated with ML which make a difference to risk profiles. Authorities can add risk events to this.

Requires countries to establish an NRA coordinating mechanism and determine the objectives of the NRA exercise. Surveys on data availability and domestic and transnational ML threat. Fill in Web-based tools providing statistics, and perceptions on the threats, vulnerabilities and consequences in the country. The national authorities are responsible for drafting the NRA.

The IMF provides all data collection tools, the raw analysis, data and a template for the written report. Conduct research into country's proceeds of crime environment and threat indicators. Run capacity-building workshops with authorities. Collect publicly available information on vulnerabilities and threats to generate preliminary risk level rating, collect publicly available information on consequences. Provides a technical assistance report to the country that describes the risk assessment process used and formally conveys the results of the analysis conducted. 

Domestic proceeds of crime table. Summary risk matrix. Heat maps for risk events (generic and identified by authorities). Summary tables for sectors and entities. NRA document itself.

Useful Links

Please note that IMF tools are not currently public. Links will be shared when available, in the meantime please contact the IMF for further information.

Council of Europe (CoE) Tool

A combination of the probability and scope of the consequences - in alignment with ISO Standard – Risk Management Vocabulary. In the ML/TF context, risk is defined as the effect of criminal ML/TF capabilities on financial, economic and social objectives.

Inherent risk refers to the ML/TF initial risk that exists before any control is applied to address or reduce the impact of that risk. Residual risk refers to the level of ML/TF risk that still exists after taking account of both the controls applied to mitigate them and vulnerabilities that may aggravate or maintain the level of risk present. Residual risk refers to the level of risk based upon which country must then determine, based on its risk appetite, the risk treatment it will apply to address those which it determines to exceed its risk appetite.

The judgement on likelihood is proximate to the judgement of the frequency at which criminals may undertake ML taking into account their knowledge and ML skills (based on typologies of cases and precedence) and the strength of preventative and recovery controls. The assessment uses quantitative (data and objective) and qualitative (subjective and perceptions based) indicators from public and private sources.

Short- and long-term impact of ML abuse successfully occurring. Derived primarily from perceptions of officials, using a structured approach to make informed judgments. Consequences are assessed based on the effect of likely level of successful ML on various social/economic/political objectives summarised across several impact areas of national and cross-border relevance (e.g. security and rule of law, social, international finance, etc.).

The CoE NRA and Sectoral Risk Assessment (SRA) methodologies are supported by tools which assist in aggregating initial data to assess inherent risks, support the selection of appropriate scores for likelihood and consequence and evaluate controls and vulnerabilities, to determine final residual risk ratings. The tools are designed to provide both visual and quantitative findings, allowing users to drill down into specific threats and risk areas, as needed. The tool allows users to adjust their own scoring, providing transparency and the ability of customising the rating process, where needed.

Country “owns” the assessment process, leading the establishment of national coordination groups, the identification and collection of data and information and soliciting the active participation of stakeholders from the public and private sector during the assessment process. 

CoE support is provided through training on how to use the methodology, set up scoring, tool usage, moderation of focus group sessions and to provide “troubleshooting” support throughout the assessment process, as needed. Additional support provided, as requested, for review of draft reports and formulation of preliminary action plans, to reflect both country’s risk appetite and overall risk-based approach towards mitigation of ML/TF risks.

ML/TF NRA Report with interactive matrix and heat map showing preliminary and final assessment results; summary tables to support concise recording of findings (“risk events”) from each risk area assessed. Risk mitigation and monitoring tool (basis for the Action Plan) template is integral part of the Methodology.

Useful Links

Other sources for consideration

NRAs and sectoral/thematic risk assessments that have been sent to the FATF Secretariat by delegations can be found on the RTMG Community workspace: Library of ML/TF/PF Risk Assessments (this link is not public).

Countries should assess the reliability of all sources consulted and be aware of potential biases. As stated throughout this guidance, sources listed are non-exhaustive and should not replace data collection and analysis on a national level. Rather, the goal is to provide a variety of sources for background information that can support jurisdictions in the initial stages of research on their risks. This list is non-exhaustive.

Footnotes

[113] Non-exhaustive list of methodologies developed by the CoE ECCD: ML/TF NRA Methodology, PF NRA Methodology, Sectoral VA and VASP ML/TF risk assessment Methodology, Sectoral TF NPO risk assessment Methodology, Legal persons and legal arrangements ML/TF risk assessment Methodology, ML/TF sectoral methodologies for different sectors of DNFBPs, Organised crime ML/TF risk assessment Methodology, Cross-border ML/TF risk assessment Methodology. All these methodologies comprise data gathering and data analysis tools and are applied on non-for-profit basis, with the support of the CoE ECCD.

[114] Countries should not take such reports at face value, and to evaluate the reliability of the source. These are shared to build background information and understanding.

[115]  Ibid.

Publication paragraph text

Translated documents

Related materials