View source for Application of multi-criteria decision analysis methods to comparative evaluation of nuclear energy system options

==Summary==
The International Project on Innovative Nuclear Reactors and Fuel Cycles (INPRO) was established in 2000 to help ensure that nuclear energy is available to contribute to meeting the energy needs of the 21st century in a sustainable manner. INPRO focuses on key issues of global sustainability of nuclear energy, with the aim of assisting in the development of long term nuclear energy strategies.<br>
This brochure presents the main findings of the INPRO collaborative project ‘Key Indicators for [[Nuclear_Energy_Systems#Innovative_Nuclear_Energy_System|Innovative Nuclear Energy Systems]]’ (KIND). It was undertaken within the INPRO area on ‘global scenarios’, which analyses regional and global nuclear energy scenarios to achieve a global vision of how nuclear energy could be sustainable within the present century. <br>
The project was implemented in 2014–2017 by experts from 16 IAEA Member States. The final report of the project was published in the IAEA Nuclear Energy Series in 2019<ref name=r1>INTERNATIONAL ATOMIC ENERGY AGENCY, Application of Multi-criteria Decision Analysis Methods to Comparative Evaluation of Nuclear Energy System Options: Final Report of the INPRO Collaborative Project KIND, IAEA Nuclear Energy Series No. NG-T-3.20, Vienna (2019):[https://www.iaea.org/publications/12373/application-of-multi-criteria-decision-analysis-methods-to-comparative-evaluation-of-nuclear-energy-system-options-final-report-of-the-inpro-collaborative-project-kind].</ref>.<br>
The KIND collaborative project developed guidance and tools (the approach) for comparative evaluation of the status, prospects, benefits and risks associated with the development of innovative nuclear technologies for the more distant future. It also examined the applicability of such an approach to other problems, including those of interest to technology users and newcomer countries. The approach is based on a limited number of key indicators in subject areas of the INPRO methodology for NES sustainability assessment and the application of state of the art judgement aggregation and sensitivity/uncertainty analysis methods.<br>
Within the KIND collaborative project, a number of case studies were carried out on comparative evaluations of hypothetical [[NES|nuclear energy system (NES)]] options, namely, NESs based on pressurized water reactors (PWR), heavy water reactors (HWR), sodium cooled fast reactors (SFR), lead cooled fast reactors (LFR), molten salt reactors (MSR), accelerator driven systems (ADS) with associated fuel cycles, as well as on comparative evaluation of nuclear energy evolutions scenarios and nuclear versus non-nuclear energy options. These case studies demonstrated applicability of the KIND approach and toolkit for evaluation of merits and demerits associated with the energy system options under consideration.

==Introduction==
The International Project on Innovative Nuclear Reactors and Fuel Cycles (INPRO), currently being implemented, is an integral part of the regular programme of the International Atomic Energy Agency (IAEA). Its objectives are to:
*help ensure that nuclear energy is available to contribute, in a sustainable manner, to the energy needs of the 21st century; and
*bring together technology holders and users to consider jointly the international and national actions required for achieving desired innovations in nuclear reactors and fuel cycles.
The INPRO’s concept of a sustainable nuclear energy is derived from the United Nations (UN) sustainable development concept (Brundtland Commission, 1987):<br>
''“Development that meets the needs of the present without compromising the ability of future generations to meet their own needs”.''<br>
Based on this concept, INPRO has developed a methodology for detailed assessment of sustainability of nuclear energy systems (NES), which helps identify the sustainability related gaps in the existing or planned NES. The key assessment areas include Economics, Infrastructure, Waste Management, Proliferation Resistance, Environment (Stressors and Resources), Safety of Reactors and Safety of Fuel Cycle.<br>
A sustainable NES should be resource self-sufficient and cost-effective, have minimum burden of nuclear wastes, ensure effective proliferation resistance and maintain the appropriate level of safety, security and reliability, and is governed, regulated and managed by competent institutions, and supported by resourceful infrastructure and crosscutting research. Multiple opportunities exist in all these aspects to improve the sustainability of an NES. A comprehensive decision-making support is required for comparative evaluations the alternative options and selection of the most promising solution.<br>
Assessments using the INPRO methodology require reasonably detailed design information for the components of a NES. For evolutionary systems, such information is typically available, whereas for future innovative NESs, that are still under development, sufficient information for a full-scope INPRO assessment is generally lacking. Moreover, the INPRO methodology is not intended for comparative evaluation of NESs.<br>
To overcome this difficulty, the INPRO collaborative project “Key indicators for innovative nuclear energy systems” (KIND) developed guidance and tools for comparative evaluations of the status, prospects, benefits and risks associated with the different options for development of nuclear energy systems, including future innovative systems. <br>
The KIND approach is based on the application of key indicators to reflect assessment areas of the INPRO methodology, and a multi-criteria decision analysis method to aggregate individual aspects to derive the overall evaluation of the alternatives. This leads to a comprehensive elaboration and understanding of the decision-making problem together with decision analysis by various mathematical methods and analytical tools. The project also explored application of the KIND approach to a variety of problems, including comparative evaluation of nuclear energy scenarios, and nuclear versus non-nuclear energy options. <br>
The methodology for the KIND approach was selected by taking into account the lessons learned and the best practices in the multiple criteria decision-making applications for nuclear engineering as well as the most significant recent findings in decision support<ref name=r2>Kuznetsov V., Fesenko G. et.al. INPRO Activities on Development of Advanced Tools to Support Judgement Aggregation for Comparative Evaluation of Nuclear Energy Systems, Science and Technology of Nuclear Installations, vol. 2014, Article ID 910162, 15 pages, 2014. doi:10.1155/2014/910162.</ref><ref name=r3>Kuznetsov V., Fesenko G., Schwenk-Ferrero A. et.al. Innovative Nuclear Energy Systems: State-of-the Art Survey on Evaluation and Aggregation Judgment Measures Applied to Performance Comparison. Energies 2015, 8, 3679-3719.</ref><ref name=r4>Kuznetsov V., Fesenko G., et.al. INPRO Collaborative Project on Key Indicators for Innovative Nuclear Energy Systems (KIND). Innovative Designs and Technologies of Nuclear Power: Abstracts of IV International Scientific and Technical Conference (September 27–30, 2016, Moscow). Moscow, JSC “NIKIET” Publ., 292 p.</ref><ref name=r5>Yoon S., Choi. S., Ko. W., An Integrated Multicriteria Decision-Making Approach for Evaluating Nuclear Fuel Cycle Systems for Long-term Sustainability on the Basis of an Equilibrium Model: Technique for Order of Preference by Similarity to Ideal Solution, Preference Ranking Organization Method for Enrichment Evaluation, and Multiattribute Utility Theory Combined with Analytic Hierarchy Process, Nuclear Engineering and Technology, vol. 49, issue 1, Korean Nuclear Society, February 2017, p. 148-164. </ref><ref name=r6>Andrianov A.A., Kuptsov I.S., Utianskaya T.V. et.al. Multi-criteria Comparative Evaluation of Nuclear Energy Deployment Scenarios with Thermal and Fast Reactors. Journal of Nuclear Fuel Cycle and Waste Technology, JNFCWT Vol.17 No.1 pp.47-58, March 2019, [https://doi.org/10.7733/jnfcwt.2019.17.1.47]</ref><ref name=r7>Schwenk-Ferrero A., Andrianov A. Nuclear Waste Management Decision-Making Support with MCDA. Science and Technology of Nuclear Installations, vol. 2017, Article ID 9029406, 20 pages, 2017. [https://doi.org/10.1155/2017/9029406].</ref><ref name=r8>Groudev, P., Zaharieva, N., Margenau, C., Constantin, M. (2017). Comparison of Innovative and Evolutionary NPPs in a Country-Specific Context for Bulgaria (Based on IAEA INPRO KIND – ET Methodology). BgNS Transactions, 22(1), 58-64.</ref>. The KIND approach, thus, represent as a state-of-the-art method for comparative evaluations of NES options and related issues.<br>
At the moment, the KIND approach is being extensively applied for comparative evaluations of various NES options at the scenario and technological levels, comparisons of nuclear fuel supply and waste management options, examination of cross-cutting issues that demonstrate the potential of the elaborated toolkit for decision support within a wide landscape of different practical nuclear engineering problems requiring expert judgment aggregations. The developed approach was found useful for establishing a productive dialogue between energy-option proponents and decision makers regarding sustainable nuclear energy options.<br>
This brochure presents a short summary of the KIND approach and tools and the main conclusions of the KIND collaborative project.
  
==Why is it important to perform comparative evaluation of NES/scenario options: Member States needs==
One of the first activities of INPRO was to develop a detailed methodology for assessing the sustainability of a nuclear energy system (NESA). However, the INPRO methodology does not provide an approach for comparative evaluation of NES options.<br>
A variety of innovative technologies to support future sustainable NESs are being developed in many countries worldwide. With multiplicity of such developments, the technology developer countries need to evaluate the performance of the innovative NES versus other innovative or established NES to prioritize/adjust the national efforts and R&D resource allocations for development of innovative nuclear technologies to support sustainable and cost-effective NES deployment. Such evaluations have to be performed for innovative technologies for which technical and economic data are not available in sufficient details. The evaluation, thus, has to be based on experts estimates and also by taking into account preferences of decision-makers and stakeholders. Different experts and stakeholders, however, may have different opinions which should be reflected in the evaluation process and methodology and aggregated to derive the overall evaluation of alternative options.<br>
The technology user countries may be less interested in technical innovations and more interested in comparative choices of more mature evolutionary NES and relevant scenarios.  However, if a technology user country performs R&D studies, it may have interest in some innovative elements. Newcomer countries typically need to make comparative choices of nuclear versus other means of energy production.<br>
All countries may face a need to evaluate advantages and disadvantages of the various plausible NES options/scenarios compared under different circumstances and to derive their overall ranks, considering the NES performance, as well as experts’ and decision makers’ judgments and preferences.<br>
Responding to Member States need, the KIND collaborative project developed guidance and tools for comparative evaluation of the status, prospects, benefits and risks associated with development of innovative nuclear technologies for a more distant future and examined the applicability of such approach to other problems, including those of interest to technology user and to newcomer countries.
<center>[[File:KIND.Unnamed.png|borderless]]</center>

==Multi-criteria decision analysis===
[[File:Fig. 1. Scope (a) and schematics (b) of multi-criteria decision analysis..png|thumb|Fig. 1. Scope (a) and schematics (b) of multi-criteria decision analysis.]]
Multi-Criteria Decision Analysis (MCDA) is a method designed to help decision-makers conduct evaluations of alternatives characterized by numerous and conflicting factors influencing the status and evolution of a system and find compromises in the decision-making process. The MCDA problems include a finite number of alternatives explicitly known at the beginning of the decision-support process. Each alternative is represented by its performance in multiple attributes and respective criteria.
[[File:Fig. 2. Schematics of MAVT..png|thumb|Fig. 2. Schematics of MAVT.]]
A large number of MCDA techniques (value-based, outranking, reference-based, other/hybrid methods) have been developed to deal with different kinds of decision-support problems, see Fig. 1a. These techniques help ranking and sorting the relevant options under consideration and selecting the most promising trade-off. Within the MCDA framework, special attention is paid to analysis of the solution’s stability against variations of various parameters and the method used.<br>
Within the MCDA framework, the decision support process starts with identification of the decision-maker, the group of subject-matter experts and the stakeholders (persons interested in a certain decision), and further goes through the following steps, Fig. 1b: problem formulation and structuring, formation of alternatives, identification and evaluation of criteria and attributes, selection of the MCDA method, performance of MCDA analysis to derive ranks of the compared NES/ scenario options, sensitivity/uncertainty analysis to clarify stability of the ranking results, final conclusions and recommendations.

==The approach to comparative evaluation of NES/scenario options==
The approach to comparative evaluation of NES/scenario options developed within the INPRO collaborative project KIND (hereinafter, the KIND approach) is an iterative procedure using the top-down and bottom-up perspectives. This approach as a decision support process begins with the identification of the decision-maker’s problem and a group of subject-matter experts and stakeholders (persons interested in a certain decision) and iteratively goes through the following steps, Fig. 3:
[[File:Fig. 3. Flowchart of MCDA application..png|thumb|Fig. 3. Flowchart of MCDA application.]]
*Problem formulation and goal definition;
*Identification of KIs (requirements for KI sets);
*Formulation of alternatives (NES options);
*Evaluation of indicators, including uncertainties, performance table formation;
*Selection of MCDA method or methods to be used;
*Objectives tree construction and weight assignments, including uncertainties;
*Alternative ranking determination based on the selected MCDA method or methods;
*Sensitivity and uncertainty analyses;
*Drawing conclusions and recommendations.
[[File:Fig. 4. Schematics of the objectives tree..png|thumb|Fig. 4. Schematics of the objectives tree.]]
The KIND approach has identified some specific considerations regarding development of a set of KIs for comparative energy system evaluations involving NESs. When developing a KI set it is important to:
*Determine the main areas to be evaluated and then assign KIs for those areas. The main areas could be based on what is important to different stakeholders in the evaluation and are to include all major perspectives;
*Not attempt to address every nuance of the system with a KI. It is to be remembered that these are ‘key’ indicators intended to address only the key elements of the system and the key issues to be considered in an evaluation. The total number of KIs needs to be limited, preferably not more than 15–20;
*Develop KIs, to the extent possible, that are independent from each other to avoid double counting same aspects of the system;
*To exclude the indicators included in national regulations. Comparative evaluation is deemed to support the selection of an NES that is preferable for a particular user from those that otherwise meet (or are anticipated to meet) all regulatory and other assessment criteria.
The objectives tree defines procedures of indicator aggregation and weighting factors evaluation and the ranking results interpretation. Such structuring makes it possible to simplify preparation of the indicator weights and provides a clear explanation of the ranking results. High-level objectives and areas weights could be obtained based on the input from decision-makers. The weighting factors for each indicator may be determined by soliciting input from subject matter experts in the corresponding nuclear engineering fields. Figure 4 illustrates construction of the KIND objectives tree as a three level hierarchical structure: the orange frames are indicators (key and secondary), the green frames are evaluation areas and the blue frames represent high level objectives.<br>
A comparative evaluation at the top aggregation level is not the final result, but rather an option to go down to lower aggregation levels and, when necessary, to particular indicators, sensitivities and uncertainties. Namely such down-to-the-bottom analysis and presentation could make a dialogue with decision makers useful and productive. Performing a detailed uncertainty/sensitivity analysis helps in significantly increasing the confidence level of results and conclusions, as this backs the judgments with conclusions on stability of the results.<br>
The KIND approach provides a convenient and systematic way of performing all of the above-mentioned steps for a full cycle MCDA. The approach incorporates the specific features of an NES, including those for innovative systems that are considered for potential deployment in a more distant future. It also deals with the challenges related to the availability of data and the uncertainty in estimates and experts’ judgement.

==KIND Evaluation Tool (KIND-ET)==
[[File:Fig. 5. Inputs of KIND-ET (example)..png|thumb|Fig. 5. Inputs of KIND-ET (example).]]
[[File:Fig. 6. Outputs of KIND-ET (example)..png|thumb|Fig. 6. Outputs of KIND-ET (example).]]
The KIND evaluation tool (KIND-ET) is a multi-attribute value theory (MAVT) based Excel toolkit developed within the INPRO collaborative project “Key Indicators for Innovative Nuclear Energy Systems” (KIND). KIND-ET was developed for the multi-criteria comparative evaluation of NES options or nuclear energy evolution scenarios in accordance with the approach and recommendations elaborated in the KIND project.<br>
KIND-ET provides a solution for the comparative evaluation of the status, prospects, benefits and risks associated with development of nuclear technologies and deployment of nuclear energy systems. The architecture and functional capacities of KIND-ET allow users to modify the tool according to their needs. KIND-ET identifies the merits and demerits of the NESs or nuclear energy evolution scenarios being compared and evaluates their overall ranks based on their performance and experts and decision makers’ judgements and preferences.<br>
The features of KIND-ET are quite flexible and allow the implementation of different approaches to compare and rank alternatives. The tables and graphs provide help to interpret the ranking results. KIND-ET users can utilize different approaches and techniques (e.g. choosing the shape of value functions) and perform other specifics for the implementation of the MAVT method as elaborated for the KIND objectives. <br>
The default version of KIND-ET includes three-level objectives tree and 15 key indicators. This structure is suitable for defining several higher-level objectives, each with some evaluation areas and key indicators for each of the evaluation areas. The software follows basic requirements: problem-orientation and integration; user-friendliness and intuitive obviousness; automation and improvability. The tool was verified on a number of numerical examples by means of comparison with the calculations based on commercial decision-making software. The verification performed confirms that KIND-ET provides correct evaluations and can be used for relevant case studies. <br>
KIND-ET provides for relatively easy performance of sensitivity and uncertainty analysis and modification to increase or reduce the number of high level objectives or/ and key indicators, alter the shapes of utility functions, or even apply a different MCDA method.  A variety of graphical panels is provided to enable effective communication of the result of comparative evaluations.<br>
The KIND-ET tools, user instruction and demo cases are provided with reference<ref name=r1/>, either as a supplementary CD with a hard copy, or as an electronic attachment downloadable from the IAEA Web-site. Examples of the KIND inputs and outputs are given in Fig. 5 and Fig. 6.

==Case studies on trial application of the KIND approach==
===Scope and content of the considered problems===
Based on the KIND approach, several trial case studies have been performed related to comparative evaluations of hypothetical NESs, NESs based on different types of evolutionary and innovative reactors, nuclear and non-nuclear energy systems, and NES deployment scenarios. These case studies were carried out for the purpose of testing the KIND approach and were not deemed to adequately reflect any developments or official plans adopted in corresponding Member States. In some cases, the results of these studies were presented to and discussed with decision makers, just to understand how useful the KIND approach could be to maintain the corresponding dialogue.<br>
The case studies have demonstrated the applicability of the recommendations and tools developed within the KIND project to comparative evaluations of NES options. They also proved that the approach can reflect the merits and demerits associated with the various energy system options under consideration.<br>
It is important to emphasize that the key indicator approach does not provide for the identification of KIs in each and every evaluation area. Every single case study presented below provides an example of a different selection of evaluation areas and the relevant KIs to reflect the specific concerns and priorities of a particular country.<br>
Altogether, seven case studies were performed in the report including:
*Generic case studies of hypothetical NESs;
*Innovative versus innovative NESs;
*Evolutionary versus innovative NESs;
*Evolutionary versus evolutionary NESs;
*Nuclear versus non-nuclear energy systems;
*Nuclear energy deployment scenarios.
Their detailed reports being provided in reference 1. The scope to the performed studies is illustrated in brief by several examples provided in the following two sub-sections. 

===Case studies on comparative evaluation of NES options===
''Case study from Romania: evolutionary versus innovative nuclear energy systems''<br>
The study performed by the expert team from Romania had the following specific objectives:
*To evaluate the considered NES together with the already existing/operating NES technology (CANDU 6), based on specific KIs and taking into consideration the country specifics;
*To validate the obtained results by performing sensitivity analysis.
The case study considered three NES technologies: CANDU NES technology (two CANDU 6 reactors presently operating at the Cernavoda NPP and the electricity generated comprises approximately 20% of Romania’s total electricity production) — CANDU; an evolutionary NES, the Generation III+ enhanced CANDU technology — ENES; and an innovative NES, the Generation IV lead cooled fast reactor technology — INES. 
[[File:Fig. 7. Structure of the objectives tree in the case study from Romania..png|thumb|Fig. 7. Structure of the objectives tree in the case study from Romania.]]
[[File:Fig. 8. High level objectives (HLO) scores for- (a) case 1; (b) case 2; (c) case 3..png|thumb|Fig. 8. High level objectives (HLO) scores for: (a) case 1; (b) case 2; (c) case 3.]]
Three high level objectives were chosen and the evaluation areas were grouped, as shown in Fig 7: 
*(a)	Economics (E), corresponding to the cost high level objective;
*(b)	Safety (S), waste management (WM), environment (ENV) and proliferation resistance (PR), corresponding to the performance high level objective;
*(c)	Maturity of technology (M) and country specifics (CS), corresponding to the acceptability high level objective.
Two KIs were selected for the evaluation in the area of economics: Levelized energy product or service cost (E1); and R&D cost (E2). The evaluation in the waste management area has been performed by considering: specific radioactive waste inventory (WM1); and spent nuclear fuel management costs (WM2). The evaluation of NESs in the area of proliferation resistance has been performed by means of the following three KIs: attractiveness of nuclear material (PR1); attractiveness of technology (PR2); safeguards approach identified (PR3). For the environment area, the following KI has been chosen: amount of useful energy produced by NES from a unit of mined natural uranium (ENV1).  Five KIs were chosen for the evaluation of considered NESs in the safety area, namely: potential to prevent release (S1); design concept specific inherent and passive safety features and systems (S2); core damage and large early release frequencies (S3); source term (S4); short term and long term accident management (S5). For the evaluation of considered NESs in the maturity of technology area, three KIs have been selected: design stage (M1); time needed to mature the technology (M2); degree of standardization and licensing adaptability (M3) (higher value was rated better in evaluation).<br>
The results were obtained for different weights at the objectives tree level: 
*Case 1 — weights for high level objectives: cost 50%, performance 30%, acceptability 20%;
*Case 2 – weights for high level objectives: cost 30%, performance 50%, acceptability 20%;
*Case 3 – weights for high level objectives: cost 40%, performance 40%, acceptability 20%.
[[File:Fig. 9. Ranking results for comparative evaluation of an NES and a CPP (base case)..png|thumb|Fig. 9. Ranking results for comparative evaluation of an NES and a CPP (base case).]]
[[File:Fig. 10. Sensitivity analysis for NES and CPP performed by varying the acceptability weighting factor..png|thumb|Fig. 10. Sensitivity analysis for NES and CPP performed by varying the acceptability weighting factor.]]
For the main working cases considered (cases 1, 2 and 3, with different sets of weights for high level objectives), the overall scores obtained for the INES suggest that it is more attractive (better in terms of performance in the safety, waste management and environment areas, and also superior in the country specifics area under the high level objective ‘acceptability’), Fig. 8.<br>
The case study from Romania has concluded that innovative technology could offer an opportunity for Romania to enhance its participation in the world’s most advanced scientific studies. The impact might not be restricted to the development of local scientific communities, but it could also create numerous opportunities for technological collaboration and knowledge transfer between the research community and industry.<br>
''Case study from Thailand: nuclear versus non-nuclear energy options''<br>
The objective of the study was to apply the set of KIs developed for newcomer countries to a case study for Thailand, whose main objective was the comparative evaluation of energy system scenarios with an NES and a non-NES. The options under consideration included an NES (evaluated using data for the Generation III+ pressurized water reactors of interest (i.e. AP-1000, APR1400, ACPR and VVER)) and a coal power plant (CPP).<br>
The KI set belongs to four areas: economics, energy security, public acceptance and infrastructure. There are two KIs in the area of economics: levelized unit electricity cost (LUEC) and cash flow. The degree of dependence on suppliers is the only KI in the area of energy security. The area of public acceptance has three KIs: survey of public acceptance, external cost and risk of accidents. Infrastructure is the area with the largest number of KIs. The five KIs in this area are status of legal framework, status of state organizations, availability of infrastructure to support owner/operator, government policy and availability of human resources. <br>
Ranking results of the comparative evaluation show that CPP is more attractive than NPP for Thailand, with them receiving the scores of 0.468 and 0.412, respectively, for the ratio of the HLO weighting factors ‘Economics’ to ‘Acceptability’ 0.3/0.7, as shown in Fig. 9. The results indicate that the score that has a significant impact on the NES is from the area of public acceptance, while the attractiveness of CPP is mainly derived from the areas of economics and infrastructure. The sensitivity analysis was performed by varying the ratio of the high-level objective weighing factors. For the fixed evaluation area weighting factors and indicator weighting, increasing the weight of ‘Economics’ with decreasing the weight of ‘Acceptability’ down to approximately 0.4 could result in making NES more attractive than CPP. The results indicate that NES attractiveness overcomes that of CPP when the weighting factor of ‘Acceptability’ is less than 0.4, Fig. 10.

===Case studies on comparative evaluation of deployment scenarios===
''Comparative evaluation of scenarios considered in the collaborative project “Global Architecture of Innovative Nuclear Energy Systems with Thermal and Fast Reactors and a Closed Nuclear Fuel Cycle” (GAINS)<ref name=r9>INTERNATIONAL ATOMIC ENERGY AGENCY, Framework for Assessing Dynamic Nuclear Energy Systems for Sustainability: Final Report of the INPRO Collaborative Project GAINS, IAEA Nuclear Energy Series No.  NP-T-1.14, IAEA, Vienna (2013): [https://www.iaea.org/publications/8873/framework-for-assessing-dynamic-nuclear-energy-systems-for-sustainability-final-report-of-the-inpro-collaborative-project-gains] .</ref>''<br>
The KIND approach can also be used for comparative evaluation of nuclear energy deployment scenarios. To demonstrate such an application, a case study was conducted to compare eleven scenarios (Table 1) considered in the GAINS collaborative project. The nine key indicators listed in Table 2 were used to present important aspects of the NESs considered in these scenarios. The following weighting options were considered reflecting possible experts’ preferences: equal significance of all KIs; expert preferences based on the questionnaires of the INPRO meetings; preference to investments minimization; and preference to wastes minimization.
[[File:Fig. 11. Ranking of the NES deployment scenarios..png|thumb|Fig. 11. Ranking of the NES deployment scenarios.]]
Based on the KIND approach, it was possible to rank the scenarios from the most preferred NES to the least preferred NES, as shown in Fig. 11. It was also possible to identify potential merits and demerits of the relevant nuclear technologies within the NES and draw recommendations for improvement of the technologies.
{| class="wikitable"
|+Table 1. NES deployment scenarios
!NES deployment scenario
!Denotation*
|-
|BAU
|L1H1
|-
|BAU+
|L1L2H1
|-
|BAU+, FR ‘break-even’
|L1L2H1F1
|-
|BAU+, FR ‘medium-BR’, medium burn-up
|L1L2H1F2
|-
|BAU+, FR ‘medium-BR’, high burn-up
|L1L2H1F3
|-
|BAU+, FR ‘break-even’ and ADS
|L1L2H1F1A1
|-
|BAU+, FR ‘medium-BR’, medium burn-up, ADS
|L1L2H1F2A1
|-
|BAU+, FR ‘medium-BR’, high burn-up, ADS
|L1L2H1F3A1
|-
|BAU+, FR ‘break-even’ and MSR
|L1L2H1F1M1
|-
|BAU+, FR ‘medium-BR’, medium burn-up, MSR
|L1L2H1F2M1
|-
|BAU+, FR ‘medium-BR’, high burn-up, MSR
|L1L2H1F3M1
|}
<small>* - L1 – LWR with low burn-up (45 GW·day/t); L2 – LWR with high burn-up (60 GW·day/t); H1 – HWR; F1 – “break-even” FR with breeding ratio BR~1.0; F2 – FR with medium BR (BR~1.2), medium burn-up (~31 GW·day/t); F3 – FR with medium BR (BR~1.2), high burn-up (~54 GW·day/t); A1 – ADS for MA burning; M1 – MSR for MA burning</small>
[[File:Fig. 12. Performance and ranking results for advanced NFC options..png|thumb|Fig. 12. Performance and ranking results for advanced NFC options.]]

{| class="wikitable"
|+Table 2. Key indicators
!Key indicators
|-
|Natural uranium consumption 
|-
|Annual spent nuclear fuel generation 
|-
|Total spent nuclear fuel in long term storages 
|-
|Minor actinides in nuclear fuel cycle
|-
|Plutonium in nuclear fuel cycle
|-
|Total enrichment capacities 
|-
|Total reprocessing capacities 
|-
|Total uranium cost 
|-
|Total investments in NPPs 
|}
''Comparative evaluation of the OECD/NEA advanced nuclear fuel cycles''<br>
Another similar application of KIND was for the OECD/NEA study on “Advanced Nuclear Fuel Cycles and Radioactive Waste Management”<ref name=r10>OECD NUCLEAR ENERGY AGENCY, Advanced Nuclear Fuel Cycles and Radioactive Waste Management, NEA Report No. 5990, OECD, Paris (2006).</ref> which was devoted to an evaluation of the impact of nuclear fuel cycle strategies on the uranium consumption and waste management. The nuclear fuel cycle options analyzed included once-through, recycling in thermal reactors, sustained recycle with a mix of thermal and fast reactors, and sustained recycle with fast reactors.<br> 
The objective was to identify those nuclear fuel cycles which provide benefits to the spent nuclear fuel (SNF)/high level waste (HLW) repository programme, reduce the depletion of uranium resources and enhance the prospects for nuclear power. Altogether, 12 nuclear fuel cycle (NFC) options (Table 3) were considered which were evaluated by 8 key indicators (Table 4). The comparative evaluation (Fig. 12) has shown that some partly closed nuclear fuel cycles represent trade-off benefits for the repository programmes and enable more efficient use of natural uranium, but at some additional costs.

{| class="wikitable"
|+Table 3. NFC options
!NFC options
!Comments
|-
|colspan="2"|''Current industrial practice and extensions''
|-
|NFC 1a “Once-through NFC”
|''reference NFC''
|-
|NFC 1b “Current reprocessing NFC”
|''Pu is recycled once in the form of MOX''
|-
|NFC 1c (Variant of Scheme 1b)
|''avoids the separation of pure Pu by recycling Np and Pu together''
|-
|colspan="2"|''Partially closed NFC''
|-
|NFC 2a “Pu burning in LWR”
|''uses LWRs only, MOX fuel with enriched uranium (MOX-UE)''
|-
|NFC 2b “Pu and Am burning in LWR”
|''requires two types of MOX-UE fuel, Am-Cm separation (Cm decay products are either disposed or recycled as MOX)''
|-
|NFC 2c “Heterogeneous Am recycling”
|''Am is recycled in targets which are disposed after irradiation''
|-
|NFC 2cV (variant 2c)
|''Am and Cm go to storage facility (decay products are either disposed or recycled as MOX fuel)''
|-
|colspan="2"|''Closed NFC''
|-
|NFC 3a “TRU burning in FR”
|''based on integral FR concept, avoids separation of pure Pu''
|-
|NFC 3b “Double strata NFC”
|''burns all Pu in conventional LWRs and FRs''
|-
|NFC 3bV (variant 3b)
|''circumvents the FR stage by transferring the Pu from the PWR-MOX stage directly to the ADS NFC''
|-
|NFC 3cV1 “All-FR strategy”
|''based on Gen-IV gas-cooled FRs''
|-
|NFC 3cV2 (variant 3c)
|''based on EFR using MOX, UREX+, uranium is not recycled''
|}

{| class="wikitable"
|+Table 4. Key indicators
!Area
!Key indicators
|-
|Resource utilization
|Natural uranium required per energy generated
|-
|rowspan="5"|Nuclear waste management
|Mass of TRU loss transferred to waste
|-
|Activity of SNF and HLW at 1000 years
|-
|Decay heat loading of SNF and HLW at 50 years 
|-
|Decay heat loading of SNF and HLW at 200 years
|-
|Volume of HLW and SNF
|-
|rowspan="2"|Economics
|NFC costs
|-
|Costs of electricity at equilibrium
|}

===Lessons learned from trial applications of the KIND approach===
The KIND collaborative project participants confirmed that the approach could be effective in practical comparative evaluations of not only less mature innovative NESs but also other energy options and nuclear versus non-nuclear energy system options. The lessons learned from these trial case studies are:
*The problem elaboration and the objectives tree need to be prepared through consultative and iterative process. A comparative evaluation problem can be simplified by focusing on a fewer number of major high-level objectives. It is practical and reasonable to consider at most two/three highest level objectives, e.g., ‘cost’, ‘benefit’ and ‘risk’ (commonly used) or ‘performance’, ‘cost’, and ‘acceptability’, depending on specifics of the considered comparative evaluation problem. These high-level objectives need to be linked with relevant evaluation areas according to the INPRO methodology, and suitable indicators need to be assigned to each of the areas.
*The determination of relative importance (weighting factors) among different indicators, evaluation areas or high-level objectives needs to be rational and reasonable, and reflect national preferences for nuclear energy development, as well as international obligations of Member States. Weights for indicators need to be determined by soliciting input from subject matter experts in the corresponding nuclear engineering fields. Weights for evaluation areas and high-level objectives can be determined by soliciting input from decision makers. 
*To avoid utilization of an excessive number of indicators, a multi-stage evaluation may be applied. The first stage reduces the total number of options using key indicators while the second stage goes into more detail in a couple of areas using the so-called secondary indicators, where it is difficult to separate the remaining options with the original key indicators.
*For interpreting the ranking results, it is necessary to decompose the overall scores into individual components in accordance with the specified structure of the objectives tree. Based on this decomposition, the status of the NES options may be explained for the decision makers and stockholders. 
*The results of sensitivity and uncertainty analysis would help achieving a productive communication by pointing to those cases where compared options are undistinguishable and by identifying certain changes in attitudes and policy that can overturn the originally obtained conclusions regarding the comparative evaluation.

==Conclusion summary for the INPRO collaborative project KIND==
The INPRO collaborative project KIND has done the following:
*Developed guidance on the elaboration of KI sets for comparative evaluation of the performance and sustainability of different NES options; 
*Adapted and elaborated advanced methods of expert judgement aggregation and sensitivity/uncertainty analysis to enable effective comparative evaluation of such options;
*Conducted case studies on trial application of the KIND approach;
*Explored the potential of the developed approach in application to both INESs and other NES options, including those of interest to technology users and newcomer countries.
The project has identified a number of specific considerations regarding the development of a set of KIs for comparative energy system evaluations involving NESs. When developing a KI set it is inter alia important to do the following:
*Identify the target audience for the evaluation and select KIs that will be understandable to that target audience.
*Determine the main areas to be evaluated and then assign KIs for those areas. The main areas could be based on what is important to different stakeholders in the evaluation and are to include all major perspectives.
*Develop KIs with full consideration of which data are available for all of the options using the least detailed option as the basis. If using a quantitative KI, first verify that quantitative data are available for every option to be evaluated. If using a qualitative KI, verify that unbiased experts are available to provide the qualitative input.
*Note that if large numbers of experts are involved in one area of evaluation, it may result in excessive number of KIs in that area, since they know their domain in detail, and will opt to have numerous KIs to measure every aspect. This does not necessarily improve the overall evaluation as the clarity of priorities can be lost in the ‘forest’ of KIs.
*Fully describe and document each KI, so that everyone involved can understand what is included, and how it is to be evaluated.
The selection of the MCDA method that is most suitable for a given problem is a separate task that needs to be based on examination of the problem context and the information provided by the subject matter experts and a decision maker. <br>
To structure a dialogue based on MCDA methods, it is necessary to describe all of the assumptions that have been made accurately to avoid misunderstandings in interpretation of the results. These assumptions then need to be analyzed within a sensitivity analysis. A detailed explanation of the selected model assumptions in the case study report is an area of responsibility for experts carrying out MCDA based studies.
Properly organized case studies based on the KIND approach represent a complex endeavour, not only operating formally with a set of analytical tools, but also helping to understand explicitly what could support the decision making process. <br>
Experts are responsible for the quality of MCDA based studies conducted to support the establishment of a certain recommendation and inform a decision maker about the merits and demerits (costs, benefits and risks) of the options considered. The decision maker takes responsibility for the final decision, taking into account the results of MCDA based studies, and this decision needs to be accepted with a clear recognition and acceptance of the associated risks.<br>
Performing a detailed uncertainty/sensitivity analysis helps to increase the confidence level for the results and conclusions significantly, as this backs the judgements with information on the stability of the results. One of the important areas for further development of the comparative evaluation approach for NESs is the extension of judgement aggregation methods to problems with uncertainties that are relevant to most of the real world problems.<br>
The elaboration and trial applications of the KIND approach to date have indicated that it can not only be effective in practical comparative evaluations of less mature INESs, but also other energy options and, specifically, NES evolution scenarios and NES versus non-nuclear energy options.<br>
Further steps in the elaboration of the KIND approach will be linked to applications of the developed toolkits to practical problems that address a variety of issues that interested Member States rate as important. This is being accomplished within the on-going follow-up INPRO collaborative project on Comparative Evaluation of Nuclear Energy System Options (CENESO). The KIND toolkit will be used to streamline such systemic activities and formulate specific guidelines with respect to particular approaches aimed at improving the performance and sustainability of national, regional and global NESs.<br>
<center>[[File:KIND. Unnamed 2.png|borderless]]</center>