Methodology for Assessing the Effectiveness of Comprehensive Review Measures in Ukraine's Security and Defense Sector
Abstract
Purpose. Development of a methodology for assessing the effectiveness of comprehensive security and defense sector reviews as a results-based management (RBM) tool and a mechanism for evaluating public policy in the field of defense.
Method. The research employs systems analysis, Results-Based Management (RBM), monitoring and evaluation (M&E) approaches, Management-by-Objectives (MBO), a three-level KPI framework, and a modified weak-link principle to identify critical elements in the performance of review measures. The methodology is based on analysis of regulatory documents, process modelling of the comprehensive review cycle, expert assessment techniques, and formalisation of standardised evaluation algorithms.
Findings. A unified methodology for assessing the effectiveness of a comprehensive review of Ukraine's security and defense sector is proposed, covering: (1) identification and classification of measures, tasks, stages, and procedures; (2) determination of expected results and effects; (3) development of a three-level system of performance indicators; (4) analysis of bottlenecks; (5) aggregation of indicators and formulation of recommendations for improving the effectiveness of the comprehensive review. It is shown how the results of the assessment can be integrated into program and project planning, defense programs, and public policy cycles.
Theoretical implications. For the first time, a formalized approach to assessing the effectiveness of comprehensive review measures in Ukraine's security and defense sector has been proposed, based on RBM and KPI and taking into account the specific characteristics of Ukraine's security and defense sector.
Practical implications. The methodology can be used by the Ministry of Defense, the General Staff of the Armed Forces of Ukraine, defense agencies, and other government authorities to evaluate the effectiveness of policies, programs, and decisions, as well as to improve the quality of defense planning.
Originality/Value. It consists in creating a methodological basis for transforming the culture of defense management in Ukraine. The work ensures the transition from a formal reporting process to adaptive performance management, which allows synchronizing strategic goals with resources, increasing the transparency of defense planning, and strengthening the institutional resilience of the security and defense sector in the face of modern threats.
Papertype. Theoretical and applied.
Downloads
References
Verkhovna Rada of Ukraine. (2018). Law of Ukraine “On National Security of Ukraine” (No. 2469-VIII, June 21, 2018). https://zakon.rada.gov.ua/go/2469-19
Verkhovna Rada of Ukraine. (2015). Order of the Cabinet of Ministers of Ukraine “On approval of the action plan for conducting a comprehensive review of the security and defense sector of Ukraine and methodological recommendations for its implementation” (No. 139-r, February 25, 2015). https://zakon.rada.gov.ua/laws/show/139-2015-%D1%80
Manheim, D. (2023). Building less-flawed metrics: Understanding and creating better measurement and incentive systems. Patterns, 4(10), Article 100842. https://doi.org/10.1016/j.patter.2023.100842
González Campos, E. (2023). Application of statistical process control for the performance improvement of a clinical engineering department. Global Clinical Engineering Journal, 6(1), 29–35. https://doi.org/10.31354/globalce.v6i1.160
Petersen, J. A., McAlister, L., Reibstein, D. J., Winer, R. S., et al. (2009). Choosing the right metrics to maximize profitability and shareholder value. Journal of Retailing, 85(1), 95–111. https://doi.org/10.1016/j.jretai.2008.11.004
Dipura, S., & Soediantono, D. (2022). Benefits of key performance indicators (KPI) and proposed applications in the defense industry: A literature review. International Journal of Social and Management Studies, 3(4), 23–33. https://doi.org/10.5555/ijosmas.v3i4.146
UK Government. (2025). Key performance indicators (KPIs) for government’s most important contracts. https://www.gov.uk/government/publications/key-performance-indicators-kpis-for-governments-most-important-contracts
Skurinevska, L. (2024). Evaluation of the effectiveness of defense resource management in the system of economic security formation of Ukraine. Journal of Scientific Papers “Social Development and Security”, 14(6), 192–203. https://doi.org/10.33445/sds.2024.14.6.19
Soares, J., Letens, G., Vallet, N., Van Bockhaven, W., et al. (2022). The defence performance measurement framework. Defence Studies, 22(1), 99–122. https://doi.org/10.1080/14702436.2021.1994394
Semenenko, O., & Skurinevska, L. (2023). Indicators and criteria for evaluating the effectiveness of defense resource management in Ukraine’s security and defense sector. Journal of Scientific Papers “Social Development and Security”, 13(2), 112–128. https://doi.org/10.33445/sds.2023.13.2.10
Dieniezhkin, M. M., Krykun, P. M., & Rusnak, I. S. (2014). Problems of conducting a comprehensive review of the security and defense sector of Ukraine. Nauka i oborona, (4), 3–10.
Gerasymov, A. P. (2016). Comprehensive review of the security and defense sector: Lessons from the past and present. National Institute for Strategic Studies. https://niss.gov.ua
Nakonechna, I. V. (2023). Information and analytical procedures for ensuring the national security of Ukraine. Legal Novelties, (19), 77–84. https://doi.org/10.32847/ln.2023.19.11
Galahan, V. (2023). Procedure and features of evaluating the state of military information systems development projects. Collected Scientific Papers of the Center for Military and Strategic Studies of NDUU, 2(78), 80–86. https://doi.org/10.33099/2304-2745/2023-2-78/80-86
Lobko, M., Tymoshenko, R., Sotnyk, V., & Fuchko, A. (2024). Problems of forming a strategic planning system in the defense sector. Collected Scientific Papers of the Center for Military and Strategic Studies of NDUU, 2(81), 41–53. https://doi.org/10.33099/2304-2745/2024-2-81/41-53
Khymchenko, O. S., Vorovych, B. O., & Kutovyi, O. P. (2024). The system of national resistance of Ukraine. Nauka i oborona, (2), 37–47. https://doi.org/10.33099/2618-1614-2024-25-2-37-47
Vorovych, B., Horbenko, S., Kravchenko, Ye., & Pryma, A. (2025). Analysis of defense review experience of NATO member states. Collected Scientific Papers of the Center for Military and Strategic Studies of NDUU, 2(85), 24–33. https://doi.org/10.33099/2304-2745/2025-2-85/24-33
Galahan, V. (2024). Procedure for assessing the capability of military command authorities. Collected Scientific Papers of the Center for Military and Strategic Studies of NDUU, 1(80), 59–65. https://doi.org/10.33099/2304-2745/2024-1-80/59-65
Surkov, O. O., Safronov, O. V., & Romaniuk, A. M. (2024). Proposals for organizing and conducting a comprehensive review of the security and defense sector of Ukraine. In State policy in the field of defense (pp. 51–63). National Defense University of Ukraine.
Ministry of Defense of Ukraine. (2020). Order “On approval of the procedure for organizing and implementing defense planning” (No. 484). https://zakon.rada.gov.ua/go/z0196-21
Verkhovna Rada of Ukraine. (2018). Resolution of the Cabinet of Ministers of Ukraine “On approval of the procedure for conducting a defense review” (No. 941). https://zakon.rada.gov.ua/laws/show/941-2018-%D0%BF
BSC Designer. (2025). Results-based management vs balanced scorecard for strategy implementation. https://bscdesigner.com/results-based-management.htm
Krykun, P., Pavlenko, V., Korendovych, V., Yasenko, S., et al. (2024). Development of the national defense planning system. Journal of Scientific Papers “Social Development and Security”, 14(3), 14–32. https://doi.org/10.33445/sds.2024.14.3.2
Yasenko, S., & Tkach, I. (2023). A review of selected analytical models. Journal of Scientific Papers “Social Development and Security”, 13(1), 111–127. https://doi.org/10.33445/sds.2023.13.1.10
Petrenko, A. (2019). Methodological approach to assessing existing capabilities. Modern Information Technologies, 35(2), 99–104. https://doi.org/10.33099/2311-7249/2019-35-2-99-104
Dukach, Yu., Kyianytsia, Z., Koniechna-Salamatin, Y., Kravchuk, I., et al. (2018). Monitoring and evaluation. Alliance for Public Health.
Sumy State University. (2022). Monitoring and evaluation of management activities (lecture notes).
Lendiel, M., Vynnytskyi, B., Rateichak, Yu., & Sanzharovskyi, I. (2007). Guide to monitoring and evaluation of regional development programs. K.I.S.
Kravchuk, I., Pylhun, L., & Savva, M. (2016). Monitoring and evaluation of project social impact. International Renaissance Foundation.
Barabash, Yu. L. (1999). Fundamentals of the theory of evaluating the effectiveness of complex systems. National Academy of Defense of Ukraine.
But, Yu. I., & Remez, A. V. (2020). Conceptual foundations for evaluating the effectiveness of types of defense. Nauka i oborona, (3), 41–45. https://doi.org/10.33099/2618-1614-2020-12-3-41-45
Sampir, O. (2021). Improved methodology for evaluating the weapon recovery system. Journal of Scientific Papers “Social Development and Security”, 11(5), 165–178. https://doi.org/10.33445/sds.2021.11.5.16
Abstract views: 39 PDF Downloads: 22
Copyright (c) 2025 Oleg Surkov, Serhii Yasenko
This work is licensed under a Creative Commons Attribution 4.0 International License.
The authors agree with the following conditions:
1. Authors retain copyright and grant the journal right of first publication (Download agreement) with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
2. Authors have the right to complete individual additional agreements for the non-exclusive spreading of the journal’s published version of the work (for example, to post work in the electronic repository of the institution or to publish it as part of a monograph), with the reference to the first publication of the work in this journal.
3. Journal’s politics allows and encourages the placement on the Internet (for example, in the repositories of institutions, personal websites, SSRN, ResearchGate, MPRA, SSOAR, etc.) manuscript of the work by the authors, before and during the process of viewing it by this journal, because it can lead to a productive research discussion and positively affect the efficiency and dynamics of citing the published work (see The Effect of Open Access).
