1. What is the assignment that the Bank received?
In December 2018, the Ministry of Science and Education requested technical assistance from the World Bank in conducting a Public Expenditure Review in Science, Technology, and Innovation (PER STI). The Public Expenditure Review in Science, Technology and Innovation is a methodological framework developed by the World Bank for comprehensive analysis of national research and innovation systems, with an emphasis on their contribution to economic development of the country. It examines the conditions under which researchers and the private sector act, identifies strengths and areas for improvement, and reviews the amount and the quality of government support for science, technology and innovation. The Reimbursable Advisory Services (RAS) engagement started in May 2019 and has been initially structured around three areas: (i) quality and coherence of the policy mix, (ii) functional and governance analysis, and (iii) monitoring and evaluation. In March 2020, the assignment was expanded to include the evaluation of Croatia’s Smart Specialization Strategy (S3) 2016-2020, consisting of two additional activities: (i) mid-term evaluation of S3, and (ii) final evaluation of S3.
2. Why is the PER in STI conducted?
The PER in STI analyzes public funding for science, technology and innovation and recommends how to improve its effectiveness through smarter allocation of funds, improved design, implementation, and governance of public support programs, and better monitoring and evaluation systems. The project also aims to review the logical framework, governance structure, and results of the S3, which will be of great significance in the preparation of Croatia’s next Smart Specialization Strategy.
3. What is the role of the WB in conducting the PER in STI?
The role of the World Bank's technical assistance is to provide the analytical basis for improving the effectiveness of public spending for science, technology, and innovation. Over the medium term, the project is expected to contribute to increasing the absorption of EU funds for science, technology, and innovation. In the long term, this should lead to improved innovation performance of Croatia, as measured by innovation outputs such as intellectual property, publications, and similar.
The World Bank’s partners in this project are policymakers involved in the research and innovation agenda. The implementation of the project entails close cooperation with the Ministry of Science and Education, the Ministry of Economy and Sustainable Development, the Ministry of Regional Development and EU Funds, the Croatian Science Foundation, and HAMAG-BICRO (Croatian Agency for SMEs, Innovations and Investments). The analysis can also benefit the broader public, especially the scientific community and prospective and current beneficiaries of public support programs for science, technology, and innovation.
The project consists of five components:
- Quality and Coherence of the Policy Mix - presents a diagnostic of the Croatian National Innovation System, analyzes public funding for science, technology and innovation, and identifies gaps and overlaps in the policy mix. Work under this activity has been completed, and the report can be accessed here.
- Functional and Governance Analysis - reviews the processes and practices related to the design, implementation, and governance of public support programs for science, technology, and innovation, and identifies strengths and areas for improvement. Work under this activity has been completed, and the report can be accessed here.
- Monitoring and Evaluation – reviews the monitoring and evaluation (M&E) framework in place for STI support programs and suggests a revamped and harmonized setup of the M&E system for STI funding, as well as a revised M&E framework of individual programs. This activity also takes stock of the results achieved in selected programs, as well as the costs needed to run those programs. Work under this activity is in progress.
- Midterm Evaluation of S3 – provides an assessment of the logical framework of the S3 policy and governance structure, proposes an evaluation design of specific instruments, and reviews the progress on the smart skills agenda. Work under this activity is in progress.
- Final Evaluation of S3 – analyzes the achievement of expected goals and indicators and provides some evidence of outcomes of the S3. Work under this activity is pending.
4. What are some of the key findings?
There are several key initial findings of the RAS:
- Reform in the public research sector is incomplete, limiting its ability to foster research excellence and create linkages with the economy. The effectiveness of the research sector in producing influential work is limited, and a large volume of scientific publications goes uncited. The current governance, institutional, and career advancement framework constrains research and development (R&D) activities of higher education institutions and discourages collaboration both (i) within the research sector and (ii) between the research sector and the private sector. However, collaboration among researchers, especially international collaboration tends to yield more influential work. Public-private linkages should be strengthened by supporting technology transfer activities and allocating more funds towards applied research and experimental development.
- Croatia’s low productivity and growth could be raised by supporting R&D-based innovation, especially in smaller and younger firms. In Croatia, smaller and younger firms tend to see more productivity gains from investing in R&D. However, these firms tend to be less represented among beneficiaries of support programs funded from the European Structural and Investment Funds (ESIF).
- High-level reforms to innovation policy governance and financing are needed to improve Croatia’s innovation performance. Research and innovation support programs would need to be revised to be more targeted and coordinated. The various sources of funding should be linked better, combining programs more effectively. The current system for financing STI with EU funds needs to be reshaped and streamlined. The selection process for projects would need to be made much shorter. Interactions with beneficiaries would benefit from improvements by providing regular and reliable calls and reducing unnecessary requirements on applicants and beneficiaries.
- The monitoring and evaluation system for STI support programs would need to be revised and fully integrated, and used for systematic learning and facilitation of decision making. Results frameworks for programs should be developed based on explicit theories of change, and indicators standardized and harmonized across programs to allow for comparability and aggregation of results across programs.