Fact-finding study on the implementation of the evaluation requirement as foreseen by the GBER and relevant guidelines
The main aim of the study is the analysis of the requirements on evaluation of State aid in the 28 Member States and in-depth analysis of the implementation of the evaluation requirement in the cases for which an evaluation plan will be under discussion or approved by a Commission decision by 31.12.2019. The findings will serve as a basis for drawing policy conclusions on how well the evaluation requirements have been performing and feed into possible considerations on the future of the relevant regulatory framework.
Support and advice DG Regional and Urban Policy in its dialogue with Italian authorities on the programming of 2021-2027 European Structural and Investment Funding by examining Italy’s self-assessment of fulfilment of enabling conditions
Strategic consultancy to DG Regio on how to address, also from an administrative capacity angle, the challenges for Italian authorities to establish full compliance of all enabling conditions in a timely fashion in order to advise the Commission in the informal dialogue.
Support and advice DG Regional and Urban Policy and the relevant Italian administrations in view to enhance the administrative capacity of Italian ERDF Operational Programmes
Support and advice DG Regional and Urban Policy and the relevant Italian administrations in view to enhance the administrative capacity of Italian ERDF Operational Programmes by analyzing the activities and the achievements to improve the programmes implementation and establishing a non-exhaustive list of effective and non-effective measures of the ongoing ARPs (Administrative Reinforcement Plans).
Unitary evaluation of the Lombardy Operative Programmes 2014-2020 co-funded by the European Structural Funds (ERDF, ESF and EAFRD)
Within the programming period 2014-2020, the activities related to the unitary evaluation assumed growing relevance, according to the UE Regulation n. 1303/2013, art. 56 and the Italian Partnership Agreement. The Partnership Agreement with Italy establishes that the Evaluation Plan should be unitary at the regional level and that it should include the evaluations of the Regional Operational Programmes (ROP) ERDF and ESF, considering also the evaluation of the Rural Development Plan (RDP EAFRD). In accordance with the Partnership Agreement, the service provides a unitary overview on the evaluations of each Programme, offering both the overall analysis of the impact of the different funds in the Region both specific thematic in-depth analyses.
Development of system for management of Cohesion Policy in the Republic of Serbia
The purpose of the contract is to prepare the Serbian public administration for effective implementation of the EU Cohesion Policy in the Republic of Serbia. The overall objective is to set up and enhance the capacities of all relevant stakeholders for timely and efficient preparation, implementation, monitoring and evaluation of programmes and projects supported by Structural Funds and Cohesion Fund.
Ex post evaluation related to the 2007-2013 regional planning on INDUSTRIAL DEVELOPMENT AREAS
Evaluation of the effectiveness and efficiency of interventions in favor of industrial development areas
Training and support service for the staff of the Crotone Prefecture for the performance of technical and information support tasks for the municipalities in the preparation, review and monitoring of the anti-corruption plans
Strategic consulting for the provision of services on the preparation, analysis and review of anti-corruption plans
EU-Argentina Regional Policy Cooperation on Multi-Level Governance Systems – Institution and Capacity Building on Regional Policy Programming and Implementation
Technical assistance and support to the Ministry of Interior, Public Works and Housing of Argentina and other Ministries concerned for:
- the design and implementation of regional policies;
- setting up the monitoring and evaluation system;
- providing detailed guidelines and training for carrying out evaluation of enterprise support and innovation, rural development, transport, environment and energy, health, tourism and culture etc.
- strengthening and implementing system procedures of horizontal and vertical collaboration between Ministries and institutions linked to development;
- transfer the necessary knowledge and skills to provincial and national officials on the normative and organisational principles adopted in the framework of EU regional policy.
- EXECUTIVE SUMMARY Argentina EN_EU DEF
- EXECUTIVE SUMMARY Argentina ES_EU DEF
Support to public consultation on cohesion policy
The purpose of this assignment is to analyse the replies received in the public consultation on Cohesion Policy, in line with the procedures described in the Better Regulation Guidelines and Toolbox. Statistical and specialised data analysis software are used for the analysis. The results of the study will be used for preparation of post-2020 cohesion policy programmes and their impact assessment.
Drafting of the AIPs (Administrative Improvement Plans)
Ismeri is drafting the Administrative Improvement Plans (AIP), required in a second phase of the Italian policy for capacity building of institutions in charge of operational programmes co-financed by ESI Funds. Ismeri supports the Ministry and Umbria Region in identifying critical issues which may affect the management of the operational programmes and the control systems. Furthermore, Ismeri supports the concerned institutions in identifying significant and measurable administrative improvement objectives and in defining interventions, necessary to achieve such objectives.
Externalities of cohesion policy
The main objective of this study is to analyse externalities, including spillover economic effects, of cohesion expenditure that occur beyond the borders of the beneficiary Member State (in a neighbouring and/or other Member States) and/or involves parties from another Member State.
European Cohesion Policy relative to Regional Development policies in other parts of the World
The main objective of this study is to compare the main features of the EU’s Cohesion Policy with similar policies in other parts of the world . The review is focused on two important emerging countries, China and Brazil, as well as on two international organizations, ASEAN and MERCOSUR. The study is also aimed at providing recommendations to feed the political debate around the future of the EU Cohesion Policy after 2020.
Unitary evaluation of programmes co-financed by EU Funds in the 2014-2020 programming period – Lot 1 – Unitary evaluation of the EARDF – ERDF and ESF
The evaluation service provides general reports on the implementation progress and the results of the programmes, as well as thematic reports on internal areas, environmental sustainability, enteprise creation and administrative capacity. The approach adopted features a mix of qualitative and quantitative methodologies. The evaluation service is aimed at assessing the process of implemenation of the interventions and, afterwards, the socio-economic effects of the measures implemented within the programmes.
Support of European Structural and Investment Funds (ESI Funds) to the implementation of the Country Specific Recommendations and to structural reforms in Member States
The study concerns the support of European Structural and Investment Funds (ESI) to the implementation of the Country Specific Recommendations (CSRs) and to structural reforms in Member States. The analysis is aimed at assessing the alignment between Cohesion policy and the European Semester and at understanding how ESI Funds contribute to support reforms (including governance and institutional capacity), also through ex ante conditionalities. The ultimate objective is to identify main lessons learned for the preparation of the post 2020 programming period.
The aim of the contract is to provide an ‘Evaluation Helpdesk’ to the Commission that:
- reviews the 2014-2020 evaluation plans,
- identifies and reviews quality of evaluations undertaken by Managing Authorities in 2015-2019,
- provides support to Member States in refining evaluation plans and designing and managing evaluations.
- provides evidence to support the European Commission’s in summarising 2014-2020 evaluation findings.
Review of evaluations of Cohesion policy 2007-13 and development of structured approach to the review of the 2014-20 evaluation plans
The principal objective of the contract is to develop an approach which will support a future ‘Evaluation Helpdesk on Cohesion policy’, i.e. to compile a list of the evaluations undertaken by the Managing Authorities and other research produced within the Member States in 2013 and 2014; to review a sample of evaluations, and to develop a structured approach to the quality review of the 2014-2020 evaluation plans.
Ex post evaluation of Cohesion Policy programmes 2007-2013, focusing on the European Regional Development Fund (ERDF) and Cohesion Fund (CF) – Work Package 13 – Geography of expenditure (La Voce’s article)
The project assembled a database of allocations to selected projects as well as expenditure of the ERDF and CF programmes under the Convergence, Regional Competitiveness and Employment (RCE) and the European Territorial Cooperation objectives (ETC), at NUTS3 level of detail and by the 86 priority themes. In order to assemble the database, the study team interacted with all the MA of the EU28, while gaps are estimated econometrically. Further tasks include a consolidation with 2000-2006 NUTS3 data, and exploring the possibility to create a single series from 1994 onwards. The database has been used in further studies while the results of the exercise have been published in the form of maps
Technical support to analyze the actions to improve the Italian capacity in managing and implementing ERDF proposed in the operational programs (2013-2020)
Ismeri supported the definition of the “Administrative Improvement Plans” (AIP); approved the final plan and assisted the administrations during the first stage of implementation of the AIPs in order to enhance the administrative capacity of Italian ERDF and EFS management . Ismeri provided DG Regio technical support and advice for the approval and monitoring of the 28 AIP. The AIP model of intervention consist of a set of improving actions and targets to simplify and make more efficient and less costly the delivery mechanisms by intervening on the legislation, procedures, personnel organization and common instrument.
Ex post evaluation of Cohesion Policy programmes 2007-2013, focusing on the European Regional Development Fund (ERDF) and Cohesion Fund (CF) – Work Package One: Synthesis report
The evaluation summarized the work packages of the ‘ex post’ evaluation of the ERDF and CF in the 2007–2013 programming period, support Commission services in the organisation, coordination and quality assurance of all the work packages of the ‘ex post’ evaluation and carry out additional analysis. Economic data for 28 countries and for NUTS2 regions were analysed. Financial data were analysed in terms of decided amounts, paid amounts and de-commitments. Core indicators were analysed as well.
Ex ante evaluation of the NOP Culture and Development 2014-2020
Ex-ante evaluation of the National Operational Program 2014-2020 whose main activities have been: analysis of internal and external coherence of the program, support the review of the structure of the program, analysis of the logical framework, development of intermediate and final program indicators and targets. Analysis of adequacy of organizational structures and of measures foreseen to reduce the administrative burden.
On going evaluation of the Regional Operational Programme (European Regional Development Fund – Regional Competitiveness and Employment objective) 2007-2003
Evaluation activities aimed at supporting monitoring activities and to verify the achievement of the strategic objectives of the Operational Programme of Tuscany Region (Regional Competitiveness and Employment objective) 2007-2013. Besides five monitoring reports of the programme, five thematic evaluations are envisaged (R&D, Energy, Mountain areas, Managing of the program, Urban Development). The evaluations will use both quantitative (counterfactual) and qualitative methodologies (case studies and theory based approach).
Ex Post Evaluation of a National Programme Aiming at the Empowerment of the Public Administration in Convergence Regions”
Evaluation, quality monitoring, dissemination of results achieved through actions implemented under the Empowerment Programme, with the aim of maximising awareness in terms of integration, institutional capacity, communication and sharing of initiatives carried out in the light of the activities of the Ministry of Civil Service Reform (DFP) in the framework of the EU 2007-2013 programming period and the recent reform of the public administration.
Expert Evaluation Network delivering Policy Analysis
The Expert Evaluation Network has been established by DG Regio to deliver policy analysis on the performance of Cohesion Policy 2007-2013. As part of the “EvalNet” contract, Ismeri and their partners has coordinated a team of experts covering the entire EU27. Each year the network produces 27 country policy papers on selected themes (innovation policy and strategy, energy efficiency, financial engineering, jobs created), 27 country reports on achievements of Cohesion Policy, 2 EU Synthesis reports and an analysis of best practices in evaluation. This entails developing guidance material since reports are drafted in a way that they can be used as a tool in negotiating mandates 2014; indeed, they also focus on special aspects/issues suggested by the Geographical Units in order to support the negotiation process. As part of the project coordination, Ismeri provides quality-assurance and carries out monitoring and evaluation activities. This include synthesis and analysis of results, quality control (both regarding contents and language) of national contributions and consistency of reporting. An extensive methodological work is carried out in relation to: the preparation of the analytical templates for reporting and the selection of best practices in evaluation. In this respect, a specific task (task 4) on reviewing evaluation methodologies was carried out. All the 27 Member States and regions ERDF evaluations have been revised, classifying them and discussing in a methodological panels of experts, to develop guidelines and also train officials responsible of evaluation, especially in New Member States in order to improve their practices. In supporting the preparation of country reports, the coordinating team manages databases of regional development indicators and of financial data concerning EU funds support. All the above activities require a capacity to ensure backstopping in short notice to the Client. Finally the organisation of two meetings of the expert panel each year is expected
Regional challenges in the perspective of 2020 Regional disparities and future challenges
The study focused on the capacity of European regions to adapt their productive and social structure to the new international challenges and modifications in the international markets. This process was directly connected to the debate of the new cohesion policy after 2013, Europe 2020 and the capacity of single countries and the EU to support new development models. In this study Ismeri was responsible for drafting concept papers and organising seminars with officials from the EC, World Bank, the Bartelsmann Foundation and sectoral experts on the main challenges (globalisation, climate change, demographic change, new social risks, energy) affecting European territories in the upcoming years. In this project, Ismeri utilised an econometric model of the world economy to estimate the effects of globalisation on European and neighbourhood economies in 2020 and build up alternative scenarios for European regions.
Distribution of Competences in relation to Regional Development Policies in the Member States of the European Union
The study aimed at examining the interconnections between devolution trends in different Member States and the financial capacity that was granted to the local and regional authorities to exercise their new powers, with a particular focus on development policy. This analysis highlighted the actual extent of power-sharing among tiers of government concerning public expenditure for development and the relevance of EU Cohesion Support across spending categories and policy areas. In this project Ismeri has carried out data collection and analysis of the regional development spending of the different administrative levels. The analysis required the use of many statistical classifications (ESA95, COFOG, additionality definitions) and statistic and econometric estimation methods.
Ex-post evaluation of cohesion policy programmes 2000-2006 co-financed by the European Regional Development Fund (Objectives 1 and 2) – WP1: Coordination, Analysis and synthesis
This study was one of the 11 work packages (WPs) of the ex post evaluation of the impact of the Structural Funds in Objective 1 and Objective 2 regions on economic and social cohesion. The overall aim has been to coordinate the various studies being undertaken to assess the effect of Cohesion Policy over the period 2000-06. The ex post evaluation produced macroeconomic and regional development analysis, assembling and processing financial implementation data, as well as theoretical and international organisations recommendations. The team supervised thematic evaluations and econometric analyses of the other work packages, provide a taxonomy of Objective 2 programmes and regions. All these activities required a strong methodological work as well as quality assurance including synthesis and analysis of results, consistency of reporting etc. The assignment has produced original insights on regional convergence and territorial effects of Cohesion Policy in objective 2 regions. In addition, it has revised macroeconomic impacts estimated with econometric models. An extensive work on databases was carried during the analysis and an essential background information on implementation of Cohesion Policy was provided to the Commission, hence the outputs had a strong guidance role for the successive development of the policy. Finally, in supporting the preparation of country reports, the coordinating team manages databases of regional development indicators and of financial data concerning EU funds support. All the above activities require the capacity to ensure backstopping in short notice was also a fundamental requirement.
Technical Assistance to the economic and social parties engaged into the implementation and the audit processes of the OP within the 2000-2006 Community Support Framework for Objective 1 Regions (QCS) 2000-2006
The project aimed at improving the organization of the social dialogue between the socio-economic Parties and MAs of operational programs. In particular, we provided and promoted an organizational model to organize the partnership process between the public institutions, central and local, and the other social and economic partners. Such an organizational model was conceived and discussed with all partners and was finally approved and utilized. The organizational model defined all the procedural steps for assuring consultation and cooperation in the different phases of the management of the OP’s from the conception of the strategy to its implementation, management, evaluation etc. Other activities carried out within the project included (seminars on the model partnership, the status of partnerships) and numerous meetings and workshops on a large range of issues (development and labour policy, capacity building, institutional arrangements, etc.). The project has allowed Ismeri Europe to address the organizational problems of the different regional situations and to investigate the management mechanisms, the human resources allocation, the procedures characterizing each institution involved in the Operational Programs management.
Ex-Ante Evaluation of the Abruzzi ERDF 2007-2013 Operative Programme
This evaluation assists the process of regional programming, in an effort to increase programme coherence and effectiveness. Various methodologies are used: desk analysis, interviews, participation at events and assistance to the regional Nucleus of evaluation
Interim evaluation of the National Operative Programme (NOP) Industry and Local Entrepreneurial Development 2000-2006
Evaluation and analysis of the implementation of the National Operational Programme’s results and impact; utilisation of the system of indicators provided by the EC Support Framework and the operational Programme; collection and utilisation of qualitative and quantitative data in order to describe how objectives were achieved and to highlight success factors and/or obstacles encountered.