The objective of the study is to assess the impact of the following EU initiatives and policies on cohesion, understood as the extent of regional and social disparities in the EU, during the period 2014-2020:
– The Common Agricultural Policy, including income, market and rural
development measures;
– The Common Fisheries Policy;
– The European Research and Innovation policy (Horizon 2020);
– The Recovery and Resilience Facility (RRF);
– The TEN-T policy and the Connecting Europe Facility;
– The EU Emissions Trading System;
– The Innovation and Modernisation Funds;
– The European Fund for Strategic Investments and the InvestEU Programme;
– ERASMUS+, in particular the impact of the programme on the national and regional population of learners and staff in formal, informal and non-formal learning , in the EU. In addition, the study will also analyse funds disbursed under regional State aid, with a particular attention to the amounts of aid channelled to EU regions under this regime to
enhance regional development.

The overall purpose of this study is to carry out a comprehensive revision of the baselines for administrative costs and burden of the CPR Funds for which such baselines exist, based on datasets as complete and coherent as possible between Funds, and to establish such baselines where they do not exist (AMIF, ISF and BMVI -altogether, the HOME Funds-, and JTF).
These baselines will also be used to assess whether the previous estimations of administrative costs and cost savings have materialised and for the preparation of new proposals and options regarding post-2027 Funds.
Additionally, the study aims to identify and quantify the administrative costs and burden deriving from additional national, regional or programme-specific regulatory frameworks and rules, specific implementation practices (e.g. based on administrative practices and culture), going beyond the EU legislative framework for the CPR Funds. The objective is to quantify in an objective manner the administrative costs related to CPR Funds programmes as those stemming directly from the EU legislation, net of gold-plating costs.

The independent evaluation service, in favor of the Managing Authority, of Axis 5, 8 and SiGeCo – Governance of the NOP Metro 2014-2020 aims at analyzing the functioning of the management and control system required of the Metropolitan Cities for the implementation of the Programme, highlighting the critical issues that arose in the implementation process of the various municipalities, understanding the causes and identifying possible improvements and corrective measures that can ensure more effective and efficient management of the new NP Metro Plus and Southern Medium Cities 2021-2027.

This study will take stock of the different types of investments co-financed by the European Regional Development Fund (ERDF) in the 2014-2020 period ensuring the enhancement of institutional capacity of public authorities and stakeholders and an efficient public administration and strengthening administrative capacity for the management and use of the ERDF and Cohesion Fund (CF). It will assess their rationale and the evidence of their effectiveness, efficiency and impact, their coherence with other policies, their relevance and the EU added value. It will seek to identify factors contributing to the success or failure of these investments under different socio-economic conditions, good practices and their contribution to good governance also beyond the implementation of the funds. The study will also investigate the results of all the investments funded by the ERDF and the Cohesion Fund in addressing and promoting reforms in the Member States.

Analysis of the policy implementation and evaluation of the policy effectiveness based on a quali-quantitative evaluation approach. The objective was to provide recommendations on the refundable schemes envisaged in the 2021-2027 programming period.

The study will focus on the following challenges and megatrends: globalisation closely linked to digitalisation, demographic change and the transition of EU economies and societies towards climate neutrality; and it will identify their impact on regional disparities and regional development potential in the 2035  medium-term perspective

Strategic specialist support and technical assistance to the Managing Authority of the National Culture Program 2021-2027 for the purpose of implementing the Administrative Regeneration Plan

Ismeri will work with metropolitan areas in Italy’s less developed regions, i.e. with the metropolitan areas of Bari, Catania, Messina, Napoli and Reggio Calabria. The work will be carried out in close cooperation with cities and the Managing Authority of PON Metro. The objective is to give cities a head start in implementation of projects by increasing capacities of responsible administrations for carrying out investments. The philosophy of this intervention is to develop projects that address bottlenecks and enable cities to handle more investments and thus have a multiplier effect on investments of European funds.

Definition of an analytical framework of administrative capacity in Italy starting from an analysis of the interventions financed under TO11, to be used as a starting point – together with other relevant information- to design interventions in the framework of the National Recovery and Resilience Plan (PNRR) and NOP “Capacity for Cohesion” 2021-2027

This study aims at assessing the effectiveness of the partnership principle in the context of cohesion policy and the Funds covered by the 2021-2027 CPR, during the programming and implementation phases.

Analysis of the results and impacts of the ERDF and Cohesion Fund programmes in the 2014-2020 programming period across all the Member States. As responsible of Work Package 1, Ismeri Europa and Applica will support the European Commission in coordinating all the ex-post sectoral assessments (on research, environment, business support, transport, administrative capacity). The results of the evaluation will be available after three years and will help define the new guidelines of the European Commission.

Support and technical secretariat for the implementation of the simplification measures established within Regional Law n ° 24 of 20.10.2016 “Rules on the quality of regulation and simplification of administrative procedures” including the activity of analysis, coordination and formulation of rules / regulations / directives related to the simplification of administrative procedures.

The objective of this assignment is to take stock of and disseminate information on the practices and procedures that authorities responsible for the management of the ERDF, ESF and Cohesion Fund in EU Member States are applying as regards the selection of operations in the programming period 2014-2020. The study analyses in depth the selection process of a sample of 90 calls for proposals, with a balance geographical coverage, highlighting possible challenges and good practices with the final aim to provide a handbook of practices that could help Managing Authorities to efficiently set up their selection processes also in view of the next programming period.

https://ec.europa.eu/regional_policy/information-sources/publications/reports/2023/selection-of-operations-taking-stock-of-practices-in-the-eu-member-states_en

Evaluation of the progress in the implementation of the Programme (with reference to all the thematic and specific objectives) and its actual performance with respect to EU and national priorities, as well as the effects that are being experienced in some thematic areas.

The evaluation analyzes to what extent the support offered by Start & Smart Italia (S&SI) has contributed to the growth of innovative start-ups and to the increase in employment. The results of the evaluation will also help prepare the new 2021-2027 programming.

The objective of the evaluation of e-cohesion is  threefold:
1) to provide up to date information on the implementation and performance of e-cohesion systems during the 2014-2020 programming period and also to identify good practice systems which could help inspire further developments of e-cohesion systems in other Member States; 2) to  identify the challenges and difficulties encountered by the Member States in setting up e-cohesion systems and document them in a Catalogue of challenges;3) to analyse the preparedness of the e-cohesion systems currently in place in view of the main relevant changes to be introduced by the new CPR for the 2021 – 2027 programming period, and to identify options for the possible avenues for improvement to ensure that the users of e-cohesion systems are able to make the most of the simplification potential of e-cohesion.

https://op.europa.eu/en/publication-detail/-/publication/5f2b4c00-e79c-11ec-a534-01aa75ed71a1

Analysis of the priorities and opportunities in the framework of the new EU programming period 2021 – 2027

The main aim of the study is  the analysis of the requirements on evaluation of State aid in the 28 Member States and in-depth analysis of the implementation of the evaluation requirement in the cases for which an evaluation plan will be under discussion or approved by a Commission decision by 31.12.2019. The findings will serve as a basis for drawing policy conclusions on how well the evaluation requirements have been performing and feed into possible considerations on the future of the relevant regulatory framework.

Support and advice DG Regional and Urban Policy and the relevant Italian administrations in view to enhance the administrative capacity of Italian ERDF Operational Programmes by analyzing the activities and the achievements to improve the programmes implementation and establishing a non-exhaustive list of effective and non-effective measures of the ongoing ARPs (Administrative Reinforcement Plans).

Strategic consultancy to DG Regio on how to address, also from  an administrative capacity angle, the challenges for  Italian authorities to establish full compliance of all enabling conditions in a timely fashion in order to advise the Commission in the informal dialogue.

Within the programming period 2014-2020, the activities related to the unitary evaluation assumed growing relevance, according to the UE Regulation n. 1303/2013, art. 56 and the Italian Partnership Agreement. The Partnership Agreement with Italy establishes that the Evaluation Plan should be unitary at the regional level and that it should include the evaluations of the Regional Operational Programmes (ROP) ERDF and ESF, considering also the evaluation of the Rural Development Plan (RDP EAFRD). In accordance with the Partnership Agreement, the service provides a unitary overview on the evaluations of each Programme, offering both the overall analysis of the impact of the different funds in the Region both specific thematic in-depth analyses.

The purpose of the contract is to prepare the Serbian public administration for effective implementation of the EU Cohesion Policy in the Republic of Serbia. The overall objective is to set up and enhance the capacities of all relevant stakeholders for timely and efficient preparation, implementation, monitoring and evaluation of programmes and projects supported by Structural Funds and Cohesion Fund.

Evaluation of the effectiveness and efficiency of interventions in favor of industrial development areas

The project’s goal is to improve the management of corruption risk within local authorities through a capacity building action aimed at the territorial office of the Government and six municipalities in Calabria. The activities carried out were:  analysis of the influence of the context on the corruption phenomena of the Administration Public; organizational analysis of the entities involved, mapping of administrative processes; identification and weighting of the corruption risk linked to administrative processes; definition of risk mitigation measures, definition of indicators (implementation and effectiveness) and organization of the risk management monitoring and review system.

Technical assistance and support to the Ministry of Interior, Public Works and Housing of Argentina and other Ministries concerned for:

• the design and implementation of regional policies;
• setting up the monitoring and evaluation system;
• providing detailed guidelines and training for carrying out evaluation of enterprise support and innovation, rural development, transport, environment and energy, health, tourism and culture etc.
• strengthening and implementing system procedures of horizontal and vertical collaboration between Ministries and institutions linked to development;
• transfer the necessary knowledge and skills to provincial and national officials on the normative and organisational principles adopted in the framework of EU regional policy.
• EXECUTIVE SUMMARY Argentina EN_EU DEF
• EXECUTIVE SUMMARY Argentina ES_EU DEF

The purpose of this assignment is to analyse the replies received in the public consultation on Cohesion Policy, in line with the procedures described in the Better Regulation Guidelines and Toolbox. Statistical and specialised data analysis software are used for the analysis. The results of the study will be used for preparation of post-2020 cohesion policy programmes and their impact assessment.

Ismeri is drafting the Administrative Improvement Plans (AIP), required in a second phase of the Italian policy for capacity building of institutions in charge of operational programmes co-financed by ESI Funds. Ismeri supports the Ministry and Umbria Region in identifying critical issues which may affect the management of the operational programmes and the control systems. Furthermore, Ismeri supports the concerned institutions in identifying significant and measurable administrative improvement objectives and in defining interventions, necessary to achieve such objectives.

The main objective of this study is to analyse externalities, including spillover economic effects, of cohesion expenditure that occur beyond the borders of the beneficiary Member State (in a neighbouring and/or other Member States) and/or involves parties from another Member State.

http://www.europarl.europa.eu/RegData/etudes/STUD/2018/617491/IPOL_STU(2018)617491_EN.pdf

The main objective of this study is to compare the main features of the EU’s Cohesion Policy with similar policies in other parts of the world . The review is focused on two important emerging countries, China and Brazil, as well as on two international organizations, ASEAN and MERCOSUR. The study is also aimed at providing recommendations to feed the political debate around the future of the EU Cohesion Policy after 2020.

Link

The evaluation service provides general reports on the implementation progress and the results of the programmes, as well as thematic reports on internal areas, environmental sustainability, enteprise creation and administrative capacity. The approach adopted features a mix of qualitative and quantitative methodologies. The evaluation service is aimed at assessing the process of implemenation of the interventions and, afterwards, the socio-economic effects of the measures implemented within the programmes.

The study concerns the support of European Structural and Investment Funds (ESI) to the implementation of the Country Specific Recommendations (CSRs) and to structural reforms in Member States. The analysis is aimed at assessing the alignment between Cohesion policy and the European Semester and at understanding how ESI Funds contribute to support reforms (including governance and institutional capacity), also through ex ante conditionalities. The ultimate objective is to identify main lessons learned for the preparation of the post 2020 programming period.

The aim of the contract is to provide an ‘Evaluation Helpdesk’ to the Commission that:

• reviews the 2014-2020 evaluation plans,
• identifies and reviews quality of evaluations undertaken by Managing Authorities in 2015-2019,
• provides support to Member States in refining evaluation plans and designing and managing evaluations.
• provides evidence to support the European Commission’s in summarising 2014-2020 evaluation findings.

The principal objective of the contract is to develop an approach which will support a future ‘Evaluation Helpdesk on Cohesion policy’, i.e. to compile a list of the evaluations undertaken by the Managing Authorities and other research produced within the Member States in 2013 and 2014; to review a sample of evaluations, and to develop a structured approach to the quality review of the 2014-2020 evaluation plans.

http://www.eyesreg.it/
The project assembled a database of allocations to selected projects as well as expenditure of the ERDF and CF programmes under the Convergence, Regional Competitiveness and Employment (RCE) and the European Territorial Cooperation objectives (ETC), at NUTS3 level of detail and by the 86 priority themes. In order to assemble the database, the study team interacted with all the MA of the EU28, while gaps are estimated econometrically. Further tasks include a consolidation with 2000-2006 NUTS3 data, and exploring the possibility to create a single series from 1994 onwards. The database has been used in further studies while the results of the exercise have been published in the form of maps

Ismeri supported the definition  of the  “Administrative Improvement Plans” (AIP); approved the final plan and assisted the administrations during the first stage of implementation of the AIPs in order to enhance the administrative capacity of Italian ERDF and EFS management . Ismeri provided DG Regio technical support and advice for the approval and monitoring of  the 28  AIP. The AIP model of intervention  consist of a set of improving actions and targets to simplify and make more efficient and less costly  the  delivery mechanisms by intervening on the legislation, procedures, personnel organization and common instrument.

The evaluation summarized the work packages of the ‘ex post’ evaluation of the ERDF and CF in the 2007–2013 programming period, support Commission services in the organisation, coordination and quality assurance of all the work packages of the ‘ex post’ evaluation and carry out additional analysis. Economic data for 28 countries and for NUTS2 regions were analysed. Financial data were analysed in terms of decided amounts, paid amounts and de-commitments. Core indicators were analysed as well.

Ex-ante evaluation of the National Operational Program 2014-2020 whose main activities have been: analysis of internal and external coherence of the program, support the review of the structure of the program, analysis of the logical framework, development of intermediate and final program indicators and targets. Analysis of adequacy of organizational structures and of measures foreseen to reduce the administrative burden.

Evaluation activities aimed at supporting monitoring activities and to verify the achievement of the strategic objectives of the Operational Programme of Tuscany Region (Regional Competitiveness and Employment objective) 2007-2013. Besides five monitoring reports of the programme, five thematic evaluations are envisaged (R&D, Energy, Mountain areas, Managing of the program, Urban Development). The evaluations will use both quantitative (counterfactual) and qualitative methodologies (case studies and theory based approach).

Evaluation, quality monitoring, dissemination of results achieved through actions implemented under the Empowerment Programme, with the aim of maximising awareness in terms of integration, institutional capacity, communication and sharing of initiatives carried out in the light of the activities of the Ministry of Civil Service Reform (DFP) in the framework of the EU 2007-2013 programming period and the recent reform of the public administration.

The Expert Evaluation Network has been established by  DG Regio to deliver policy analysis on the performance of Cohesion Policy 2007-2013. As part of the “EvalNet” contract, Ismeri and their partners has coordinated a team of experts covering the entire EU27. Each year the network produces 27 country policy papers on selected themes (innovation policy and strategy, energy efficiency, financial engineering, jobs created), 27 country reports on achievements of Cohesion Policy, 2 EU Synthesis reports and an analysis of best practices in evaluation. This entails developing guidance material since reports are drafted in a way that they can be used as a tool in negotiating mandates 2014; indeed, they also focus on special aspects/issues suggested by the Geographical Units in order to support the negotiation process. As part of the project coordination, Ismeri provides quality-assurance and carries out monitoring and evaluation activities. This include synthesis and analysis of results, quality control (both regarding contents and language) of national contributions and consistency of reporting. An extensive methodological work is carried out in relation to: the preparation of the analytical templates for reporting and the selection of best practices in evaluation. In this respect, a specific task (task 4) on reviewing evaluation methodologies was carried out. All the 27 Member States and regions ERDF evaluations have been revised, classifying them and discussing in a methodological panels of experts, to develop guidelines and also train officials responsible of evaluation, especially in New Member States in order to improve their practices. In supporting the preparation of country reports, the coordinating team manages databases of regional development indicators and of financial data concerning EU funds support. All the above activities require a capacity to ensure backstopping in short notice to the Client. Finally the organisation of two meetings of the expert panel each year is expected

The study focused on the capacity of European regions to adapt their productive and social structure to the new international challenges and modifications in the international markets. This process was directly connected to the debate of the new cohesion policy after 2013, Europe 2020 and the capacity of single countries and the EU to support new development models. In this study Ismeri was responsible for drafting concept papers and organising seminars with officials from the EC, World Bank, the Bartelsmann Foundation and sectoral experts on the main challenges (globalisation, climate change, demographic change, new social risks, energy) affecting European territories in the upcoming years. In this project, Ismeri utilised an econometric model of the world economy to estimate the effects of globalisation on European and neighbourhood economies in 2020 and build up alternative scenarios for European regions.

The study aimed at examining the interconnections between devolution trends in different Member States and the financial capacity that was granted to the local and regional authorities to exercise their new powers, with a particular focus on development policy. This analysis highlighted the actual extent of power-sharing among tiers of government concerning public expenditure for development and the relevance of EU Cohesion Support across spending categories and policy areas. In this project Ismeri has carried out data collection and analysis of the regional development spending of the different administrative levels. The analysis required the use of many statistical classifications (ESA95, COFOG, additionality definitions) and statistic and econometric estimation methods.

This study was one of the 11 work packages (WPs) of the ex post evaluation of the impact of the Structural Funds in Objective 1 and Objective 2 regions on economic and social cohesion. The overall aim has been to coordinate the various studies being undertaken to assess the effect of Cohesion Policy over the period 2000-06. The ex post evaluation produced macroeconomic and regional development analysis, assembling and processing financial implementation data, as well as theoretical and international organisations recommendations. The team supervised thematic evaluations and econometric analyses of the other work packages, provide a taxonomy of Objective 2 programmes and regions. All these activities required a strong methodological work as well as quality assurance including synthesis and analysis of results, consistency of reporting etc.  The assignment has produced original insights on regional convergence and territorial effects of Cohesion Policy in objective 2 regions. In addition, it has revised macroeconomic impacts estimated with econometric models. An extensive work on databases was carried during the analysis and an essential background information on implementation of Cohesion Policy was provided to the Commission, hence the outputs had a strong guidance role for the successive development of the policy.  Finally, in supporting the preparation of country reports, the coordinating team manages databases of regional development indicators and of financial data concerning EU funds support. All the above activities require the capacity to ensure backstopping in short notice was also a fundamental requirement.

The project aimed at improving the organization of the  social dialogue between the socio-economic Parties and MAs of operational programs.  In particular, we provided and promoted an organizational model to organize the partnership process between the public institutions, central and local, and the other social and economic partners.  Such an organizational model was conceived and discussed with all partners and was finally approved and utilized.  The organizational model defined all the procedural steps  for assuring  consultation and cooperation in the different phases of the management of the OP’s from the conception of the strategy to its implementation, management, evaluation etc.   Other activities carried out within the project included (seminars on the model partnership, the status of partnerships) and numerous meetings and workshops on a large range of issues (development and labour policy, capacity building, institutional arrangements, etc.). The project has allowed Ismeri Europe to address the organizational problems of the different regional situations and to investigate the management mechanisms, the human resources allocation, the procedures characterizing each institution involved in the Operational Programs management.

This evaluation assists the process of regional programming, in an effort to increase programme coherence and effectiveness. Various methodologies are used: desk analysis, interviews, participation at events and assistance to the regional Nucleus of evaluation

Evaluation and analysis of the implementation  of  the National Operational Programme’s results and impact; utilisation of the  system of indicators provided by the EC Support Framework and the operational Programme;  collection and utilisation of qualitative and  quantitative data in order to describe how objectives were achieved  and to highlight success factors and/or obstacles encountered.

This service is aimed at providing an assessment of the results of the measures financed under the 1^st axis of the ERDF OP 2014-2020, to support the development of the regional High-tech Network (Rete Alta-Tecnologia), and proposing recommendations to strengthen the network in the 2021-2027 programming period.

Please find below the thematich report on S3

The general objective of this proyect is to strengthen the impact of existing actions aimed at further developing start-up and scale up support by building on the experience of some of Europe’s most entrepreneurial regions and capitalising on the Committee of the Regions’s links to and communication channels with regions and local actors.

Ismeri Europa supports the Tuscany Region in the process of reviewing its Smart Specialization Strategy (S3). The work will synthesize and integrate the updated roadmaps as proposed by the Technological Districts and by the regional offices in charge of establishing and implementing the regional industry 4.0 strategy.  This activity allows (through Ismeri’s RED database) the comparison of the proposed roadmaps with the European research scenario developed under the Horizon 2020 programme. Ismeri Europa will then carry out benchmarking analyses at EU level to assess the competitive advantage in the research areas supported by the S3 of the Tuscany region and its main R&D assets and therefore to validate the proposed updates.

Technical assistance and support to the Ministry of Interior, Public Works and Housing of Argentina and the Ministries concerned, for the design and implementation of regional policies, for which European Union experience is regarded as of high importance. The specific project objectives are:

–  Assistance in the overall design of the federal system of territorial development, focusing on the process of interaction of the three tiers of government, as well as civil society; Assistance in the development of the principles, standards and the specific regulations for the planning, management and measurement of the impact of productive development projects in provinces and municipalities;  Assistance in the design of capacity building programmes (training of trainers) for national, provincial and local actors, public and private, involved in the processes of planning and management of territorial development programmes;  Assistance in the launch of two territorial development pilot projects in two Argentinian Provinces.

link

The objective of the work was to provide an up to date measure of the implementation of the S3 strategy (years 2014 and 2015) and offer an in depth analysis of the technology trends and of the coherence with the strategy, emerging from the projects financed under the S3. The activities carried out by Ismeri Europa involved the measuring of the indicators indicated in the strategy and the analysis of the monitoring data of the regional programmes (especially regarding the  ERDF operational programme) in order to measure the implementation of the S3 accordingly with the priority areas and roadmaps of the strategy. Furthermore Ismeri Europa has provided an analysis of the technology level (through RED methodology)   of the regional R&D projects financed under the S3 and those developed within the European research scenario of Horizon 2020 in order to identify specific research trends and suggest possible adjustments of the strategy.

analysis of the participation of universities in the context of the framework programmes of research and technological development (FP4-FP7) in terms of motivation, partnerships created and scientific output. The analysis also investigates reasons for rejection and paths of non-successful proposals. A mix of methods is used, including: statistical analysis of combined databases, social network analysis, case studies and interviews. The study aims at providing an input to the ex post evaluation of the 7th Framework Programme

https://ec.europa.eu/research/evaluations/pdf/archive/other_reports_studies_and_documents/ki0116395enn.pdf

Comparative assessment of the technological and economic results of the industrial research laboratories financed by the regional research programme; evaluation of their capacity to carry out industrial research activities and technology transfer to local enterprises; analysis of the sustainability of each laboratory; assessment of the technological potential and of the competitive positioning of the laboratories at the European level; identification of key constraints for the competitiveness of the laboratories and formulation of recommendations for overcoming obstacles; assistance to the Region in the definition of research support measure in relation to the ERDF Regional Operational Programme 2014-2020.

ISMERI provided technical assistance to support designing a national call for tenders for business research and innovation projects. The focus was on “sustainable industry” and, in line with EU2020, the financed projects should aim at promoting an intelligent, sustainable and inclusive growth. We used our data on FP7 participation to identify the most important key technologies which are relevant for the agreed definition of “sustainable industry”, and to estimate the potential demand for the business sector. Based on this information, some focus groups involving sectorial experts, policy makers and firms were organised to discuss and shortlist the most promising investment priorities. Differently from the past and similar support initiatives, the policy maker started from a knowledge base of key technology fields and catalysed the stakeholders’ discussion on those.

The project, implemented on the basis of the National Operative Programme (NOP) Industry and the NOP Research 2000-2006, in Convergence regions includes qualitative and quantitative analysis, questionnaire design and an online survey of the beneficiary firms. The analysis is based organizing and carrying out field work and direct interviews of 600 enterprises, case studies and focus groups.

The project consists in the design and provision of training and tutoring services to support preparation and implementation of regional strategy of innovation and to support the development of services for the inclusion of SMEs in the innovation system. The cooperation involves the EC, Emilia-Romagna region (Italy), Baden-Wurttemberg (Germany), and two regions where the EC provides external assistance: the State of St. Catarina (Brazil) and the Province of Cordoba (Argentina). The project’s activities include: a series of workshops in LA, study visits in Europe and tutoring in both Argentina and Brazil. The preparation and delivery of the training requires a methodological work which includes also a specific module on policy monitoring and evaluation. The projects final outputs include a set of guidelines/manuals on how to prepare and implement a regional strategy of innovation as well as guidelines for managing innovative services for SMEs. This includes elements of quality assurance as well.

The Regional Innovation Monitor (RIM) aims to become a reference EU framework, supporting national, regional and local administration policy-makers, regional administrators, innovation programme managers, other innovation actors and researchers in the EU in the development of more efficient regional innovation strategies. The project consists of collecting quali-quantitative information on the RTDI performance of European regions, analysing and publishing it on a Commission Web repository. The first phase entailed the production of: baseline regional profiles across the EU27, regional policy papers concerning innovation performance and challenges, governance, regional policy mix.

The Technology Assessment project consists in: mapping the regional innovation system with a special focus on the high-tech network of labs and the associated actors (firms and university depts.); carrying out a benchmarking of the network in relation to European best practices, which aims at assessing the appropriateness of the technological roadmaps followed by the regional actors; identifying strategic and operational directions to support the improvement of the organisational arrangements which characterise the functioning of the network. The regional mapping and benchmarking requires extensive methodological work, in particular monitoring and evaluation tools as well as the preparation of analytical templates for the analysis and benchmarking of technology platforms. The analysis carried out also entails elements of quality control and consistency of reporting  across sectors.   As part of the analytical work, databases of key performance indicators are set up and managed. The final task of the project (action plan) requires developing guidance material since the team supports the region in preparing a plan for the future development of the network. All the above activities require a capacity to ensure backstopping in short notice to the Client.

The challenge of the project, financed by the 7FP and coordinated by the CEPN-Centre d’Économie – Paris Nord (CNRS/ Université Paris Nord) was to capture, within a set of scenarios, characteristics and implications of different patterns that may occur in Europe and in the World in several domains in 2030 (economic, financial, environmental, technological, political, demographical and social), taking into account past trends and likely changes in technology, individual behaviour and institutional transformations. ISMERI was the leading partner in the Work Package 7 (WP7) “Well being and living conditions”, and contributed to the WP1 “A macro-model of world regions” and to the WP4 “Global development, demography and migration”. As part of the analysis of past trends and future prospects of well being and living conditions, ISMERI has tried to clarify how people could benefit from growth trajectories from the present time to 2030. This required an extensive methodological work including econometric modelling, analysis and synthesis of results, development and management of complex databases covering the entire world, hence including the regions where the EC provides external assistance.

The project consisted in selecting two South American regions on the basis of the research and innovation features, analysing their innovation systems and set the basis for establishing research cooperation initiatives with European regions. The team designed and applied a methodology for analysing in detail the functioning and performance of the systems. Two case studies were drafted on the State of St. Catarina (Brazil) and on the Province of Cordoba (Argentina). The analysis provided an detailed mapping of the regional innovation actors (businesses and research centres, firms and clusters, public knowledge and technology intermediaries, national and regional policy makers etc.), their local and international linkages. Desk research and interviews with key stakeholders were carried out to collect data and key performance indicators of the functioning of the systems and identify directions for future cooperation with the EU.

The study assesses the completeness of the context analysis , the internal and external strategic coherence and estimates the impact of the programme. The programme amounts to 3600 million Euros and is devoted to supporting industrial research, excellence training, infrastructures and equipment to carry out frontier research.

This assignment follows the mid-term evaluation of the NOP Research and aims at shedding light on the actual impacts that the aid schemes for industrial research are likely to have produced some years after the projects’ conclusion. Data have been collected by means of an online questionnaire and analysed statistically. The focus was on creation of stable relationships with other firms and research centres, patenting, types of innovation and marketability of  technical solutions, assessment of the actual profitability or cost effectiveness of the projects, considering the amount of public resources spent. Final recommendations focused on how to improve future added value of intervention.

The project involved the drafting of 27 national reports (EU25 + Bulgaria and Romania) and the preparation of a EU27 synthesis report concerning: innovation potential in Europe; national and regional RTDI policy trends; the impact of Community support on knowledge and innovation policy across European regions; the promotion of good practices in innovation policy. The main goal of the study was to provide a set of strategic and operational recommendations to be used by DG Regional Policy geographical units in preparing the negotiations with the Member States for the period 2007-2013 and to prepare the next operational programmes.

The objective of this project was the evaluation of the programme and the development of recommendations on possible modifications and adjustments. This project included the evaluation of almost 1000 projects (3.200 Meuro) of excellence training and industrial research in high tech applications. This activity required the assessment of specialized training carried out by universities in specific scientific areas and of its coherence with the particular needs of firms. This, in turn, involved field research of almost 300 projects of industrial research to analyze their impact on firms’ competitiveness. A set of 30 quantitative performance indicators was collected and analyzed to highlight the impact of the project at different levels: human resources, field patents, type of innovation (product or process), impact of the market position of the firms etc.

Sorry, this entry is only available in Italiano and Español.

Support for the preparation of evaluation activities and the evaluation plan of the ERDF and ESF+ PR 2021-2027, able to cover the different methodological and operational aspects of the evaluation in compliance with the regulatory indications and content suggested by the EC, as well as technical and organisational support for the definition of a new model of partnership reports in the 2021-2027 programming period,

The study will assess the entire ESF+, meaning the ESF+ strand under shared management and the Employment and Social Innovation strand (the ‘EaSI strand’) implemented under direct and indirect management. It will cover the programming period starting with the ESF+ Regulation’s entry into force until the end 2023. This will include both programming and the early phase of implementation in the 27 Member States.

The  study shall: take stock of the results of ESF and YEI support achieved in the current programming period 2014-2020; assess the effectiveness, efficiency, relevance and EU added value of actions funded by the European Social Fund under the 2014-2020 programming period; provide lessons learned, which can be relevant for the implementation of the European Social Fund Plus during the programming period 2021-2027; underpin the Commission’s Staff Working Document on the ex-post evaluation of the European Social Fund and YEI; contribute to the design of future programmes beyond 2027.

This study will cover all ESF investment priorities in order to obtain a complete overview of ESF and YEI including CRII, CRII+ and REACT-EU support.

The project aims to strengthen the capacities and methodological instruments of the administrations managing and implementing ESIF, with a particular focus on evaluation instruments (aimed at gender mainstreaming). The improved integration of a gender mainstreaming approach into the evaluation activities will allow the identification of potential gender gaps and will promote a more effective evaluation of interventions and Operational Programmes.

The purpose of the study is to carry out a meta-analysis of the available ESF and YEI CIEs covering 2007-2013 and 2014-2020 periods. The aim of the meta-analysis is to synthesize the ESF and YEI CIEs in order to find systematic evidence on the effectiveness and sustainability of the ESF and YEI operations on employment, education and social inclusion. The results of the meta- analysis shall be compared with the international evidence of the meta-analysis of similar interventions.

DG Employed charged Ismeri Europa of updating the 2013 guide on how to carry out counterfactual impact evaluations. This guide is addressed to ESF Managing Authorities. The update will be done based on the new strategic and institutional framework of ESIFs, as well as on the recommendations drawn from the “Pilot and feasibility study on the sustainability and effectiveness of results for European Social Fund participant using Counterfactual impact evaluations”.

https://ec.europa.eu/social/main.jsp?catId=738&langId=en&pubId=8426&furtherPubs=yes

The purpose of this request for services is to support the contracting authority in analysing and assessing the potential impacts of different policy options concerning the personal scope of potential measures on the application of EU competition rules to collective bargaining/negotiations by the self-employed in need of protection.

Evaluation aimed at carrying out general analyses on the implementation framework of the 5 axes of the OP; it will focus on the activities carried out in each Axis, in each category of Regions and with reference to the investment priorities and specific objectives of the Programme

Evaluation of the ESF OP and of the single priority Axes, in particular: a) analysis of the strategy of the OP and its effectiveness with respect to the achievement of the objectives set; b) analysis of the physical, procedural and financial progress in the implementation of the OP; c) analysis of the implementation mechanisms of the OP; d) analysis of the results obtained with respect to the Europe 2020 objectives and other European and national objectives; e) analysis of the efficiency of the management and implementation mechanisms for the implementation of the Axes’ policies.

Exploratory analysis aimed at collecting information, interventions and the main results achieved in Lombardy rEGION as well as preparation of explanatory notes to support the activities of the Social Policies managed by DG of Lombardy Region, with a focus on the promotion of a synergy between actions implemented by different subjects tackling poverty and providing support to the Technical Secretariat of the regional poverty control room

The study aims at providing the Commission with opinions, evidence and analysis that will allow building up its evaluation of the ESF support to education and training. The evaluation will assess the effectiveness, efficiency, relevance, coherence and EU added value of actions funded by the European Social Fund under the current programming period.

https://ec.europa.eu/social/main.jsp?catId=738&langId=en&pubId=8346&furtherPubs=yes

Evaluation aimed at verifying the relevance, effectiveness and efficiency of the implementation of the interventions foreseen by the ESF OP 2014-2020.

Evaluation aimed at verifying the relevance, effectiveness and efficiency of the implementation of the interventions foreseen by the ESF OP 2014-2020.

Sorry, this entry is only available in Italiano.

The aim of the study was to evaluate the European Public Employment Sevices Network based on the objectives established in Decision 573/2014 / EU. The study assisted the Commission in assessing the relevance, effectiveness, efficiency, coherence and added value of decision 573/2014 / EU and in particular deepened the contribution of the European Network to the strengthening of employment services in some Member States including Italy.

Evaluation of the effectiveness, efficiency and impact of the Operational Programme and of its policies

Technical support for the development of a model for monitoring the performance of the National Agency of Active Labour Market Policies (ANPLA) and of the National Labour Inspectorate (INL)

The project is aimed at assessing the feasibility of Counterfactual impact evaluation (CIE) as an advantageous method for studying European Social Fund (ESF) interventions. The activities include:1) Mapping available data and judge whether CIE could be used more widely; 2) identify obstacles and propose ways to overcome them, notably as regards access to data registers;
3) explore how CIE could be used directly by the Commission to reach solid conclusions about the ESF effectiveness and sustainability of results;4) carry out a pilot exercise in a limited number of Member States on the sustainability and effectiveness of 2014-2020 ESF initiatives for long-term unemployed and early school leavers.

https://ec.europa.eu/social/main.jsp?catId=738&langId=en&pubId=8233&furtherPubs=yes

Framework contract to assist the Commission in implementing the Better Regulation Guidelines by carrying out studies in the field of employment, social affairs, labour mobility and skills with the purpose of supporting: (1) impact assessment for the design and preparation of policies, programmes and legislation; (2) evaluation to assess their effectiveness, efficiency, relevance, coherence and the added value; (3) monitoring their implementation.

https://ismerieuropa.com/wp-content/uploads/2019/07/KE-01-19-580-EN-N.pdf

Sorry, this entry is only available in Italiano.

The “Benchmarking of employment services’ contribution to the implementation of the Youth Guarantee”, financed within PARES (Partnership between Employment Services), was implemented by the Italian Ministry of Labour in cooperation with the national Authorities in charge of managing the Youth Guarantee scheme in France and in Hungary as well as the similar scheme in Serbia. Ismeri Europa supported the Ministry of labour with technical assistance to the methodological issues, data collection, benchmarking analysis and drafting reports. In particular IE drafted the methodological guidelines, the inception report and the final report of the study.

The main purpose of the present contract is to assist DG EMPL in assessing and reviewing the Italian Administrative Reinforcement Plans (ARPs) related to the implementation of ESF Operational Programmes. The study provides technical support to DG EMPL on the assessment of the ARP of the Italian Ministry of Labour whose approval is still pending in order to ensure that it reaches an adequate level. In addition to this, DG EMPL will be supported in preparing meetings with the Italian Authorities. Ismeri will provide 2 short reports, one based on a comparative analysis of the ESF role in the Italian ARPs, and a final report which will focus on analyzing the coherence between the ARPs and the actions funded under TO11 and Technical Assistance in the Italian OPs.

Sorry, this entry is only available in Italiano.

Evaluation of the Action 3, envisaged within the Action and Cohesion plan (PAC) and aimed at reducing the educational failure and the school drop-out in the regions of the Convergence Objective. Action 3 aims at developing models of educational and training actions from the pre-schooling period and the first cycle until the entry into the labour market, in areas characterized by a high school drop-out and by social and cultural exclusion. The project develops a transversal analysis of the interventions, an assessment of their effectiveness and develops a model of these interventions likely to be replicated during the next programming period.

Ex ante evaluation of the Operational Programme National Inclusion ESF relating to the programming period 2014 – 2020; The main activities were: analysis of internal and external coherence of the program, analysis of the logical framework, development of program indicators and targets intermediate and final analysis of the adequacy of the organizational and the measures envisaged to reduce the administrative workload.

The evaluation focuses on the interventions aimed at improving the educational and training system, promoting the access to the labour market and supporting the professional training of workers and unemployed people. Five ESF OPs are analyzed in depth: the National OP “Competence for Development”, the Apulia ROP and Sicily ROP for the Convergence area, the Tuscany ROP and the Piedmont ROP for the Competitiveness area.

Technical assistance aimed at promoting the ability of economic and social partners to interact with the authorities responsible for the Regional Operational Programme ESF Basilicata. The project has defined the procedures for consultation between stakeholders and supports the partnership relations through the implementation of preparatory documents, handbook on the functioning of Cohesion policy and the management of the ESF, and meetings.

The project aims at assessing the impact of six policy options identified by the EC to modify the current regulatory setting of posting at the European Union level. The study of the literature was carried out on both a set of national case studies and statistical and econometric analyses, and allowed to identify the extent of posting, its main features and drivers, the main economic, social and legal problems related to the phenomenon and then outline the objectives and scope of the desirable revisions.
All this process required an extensive methodological work, as well as the application of advanced monitoring and ex-ante evaluation techniques. The assessment also investigated the new obligations on information related to each of the six policy options and estimated the related administrative costs. A comparison among the suggested policy options, both in terms of effectiveness and administrative costs borne by the different stakeholders, was possible thanks to the several analyses carried out. A synthesis and analysis of the complex results, of quality control and of the consistency of reporting were the key tasks of this project.

The ESF NOP 2007-2013 supports systems and structures of the labour market and is managed by the Italian Ministry for Labour and Social policies. As part of the on-going multiannual programme evaluation, Ismeri carries out: an analysis of the efficiency of the management systems, an analysis of national reforms and their implication for the NOP’s strategy, an assessment of the results of interventions and their effects on the functioning of systems and structures; finally, the evaluation team identifies best practices among the carried out initiatives. Three thematic evaluations (immigrants, young people, institutional capacity) and two annual reports have been completed so far. The project activities require applying monitoring/evaluation methodologies, synthesis and analysis of results of the field research and surveys used to collect data and information, as well as elements of quality control and consistency of reporting to ensure that research outputs meet the required standards. As for institutional capacity, a second thematic evaluation is being carried and its aim is to identify lessons to improve the governance in 2014-2020 period.

The project has established an EU network of academics and practitioners on workers’ professional and geographical mobility to analyse new patterns of mobility and corresponding national policy developments in the context of the EES and post 2010. The network provides scientific background and support in the field of mobility and provides support to mobilising stakeholders by organising national and thematic workshops and an annual conference. A strong methodological work and the application of monitoring/evaluation methodologies are key project activities, especially in relation to the preparation of thematic reports. Synthesis and analysis of results of the work carried out by experts (case studies, annual reports etc.), quality control and consistency of reporting across the EU are also key elements of the assignment.

The Lombardy ESF ROP mid-term evaluation aims at identifying the results and impacts of the programme and hence at verifying its effectiveness and the efficiency. The evaluation has required a relevant methodological work, including synthesis and analysis of results and the design and application of advanced evaluation methodologies. Desk analysis of administrative documentation,  definition of questionnaires,  surveys to people and counterfactual evaluation of impact of Dowry (training voucher) have been carried out. The employment and empowerment impacts of an individual voucher, which finances a mix of training and other employment services, was assessed through a counterfactual econometric analysis.   An integrated database, building on administrative data and data from a specific survey, has been used in the econometric exercise.  The evaluation also requires quality assurance and control of the coherence of reports prepared by the partners.

The principal aim of the evaluation was the financial progress and management of the programme; the results and initial impact, within the four axes of the program (adaptability, employability, entrepreneurship, equal opportunity), the soundness of the rationale underpinning the programme, partnership, active participation and gender “mainstreaming”  were analysed in depth. In comparison to traditional structural funds evaluations, innovative instruments (evaluation conference, cognitive tools and participative approaches) were used.

Progettazione e realizzazione di un sistema di monitoraggio del PARO (Piano d’Azione Regionale per l’Occupazione) della regione Emilia Romagna sufficientemente flessibile e migliorabile nel tempo. Il progetto si articolava in tre macrofasi: 1) Messa a punto dell’impianto metodologico di rilevazione e raccolta delle informazioni 2) Realizzazione delle rilevazioni 3) Azioni di diffusione e formazione

PATTERN project’s general objective is to improve practitioners’ decision making on climate and environmental policies, by developing an interactive online platform for the economic appraisal of policies and measures. To reach this general objective, the project will develop an integrated operational approach for economic appraisal (WP3 and 4), provide guidelines to overcome any potential gaps in the ex-post and ex-ante analyses (WP1), build an effective participatory process aimed at elaborating 5 Theories of Change (WP2), build a European Community of Practice for climate and environmental policymaking (WP6), and create a One-Stop-Shop for all policy and decision makers to easily access and use the project’s results.

The research  provided useful, authoritative and timely information to
Members of the REGI Committee on the subject of Cohesion Policy and Climate Change. The primary aim of the project is to assess how EU Cohesion Policy currently contributes and can contribute in the future to reaching the goals of EU Climate Policy. The study should focus on the contribution of the EU Cohesion Policy to the EU Climate Policy, in particular financial support provided to projects supporting the objectives of the EU’s Climate Policy and the implementation of EU
commitments resulting from the Paris Agreement.

https://research4committees.blog/2021/05/27/digest-study-presentation-cohesion-policy-and-climate-change/

Sorry, this entry is only available in Italiano.

Watch the video

The Ex ante Evaluation of the OP EMFF assesses the completeness of the analysis, the internal consistency of the OP, the selected thematic objectives, the priorities, and the relevance of the OP indicators. The Strategic Environmental Assessment defines the possible environmental impacts of the OP on the marine and terrestrial ecosystems affected by fishery and aquaculture activities. Special attention is paid for the potential negative impacts on the Nature 2000 Network, on the marine protected areas and on the wetlands.  For these categories, is devoted a “Study of environmental incidence“, that is an integral part of the Environmental Report. In addition, is analyzed the integration inside the OP of biodiversity and climate change’s themes.

Mitigation and adaptation to climate change are on top of the UE agenda and Member States are asked to contribute to the Climate Action by developing their policies accordingly. Ismeri Europa is in charge of evaluating if and how climate relevant strategies are integrated among all Italian national and regional 2014-2020 ESIF programmes (ESF, ERDF, EAFRD and EMFF); the task is part of an European wide project commissioned by DG Clima and involving all Member States, in order to support the adoption process of all operational programmes for the 2014-2020 programming period.

The evaluation focuses on identifying the regional demand and production of energy, highlighting the successful practices and the limits of the regional policies implemented the last decade. The work aimed at providing useful advices for the recent regional energy strategic plan and for the 2014-2020 programming period. The evaluation was supported by specific analysis enabling the comparison of Friuli Venezia Giulia’s performances with bordering areas, in order to identify and understand different strategic choices and consequent results. Furthermore a survey of the regional renewable energy businesses has been included which allowed i.a. the definition of the main burdens and potentialities for its development.

Valutazione dei possibili impatti ambientali del PAN nella nuova programmazione, Ismeri ha proposto gli eventuali correttivi per la fase di attuazione.

La VAS ha avuto la finalità di garantire che le conseguenze ambientali del PON siano considerate sin dalle prime fasi del processo decisionale. Il PON Ricerca e Competitività 2007-13 comprende una serie di attività, dal sostegno agli investimenti produttivi alla creazione di infrastrutture di ricerca, che potenzialmente sono in grado di produrre effetti significativi sull’ambiente. Nello specifico caso la VAS ha assunto un ruolo di primo piano nel creare le condizioni adeguate per l’attuazione delle linee di intervento.