Evaluation of the ESF support to Education and Training (Thematic Objective 10)
The study aims at providing the Commission with opinions, evidence and analysis that will allow building up its evaluation of the ESF support to education and training. The evaluation will assess the effectiveness, efficiency, relevance, coherence and EU added value of actions funded by the European Social Fund under the current programming period.
Evaluation of the National Operational Program ESF 2014 – 2020
Strategic and operational assessment and impact of the ESF Marche POR 2014/2020
Evaluation of the ESF Operational Program “Investments in favor of growth and employment” 2014-2020
Evaluation aimed at verifying the relevance, effectiveness and efficiency of the implementation of the interventions foreseen by the ESF OP 2014-2020.
Evaluation of the effectiveness of the implementation of the National Operational Program ESF “Social Inclusion” 2014 – 2020
Study supporting the evaluation of Decision 573/2014/EU on enhanced cooperation between PES
The aim of the study was to evaluate the European Public Employment Sevices Network based on the objectives established in Decision 573/2014 / EU. The study assisted the Commission in assessing the relevance, effectiveness, efficiency, coherence and added value of decision 573/2014 / EU and in particular deepened the contribution of the European Network to the strengthening of employment services in some Member States including Italy.
Evaluation of the ROP ESF 2014/2020 “Investment for growth and jobs”
Evaluation of the effectiveness, efficiency and impact of the Operational Programme and of its policies
Support services for the development of a model for monitoring the activities of institutions subject to supervision by the Ministry of Labor and Social Policies
Technical support for the development of a model for monitoring the performance of the National Agency of Active Labour Market Policies (ANPLA) and of the National Labour Inspectorate (INL)
Feasibility and pilot study on the sustainability and effectiveness of results for ESF participants using counterfactual impact evaluation (CIE)
The project is aimed at assessing the feasibility of Counterfactual impact evaluation (CIE) as an advantageous method for studying European Social Fund (ESF) interventions. The activities include:
1) Mapping available data and judge whether CIE could be used more widely
2) identify obstacles and propose ways to overcome them, notably as regards access to data registers
3) explore how CIE could be used directly by the Commission to reach solid conclusions about the ESF effectiveness and sustainability of results.
4) carry out a pilot exercise in a limited number of Member States on the sustainability and effectiveness of 2014-2020 ESF initiatives for long-term unemployed and early school leavers.
Multiple framework contracts for the provision of services related to the implementation of Better Regulation Guidelines
Framework contract to assist the Commission in implementing the Better Regulation Guidelines by carrying out studies in the field of employment, social affairs, labour mobility and skills with the purpose of supporting: (1) impact assessment for the design and preparation of policies, programmes and legislation; (2) evaluation to assess their effectiveness, efficiency, relevance, coherence and the added value; (3) monitoring their implementation.
Technical Assistance to the Social and Economic Parts
Pares (“Partnership between employment services”) project management support services
The “Benchmarking of employment services’ contribution to the implementation of the Youth Guarantee”, financed within PARES (Partnership between Employment Services), was implemented by the Italian Ministry of Labour in cooperation with the national Authorities in charge of managing the Youth Guarantee scheme in France and in Hungary as well as the similar scheme in Serbia. Ismeri Europa supported the Ministry of labour with technical assistance to the methodological issues, data collection, benchmarking analysis and drafting reports. In particular IE drafted the methodological guidelines, the inception report and the final report of the study.
Assessment and review of the italian “piani di rafforzamento amministrativo”
The main purpose of the present contract is to assist DG EMPL in assessing and reviewing the Italian Administrative Reinforcement Plans (ARPs) related to the implementation of ESF Operational Programmes. The study provides technical support to DG EMPL on the assessment of the ARP of the Italian Ministry of Labour whose approval is still pending in order to ensure that it reaches an adequate level. In addition to this, DG EMPL will be supported in preparing meetings with the Italian Authorities. Ismeri will provide 2 short reports, one based on a comparative analysis of the ESF role in the Italian ARPs, and a final report which will focus on analyzing the coherence between the ARPs and the actions funded under TO11 and Technical Assistance in the Italian OPs.
Ripetizione di servizi analoghi al “Servizio di supporto tecnico-organizzativo alle parti economiche e sociali chiamate a partecipare alla preparazione, attuazione, sorveglianza e valutazione del PO FSE Basilicata 2007-2013
Support and evaluation of the Action 3 “Countering the school drop-out” of the Action and Cohesion Plan (PAC)
Evaluation of the Action 3, envisaged within the Action and Cohesion plan (PAC) and aimed at reducing the educational failure and the school drop-out in the regions of the Convergence Objective. Action 3 aims at developing models of educational and training actions from the pre-schooling period and the first cycle until the entry into the labour market, in areas characterized by a high school drop-out and by social and cultural exclusion. The project develops a transversal analysis of the interventions, an assessment of their effectiveness and develops a model of these interventions likely to be replicated during the next programming period.
Ex ante evaluation of the National Operational Programme “Inclusion” ESF relating to the programming period 2014 – 2020
Ex ante evaluation of the Operational Programme National Inclusion ESF relating to the programming period 2014 – 2020; The main activities were: analysis of internal and external coherence of the program, analysis of the logical framework, development of program indicators and targets intermediate and final analysis of the adequacy of the organizational and the measures envisaged to reduce the administrative workload.
Ex-post evaluation of ESF investments in human capital in Italy in the 2007-2013 programming period.
The evaluation focuses on the interventions aimed at improving the educational and training system, promoting the access to the labour market and supporting the professional training of workers and unemployed people. Five ESF OPs are analyzed in depth: the National OP “Competence for Development”, the Apulia ROP and Sicily ROP for the Convergence area, the Tuscany ROP and the Piedmont ROP for the Competitiveness area.
Technical Assistance to the Social and Economic Parts
Technical assistance aimed at promoting the ability of economic and social partners to interact with the authorities responsible for the Regional Operational Programme ESF Basilicata. The project has defined the procedures for consultation between stakeholders and supports the partnership relations through the implementation of preparatory documents, handbook on the functioning of Cohesion policy and the management of the ESF, and meetings.
Impact Assessment concerning the possible revision of the legislative framework on the posting of workers in the context of the provision of services
The project aims at assessing the impact of six policy options identified by the EC to modify the current regulatory setting of posting at the European Union level. The study of the literature was carried out on both a set of national case studies and statistical and econometric analyses, and allowed to identify the extent of posting, its main features and drivers, the main economic, social and legal problems related to the phenomenon and then outline the objectives and scope of the desirable revisions.
All this process required an extensive methodological work, as well as the application of advanced monitoring and ex-ante evaluation techniques. The assessment also investigated the new obligations on information related to each of the six policy options and estimated the related administrative costs. A comparison among the suggested policy options, both in terms of effectiveness and administrative costs borne by the different stakeholders, was possible thanks to the several analyses carried out. A synthesis and analysis of the complex results, of quality control and of the consistency of reporting were the key tasks of this project.
Independent evaluation of projects implemented by the ESF NOP 2007-2013”
The ESF NOP 2007-2013 supports systems and structures of the labour market and is managed by the Italian Ministry for Labour and Social policies. As part of the on-going multiannual programme evaluation, Ismeri carries out: an analysis of the efficiency of the management systems, an analysis of national reforms and their implication for the NOP’s strategy, an assessment of the results of interventions and their effects on the functioning of systems and structures; finally, the evaluation team identifies best practices among the carried out initiatives. Three thematic evaluations (immigrants, young people, institutional capacity) and two annual reports have been completed so far. The project activities require applying monitoring/evaluation methodologies, synthesis and analysis of results of the field research and surveys used to collect data and information, as well as elements of quality control and consistency of reporting to ensure that research outputs meet the required standards. As for institutional capacity, a second thematic evaluation is being carried and its aim is to identify lessons to improve the governance in 2014-2020 period.
Establishment of a European Job Mobility Partnership
The project has established an EU network of academics and practitioners on workers’ professional and geographical mobility to analyse new patterns of mobility and corresponding national policy developments in the context of the EES and post 2010. The network provides scientific background and support in the field of mobility and provides support to mobilising stakeholders by organising national and thematic workshops and an annual conference. A strong methodological work and the application of monitoring/evaluation methodologies are key project activities, especially in relation to the preparation of thematic reports. Synthesis and analysis of results of the work carried out by experts (case studies, annual reports etc.), quality control and consistency of reporting across the EU are also key elements of the assignment.
Independent evaluation of the 2007–13 ESF OP of Lombardy Region
The Lombardy ESF ROP mid-term evaluation aims at identifying the results and impacts of the programme and hence at verifying its effectiveness and the efficiency. The evaluation has required a relevant methodological work, including synthesis and analysis of results and the design and application of advanced evaluation methodologies. Desk analysis of administrative documentation, definition of questionnaires, surveys to people and counterfactual evaluation of impact of Dowry (training voucher) have been carried out. The employment and empowerment impacts of an individual voucher, which finances a mix of training and other employment services, was assessed through a counterfactual econometric analysis. An integrated database, building on administrative data and data from a specific survey, has been used in the econometric exercise. The evaluation also requires quality assurance and control of the coherence of reports prepared by the partners.
Evaluation CIP EQUAL 2000/2006
The principal aim of the evaluation was the financial progress and management of the programme; the results and initial impact, within the four axes of the program (adaptability, employability, entrepreneurship, equal opportunity), the soundness of the rationale underpinning the programme, partnership, active participation and gender “mainstreaming” were analysed in depth. In comparison to traditional structural funds evaluations, innovative instruments (evaluation conference, cognitive tools and participative approaches) were used.
Monitoring the Regional Action Plan for Employment
Progettazione e realizzazione di un sistema di monitoraggio del PARO (Piano d’Azione Regionale per l’Occupazione) della regione Emilia Romagna sufficientemente flessibile e migliorabile nel tempo. Il progetto si articolava in tre macrofasi: 1) Messa a punto dell’impianto metodologico di rilevazione e raccolta delle informazioni 2) Realizzazione delle rilevazioni 3) Azioni di diffusione e formazione