The Department of Children, Equality, Disability, Integration and Youth and The Atlantic Philanthropies

Measuring outcomes from the ABC Programme through a national evaluation

Family & Parenting

Overview

An evaluation of the outcomes, implementation and costs of an area-based approach to tackle disadvantage. The evaluation drew from data over a four-year period, and services in thirteen areas around Ireland. The evaluation found that the Programme made a positive contribution to the lives of children and families, and shares learning about effective approaches in services and practice.

The challenge

The ABC Programme is delivered in thirteen geographic areas of disadvantage around Ireland, and involves the use of evidence-based interventions and services to benefit children and their parents.

Programme funders wanted to find out what changed for the children and families engaging with the Programme as a whole, the changes for practitioners and service providers, and the costs of the interventions across all sites.The evaluation focused on the first four years of the programme (2013-2017), during which the Department of Children & Youth Affairs and The Atlantic Philanthropies invested some €30.7m. Since 2017 the Programme is funded by the Department of Children, Equality, Disability, Integration and Youth, and is now managed by Tusla, the Child and Family Agency.

What we did

Understand the challenge

A key challenge for this complex evaluation was how to create a national report using data from individual ABC areas. Programme funders were interested in three questions:

  • Outcomes - what changes happened for children and parents?
  • Implementation – what changes happened for practitioners and service managers locally and nationally?
  • Costs - what were the costs of interventions that were delivered?

Design the approach

The CES evaluation team, led by Dr Claire Hickey, was guided by the funders and an Expert Advisory Group as they set about designing a shared outcomes measurement framework. The involvement of practitioners was recognised as key to gathering the data about outcomes for children and families engaging with ABC services around the country.

Success of a shared outcomes framework required a standardised approach to surveys and questionnaires, but also strong buy in from busy practitioners on the ground. The team worked with the ABC sites to support practitioners, providing training and other supports so that they could collect the data from the parents and families they worked with. The evaluation team quality assured the data and analysed it. The team conducted surveys and held focus groups to get an understanding of the changes for services and practitioners.

Support Progress

Given the complexity and volume of data produced, the team developed a range of resources from the evaluation report to share findings with different audiences, including policy makers, practitioners, service providers, parents and families who participated in the evaluation. Resources included summaries and briefings, tools, posters and learning papers.  

The impact

The evaluation found positive changes for the parents and children participating, practitioners working in new ways, along with new and  better relationships between practitioners and agencies.

Findings were used to inform both policy and practice for children and young people. Findings were used to inform public policy for children and young people on prevention and early intervention. They also informed the establishment of new initiatives, including the Department of Children, Equality, Disability, Integration and Youths What Works Programme, aimed at enhancing capacity, knowledge and quality in prevention and early intervention for children, young people and their families.

Want to have a chat?

Get in touch

The Team

The ABC evaluation team included specialist expertise in research and evaluation, along with experience of community and voluntary sector organisations. The team engaged with the Area sites over the course of the evaluation, and drew on communications expertise within CES in producing briefs and resources.

To speak to our team about this work contact us here

Want to work with a team like this?

Book a consultation
In partnership with

Department of Children, Equality, Disability, Integration and Youth

Services

Research and Evaluation

Resources

Resource Library

We curate a growing library of useful, usable tools, reports and case studies in our Notion database. Explore resources.effectiveservices.org
Explore Resources ↗
Family & Parenting

Related Case Studies