Using the National Pupil Database (NPD) – 8 point checklist

Earlier this week I briefly talked about my experience of using the National Pupil Database (NPD) at a DfE and Centre for the Analysis of Youth Transitions (CAYT) workshop on evaluating the impact of children and young people services. The NPD is a collection of school census and other information on young people that service providers are being encouraged to access in order to create a fantastic evidence base in this field.

Based on my experience, I wrote a checklist on how to take advantage of the database which CAYT kindly placed on their website. Please download it here.

5 essential tips to take full advantage of the Justice Data Lab

At the beginning of this month, the MoJ of Justice launched the Justice Data Lab. Through the lab will organisations that aim to rehabilitate offenders can access robust evidence of their impact on re-offending. Organisations that would not have the resources to access such information can now operate on a more level playing field. The evidence will help more organisations use evaluation to improve their service and engage with NOMS’s commissioning intentions .

This is a dramatic change and I think MoJ and New Philanthropy Capital, who led on the set up of the lab, should be commended and the lab will hopefully be the first example of official datasets being made (securely) available to more and more organisations.

Opening up access to the data does not mean that organisations will be able to take advantage and they need get prepared. The lab will use the Police National Computer (PNC) to evidence reoffending. I use these data in reoffending studies and therefore below share some crucial tips on how you can take best advantage of the lab.  These tips will ensure you increase your match rate to the PNC. This is important because many organisations that want to use the lab will have a less than 100 hundred beneficiaries and need to match as many as possible to ensure useful evidence of impact is generated.

The tips will also ensure you can tell your story. Describing your impact with a story – who did you worked with, what was their history, what did you do with them, how much did it cost? – will make your case more compelling and give you a better chance to get funding.

Essential Tips:

Ask for the PNC number

The lab will match your beneficiaries to its records in the PNC. This can be done using name and date of birth but this can be inaccurate (Joseph recorded as Joe, 01/02/1979 recorded as 02/01/1979 etc.). Instead, ask your Criminal Justice partner for your beneficiaries’ PNC number or Prison ID number when you receive a referral.

Ask about the last offence

The lab also needs to identify the last offence and conviction that led to your beneficiaries’ current or previous sentence (this is called the index offence). The 12 month reoffending period starts from the date he or she left prison or the Community Order or Suspended Sentence Order commenced. Ask your criminal justice partner for the previous offence type, offence date, and conviction date and the lab can do the rest.

Describe who you are working with

You can also ask for information on a beneficiary’s risk of reoffending (OGRS3), risk of serious harm (RoSH), and the number of previous offences. Depending on what you do you could also ask for criminogenic need scores from the OASys assessment. This information will help you to contextualise your impact, and explain why your impact is important. For example, you might work with individuals with a high risk of reoffending and delaying reoffending or reducing the harm of their offence might be important outcomes for this group.

Present your impact alongside what you did

By demonstrating that your project can plausible reduce reoffending (e.g. is backed up by other evidence) and that you implemented it well, it is easier to say that the impact demonstrated was because of you and not due to chance or some other factor. Potential funders will be more persuaded by such evidence than just your reoffending rate.

Calculate how much you cost to stop a person reoffending

This is called cost-effectiveness and is basically the cost of your project divided by the number of people you prevented re-offending. This figure is very important to commissioners and funders.

For example, if your project cost £75,000, worked with 150 offenders and had a 5% impact on reoffending then your cost to prevent one person reoffending was:

£75,000/(150 x 5%) = £10,000

UKES London Event: Introduction to Economic Evaluation

I am member of the UK Evaluation Society London Network. The network has arranged a free introduction to economic evaluation, led by Jacque Mallender Founder Director of Matrix.

The seminar will provide an introduction to the use of cost benefit analysis in evaluation. Ex ante and ex post evaluation seeks to answer questions about what works, why, and in what circumstances. Interventions also cost money and policy makers are increasingly looking beyond effectiveness and are asking about value for money, affordability, and funding priorities. This session will explore the different methods of economic evaluation, the value of doing this type of evaluation and the limitations and constraints. Some case studies will be presented to show how these methods have been applied in practice.

Contact me (jack.cattell@getthedata.co.uk) or leave a comment for more details.

The beginning

Today I start my blog on social impact analytics, impact measurement, evaluation – what ever you want to call it. After a University of Pennsylvania project, I call what I do social impact analytics. I aim to marry tried and tested approaches to performance information with my impact evaluation skills. My work helps not for profits and statutory services that aim to create a impact for clients,  whether that is reducing re-offending, increasing independent living or reducing the number of young people not in education, employment or training. I set up a business in 2012 to provide this service.

Why would I want to do that?

Well – a few reasons.

One – I am good at it. I have a talent for designing what to measure, designing a data collection process and then analyzing that data. I enjoy doing it to. I have a lot of experience and a lot of insight to share.

Two – In the UK there is more emphasis on public bodies and not for profits to demonstrate the impact of what they do. There are also new methods of public service commissioning called payment by results and social impact bonds that require good outcome data and impact studies.

Three – A lot of people want to do this work but are struggling. I hope this blog can provide insights to increase the effect of their work.