Step 2: Collecting data

/by

In this step you need to consider how you will go about collecting the data to help you understand if your programme or service is working towards the outcomes you identified in your Theory of Change.

Your data will fall into 2 types:

  • Quantative
  • Qualitative

Below are some of the methods most frequently used for collecting Outcome information:

Each of these methods has its pros and cons, and before you choose, important questions you should ask yourself include:

  • Do we already collect this information, or could we adapt the monitoring systems we already have in place?
  • Do we need to collect information from all our users, or could we collect it from a smaller group. If we do this, will it mean that certain groups are not represented?
  • What methods are suitable for our service and its beneficiaries?
  • Consider what tools and data sources are already available before developing your own.
  • Collaborate with others and share measurement tools where possible to save time and resources.

The next step is to think about the practicalities of collecting your data:

  • When should this data be collected? e.g. before, during and after an intervention.
  • Who will collect the data?

Further information and resources:

 A basic introduction to data collection methods can be found on the NPC’s website.

Choosing your evaluation methods – Fit for Purpose is a recorded webinar by Evaluation Support Scotland. It takes you through some of the factors to consider when choosing appropriate evaluation tools, the pros and cons of a “validated tool” versus home-grown and the importance of fitting your evaluation methods to the values of your organisation.

https://evaluationsupportscotland.org.uk/resources/fit-for-purpose-webinar/

Creative evaluation methods – less formal data collection methods could be more suitable for your organisation e.g. using drawings and videos, diaries and storytelling. Scottish Evaluation Service has a useful resource hub to give you ideas. It covers tools such as Choosing Pictures and Employability Skills Wheel. NPC also gives some advice around using Creative methods and you can download their method cards here.

Impactasaurus is a great free resource which offers a bank of questionnaires to choose from and  also supports you to report on the results, after using one of their questionnaires.