Comparing two approaches to outcome measurement of an online self-management programme for people with epilepsy

Abstract

Background: There are a range of approaches to measuring the effectiveness of self-management support for people with long term conditions. Choice of approach may be influenced by perceptions of methodological rigour, the purpose of evaluation, and anticipated impact. Methods: Two methods were employed to evaluate the impact of an online self-management programme for people with epilepsy; an online quantitative survey using standardised, validated, self-administered questionnaires administered before, immediately after and 3 months after completing the programme (n= 62, 37, and 31 respectively), and a standardised, structured, qualitative interview following Social Return on Investment (SROI) methodology (n=10). Quantitative data from the online survey was analysed using inferential statistics. Data from the qualitative interviews was analysed using a social returns approach to calculate the social value to participants expressed in pounds sterling. Findings: Participants reported increased knowledge, skills and confidence (activation) to manage their epilepsy, using the Patient Activation Measures ( the primary outcome). The average activation score for participants moved from level 2 to level 3, 3 months after completing the programme (M= 54.52 and 60.48 respectively, 95% CI for mean difference = 1.07-10.84) . Using SROI, the total impact value of the programme per person per year was £13145.48. For every £1 spent to develop and deliver the Epilepsy and You programme, £18.15 of social value was generated for programme participants. Discussion: The relative value of the two approaches to measuring outcomes will be discussed, from the perspective of researchers, intervention providers, and commissioners of self-management programmes.