#SISUMMIT15 WIFI NETWORK: BREDBAND 2 LOGIN: GUEST / PASSWORD: GUEST

Transkript

1 #SISUMMIT15 WIFI NETWORK: BREDBAND 2 LOGIN: GUEST / PASSWORD: GUEST

2 #SISUMMIT15 MEASURING SOCIAL IMPACT FROM POLICIES TO PRACTICE TORBJÖRN ENSTRÖM, FRYSHUSET TRIS LUMLEY, NEW PHILANTHROPY CAPITAL CAMILLA BACKSTRÖM, MÖTESPLATS SOCIAL INNOVATION

3 IMPACT MEASUREMENT IN SOCIAL INNOVATION Social Innovation Summit, Malmö, Sweden v Tris Lumley, Director of Development, NPC (New Philanthropy NPC - title of the document (can be changed under view/header and footer. Add date here if needed. 3

4 NPC: TRANSFORMING THE SOCIAL SECTOR Nonprofit Increasing the impact of non-profits eg, impact-focused theories of change Funder Sector Increasing the impact of funders eg, framing issue & mapping needs NPC works at the nexus between non-profits and funders Consultancy Think tank Strengthening the partnership eg, collaboration towards shared goals 4

5 The rise of impact measurement The dangers of the wrong approach Focus on purpose to succeed Towards a systemic view NPC - title of the document (can be changed under view/header and footer. Add date here if needed. 5

6 The rise of impact measurement The dangers of the wrong approach Focus on purpose to succeed Towards a systemic view NPC - title of the document (can be changed under view/header and footer. Add date here if needed. 6

7 WHY IS IMPACT MEASUREMENT IMPORTANT? Social impact is the core purpose, and currency, of the social sector Without impact data, how can we manage our programmes? Without impact data, how can we invest or allocate resources? Without impact data, how can we know whether we re succeeding? 7

8 DO NO HARM!

9 IMPACT MEASUREMENT MADE SIMPLE Simple in theory but complex in practice? Impact measurement should focus on simple core questions: What s the problem we re trying to address? What will success look like if we achieve it? How do we expect what we do to achieve success? How will we know if it s working? How can we improve what we re doing through learning? 9

10 NPC S FOUR PILLARS OF IMPACT MEASUREMENT Effective measurement framework developed Map your theory of change Prioritise what you measure Choose your level of evidence Select your sources and tools Strategic vision Leadership Case for impact measurement 10

11 THE PURPOSE OF IMPACT MEASUREMENT Impact measurement should be driven by clear purpose: Learning, managing and improving Communicating and decision-making Holding ourselves accountable Contributing to a body of knowledge 11

12 WHAT DOES THE EVIDENCE SAY? Is impact measurement living up to its purpose? 12

13 THERE S MORE ACTIVITY Most UK charities now say they re measuring impact Measure impact for a small proportion of activities Measure impact for about half of activities Do not measure impact for any activities Measure impact for all or nearly all of activities 0% 10% 20% 30% 40% 50% 60% Question: how would you describe your organization s current approach to measuring its impact? N=1,000 13

14 THERE ARE REAL BENEFITS Impact measurement can help charities learn & improve Improved services Better able to demonstrate our results Improved targeting of those we help Increased funding Improved allocation of spending and Improved strategy Improved practices and policies in your Partnerships with other organizations Don t know Increased publicity Improved practices and policies in other Other 0% 5% 10% 15% 20% 25% 30% Question: In the last year, has measuring your impact led to any of the following benefits? N=755 14

15 BUT THE DRIVER IS FUNDING Funders drive measurement efforts, not charities themselves A change in funders requirements Impact measurement prioritised by trustees/ chief executive/senior management Increased support for measurement from funders Wanted to be more competitive/keep up with best practice Wanted to improve our services Wanted to know the difference our services were making Hired someone with monitoring and evaluation skills Other 0% 10% 20% 30% 40% 50% 60% Question: What were the main reasons for this increase [in impact measurement efforts?] N=550 15

16 WHAT DO FUNDERS WANT? Funders priorities shape the incentives Government Accountability Outputs Cost Funders Projects Evaluation Innovation Individual donors to cause Stories 16

17 IT S NOT CLEAR IMPACT MEASUREMENT IS ON THE RIGHT TRACK Not clear we re learning & improving Impact measurement still largely driven by funders & investors Unclear it s really driving decision-making Lack of investment in infrastructure & standards Lack of investment in organisations capacity 17

18 The rise of impact measurement The dangers of the wrong approach Focus on purpose to succeed Towards a systemic view NPC - title of the document (can be changed under view/header and footer. Add date here if needed. 18

19 WE GIVE THEM WHAT THEY WANT Fundraisers do what needs to be done for the 19

20 IN THEORY NONPROFITS FOCUS ON IMPACT Parallel models funding and activity Funding + Activity = Impact Raise resources Deliver interventions Create social impact 20

21 BUT IN PRACTICE FOCUS CAN BE Risk is organisation becomes the central purpose Non-strategic funding + Funders' demands take priority to raise resources Non-strategic Activity = Lack of lasting impact Organizational survival takes priority over mission Benefit to funders, boards, staff and volunteers 21

22 an, social sector?

23 The rise of impact measurement The dangers of the wrong approach Focus on purpose to succeed Towards a systemic view NPC - title of the document (can be changed under view/header and footer. Add date here if needed. 23

24 THE PURPOSE OF IMPACT MEASUREMENT Impact measurement should be driven by clear purpose: Learning, managing and improving Communicating and decision-making Holding ourselves accountable Contributing to a body of knowledge 24

25 WORKING TOWARDS A BETTER FUTURE How can we ensure impact measurement works? We need to be clear on questions we seek to answer: Before funding decisions/programme design During delivery After when reviewing, learning & improving

26 Before we design an intervention/programme/product Field What do we know? Organisations What should we do? People What are your priorities / needs / desires?

27 During the delivery of an intervention/programme/product Field How do we compare to others? Organisations How are we doing? What should we change? People How can we serve you better?

28 After the delivery of an intervention/programme/product Field How are we doing collectively? Organisations How did we do? Where did we fail? People How can we serve you better next time?

29 DOES MEASUREMENT KILL INNOVATION? or does innovation need learning? Funders and investors typically favour innovation But innovation without learning is a fetish The cult of the new vs what we know works Innovation but no action based on its success or failure Innovation very rarely scales in the social sector We have a proxy buyer problem, and no market to drive scaling And innovation without research is pointless What do we already know about what works and what doesn t? Do we need to innovate, or focus on investing in effective practices? Are we lacking a theoretical basis for social innovation? 29

30 The rise of impact measurement The dangers of the wrong approach Focus on purpose to succeed Towards a systemic view NPC - title of the document (can be changed under view/header and footer. Add date here if needed. 30

31 SOCIAL INNOVATION & ORGANISATIONS Questions we need to answer for each role How can we help you? How can we serve you better? Can others serve you better? Voice What are your priorities? What are your needs? What are your desires? Services Social change What needs to change? How can we achieve change? 31

32 DIFFERENT QUESTIONS; DIFFERENT APPROACHES To prove what we re doing makes a difference Did our intervention work? As well as expected? Why? To improve what we re doing by learning What didn t work as well as we hoped? What can we change? To share what we learn for the benefit of all What should others know to help improve their work? To hold ourselves accountable to those we aim to serve Are we doing the best we can? Are we meeting their needs?

33 DON T START FROM NOTHING What do we already know from research? What do others already know? Academics Organisations Funders Do you really need to measure impact, or ensure quality?

34 IF YOU KNOW A LOT, MEASURE A LITTLE. IF YOU KNOW A LITTLE, MEASURE A LOT.

35 NO STORIES WITHOUT NUMBERS. NO NUMBERS WITHOUT STORIES.

36 LEARN TOGETHER Are there other organisations you can work with? Could you create a group of funders with shared goals? Could you work towards shared measurement frameworks? Cheaper Accelerates learning through comparison

37 KEEP COMING BACK TO PURPOSE To prove what we re doing makes a difference To improve what we re doing by learning To share what we learn for the benefit of all To hold ourselves accountable to those we aim to serve

38 THANK YOU Please get in touch: v - tris.lumley@thinknpc.org twitter NPC (New Philanthropy Capital) NPC - title of the document (can be changed under view/header and footer. Add date here if needed. 38

39 Vi gör det möjligt för unga att genom sina passioner förändra världen. Vi gör det möjligt för unga att genom sina passioner förändra världen Social Innova+on Summit, Malmö 25 november 2015

40 Fryshusets challenge Vi gör det möjligt för unga att genom sina passioner förändra världen. External and legal demands From Contributors Branch Associations (FRII, SFI mfl) Accounting standards (K3 from 2014) Internal needs Quality control Internal steering

41 Vi gör det möjligt för unga att genom sina passioner förändra världen. Different ways to measure The EVPA handbook: Input Output Outcome Impact (resource) (activity) (statistics) (effect in society) For effect measurement (Impact) Mötesplats Social Innovation vid Malmö Högskola evaluated different methods: SROI Emerso n Cost/ Benefit Social accounting GRI/ Tellus / UNEP Socioeconomic analysis

42 Vi gör det möjligt för unga att genom sina passioner förändra världen. Analyse phenomena; identify & quantify LVU Korttidshem Jourfamilj PBU Kontaktperson Överklagan Kammarrätt Advokat Länsrätt Beslut om ärende Utredning Barn MVC BVC Barnomsorg Skola Utsatta Anmälan barn Utredning Skolsköterska Skolkurator Socialtjänsten Stödresurser Polis Boende Familjehem/Behandl Familjehem/Trad Beslut Utredningshem Ärende PBU Specialpedagog Extralärare Ingen bostad Utredning Bostadsbidrag Social kontrakt/ försöksboende Bidragsförskott Stödresurs Barnomsorg Jourhem Omedelbart omhändertagande Särskilt boende Inackordering Stödresurs Skola Härbärge Stödboende Kontinuerlig kontakt Hotellhem Beroendemottagning Öppenvård Boende Överklagan Kammarrätt Advokat Utredning Beslut om ärende Försörjningssätt Läkare Karensdagar Utredning Sjukpenning Sjukersättning Inackordering Kontaktperson Länsrätt Ärende Sjuk Utredning Rehabersättning Behandlingshem LVM hem Beslut Anmälan Missbruk Dålig ekonomi Utredning Ekonomiskt bistånd A-kassa Vård/Behandling Läkarbesök vårdcentral Medicinskt vårddygn Läkemedel Akutmottagning Liten operation Medicinska Heroinist Hepatit X Infektioner... Kirurgiska Amfetaminist Misshandel Trafikolyckor Olycksfall... Missbrukets kroppsliga effekter Inkomst Inget jobb Lönearbete Utredning Vitt Aktivitetsgaranti OSA Skatteintäkter Lönebidrag Produktionsvärde Stor operation Svart Tandakuten Odontologiska Bedrägeri Polisutredning Psykakut Psyk öppenvård Psyk slutenvård Läkemedel Psykiatriska Psykiatriska symptom Missbrukets mentala effekter Hälare Snatteri Bilstöld Inbrott Skadereglering Egendomsförlust Egendomsskador Tid/Prodförlust drabbade Gripande Avgiftning Metadon Subitex Beroende Abstinens Kroppsliga effekter Langning Antabus Smuggling Prostitution Övr omkostnader Övervakning Villkorlig dom Gripande, Åtal, Dom och Straff Kontraktsvård Gripande Momsintäkter Samhällstjänst Intensivövervakning Dom Arrest Utredning Skyddstillsyn Huvudförhandling Åklagare Vilande Öppen lokalanstalt Öppen riksanstalt Häkte Advokat Åtal Anhållande Sluten lokalanstalt Skyddshäkte Arrest Sluten riksanstalt Säkerhetsanstalt Häktning Brottsutredning Häktningsförhandling Personutredning

43 Vi gör det möjligt för unga att genom sina passioner förändra världen. Asess costs to each activity Utdrag ur prislista (ca 250 variabler) Välfärdssamhällets Claes Olsson katalog

44 Vi gör det möjligt för unga att genom sina passioner förändra världen. The three cost items of Social Exclution Public suppor+ng aci+vies We help people Produc+on losses We lose manpower Financial costs We support people financially Skatter och Avgifter Produktionsförlust Utanförskapets/Marginaliseringens kostnader Insatser Försörjning

45 Vi gör det möjligt för unga att genom sina passioner förändra världen. Socioeconomic effect Realt aktör Produktionsvärde Finansiellt Summa

46 Vi gör det möjligt för unga att genom sina passioner förändra världen. Socioeconomic effect Realt aktör Produktionsvärde Finansiellt Summa

47 Vi gör det möjligt för unga att genom sina passioner förändra världen. Learning points Begin with simple sta+s+cs Input/output Describe the personal development Outcome Describe how this affect society Impact Evaluate the impact Socioeconomics, SROI

48 #SISUMMIT15 MEASURING SOCIAL IMPACT FROM POLICIES TO PRACTICE TORBJÖRN ENSTRÖM, FRYSHUSET TRIS LUMLEY, NEW PHILANTHROPY CAPITAL CAMILLA BACKSTRÖM, MÖTESPLATS SOCIAL INNOVATION

49 #SISUMMIT15 WIFI NETWORK: BREDBAND 2 LOGIN: GUEST / PASSWORD: GUEST