#SISUMMIT15 WIFI NETWORK: BREDBAND 2 LOGIN: GUEST / PASSWORD: GUEST

#SISUMMIT15 MEASURING SOCIAL IMPACT FROM POLICIES TO PRACTICE TORBJÖRN ENSTRÖM, FRYSHUSET TRIS LUMLEY, NEW PHILANTHROPY CAPITAL CAMILLA BACKSTRÖM, MÖTESPLATS SOCIAL INNOVATION

IMPACT MEASUREMENT IN SOCIAL INNOVATION Social Innovation Summit, Malmö, Sweden v Tris Lumley, Director of Development, NPC (New Philanthropy Capital) @trisml NPC - title of the document (can be changed under view/header and footer. Add date here if needed. 3

NPC: TRANSFORMING THE SOCIAL SECTOR Nonprofit Increasing the impact of non-profits eg, impact-focused theories of change Funder Sector Increasing the impact of funders eg, framing issue & mapping needs NPC works at the nexus between non-profits and funders Consultancy Think tank Strengthening the partnership eg, collaboration towards shared goals 4

The rise of impact measurement The dangers of the wrong approach Focus on purpose to succeed Towards a systemic view NPC - title of the document (can be changed under view/header and footer. Add date here if needed. 5

WHY IS IMPACT MEASUREMENT IMPORTANT? Social impact is the core purpose, and currency, of the social sector Without impact data, how can we manage our programmes? Without impact data, how can we invest or allocate resources? Without impact data, how can we know whether we re succeeding? 7

DO NO HARM!

IMPACT MEASUREMENT MADE SIMPLE Simple in theory but complex in practice? Impact measurement should focus on simple core questions: What s the problem we re trying to address? What will success look like if we achieve it? How do we expect what we do to achieve success? How will we know if it s working? How can we improve what we re doing through learning? 9

NPC S FOUR PILLARS OF IMPACT MEASUREMENT Effective measurement framework developed Map your theory of change Prioritise what you measure Choose your level of evidence Select your sources and tools Strategic vision Leadership Case for impact measurement 10

THE PURPOSE OF IMPACT MEASUREMENT Impact measurement should be driven by clear purpose: Learning, managing and improving Communicating and decision-making Holding ourselves accountable Contributing to a body of knowledge 11

WHAT DOES THE EVIDENCE SAY? Is impact measurement living up to its purpose? 12

THERE S MORE ACTIVITY Most UK charities now say they re measuring impact Measure impact for a small proportion of activities Measure impact for about half of activities Do not measure impact for any activities Measure impact for all or nearly all of activities 0% 10% 20% 30% 40% 50% 60% Question: how would you describe your organization s current approach to measuring its impact? N=1,000 13

THERE ARE REAL BENEFITS Impact measurement can help charities learn & improve Improved services Better able to demonstrate our results Improved targeting of those we help Increased funding Improved allocation of spending and Improved strategy Improved practices and policies in your Partnerships with other organizations Don t know Increased publicity Improved practices and policies in other Other 0% 5% 10% 15% 20% 25% 30% Question: In the last year, has measuring your impact led to any of the following benefits? N=755 14

BUT THE DRIVER IS FUNDING Funders drive measurement efforts, not charities themselves A change in funders requirements Impact measurement prioritised by trustees/ chief executive/senior management Increased support for measurement from funders Wanted to be more competitive/keep up with best practice Wanted to improve our services Wanted to know the difference our services were making Hired someone with monitoring and evaluation skills Other 0% 10% 20% 30% 40% 50% 60% Question: What were the main reasons for this increase [in impact measurement efforts?] N=550 15

WHAT DO FUNDERS WANT? Funders priorities shape the incentives Government Accountability Outputs Cost Funders Projects Evaluation Innovation Individual donors to cause Stories 16

IT S NOT CLEAR IMPACT MEASUREMENT IS ON THE RIGHT TRACK Not clear we re learning & improving Impact measurement still largely driven by funders & investors Unclear it s really driving decision-making Lack of investment in infrastructure & standards Lack of investment in organisations capacity 17

WE GIVE THEM WHAT THEY WANT Fundraisers do what needs to be done for the 19

IN THEORY NONPROFITS FOCUS ON IMPACT Parallel models funding and activity Funding + Activity = Impact Raise resources Deliver interventions Create social impact 20

BUT IN PRACTICE FOCUS CAN BE Risk is organisation becomes the central purpose Non-strategic funding + Funders' demands take priority to raise resources Non-strategic Activity = Lack of lasting impact Organizational survival takes priority over mission Benefit to funders, boards, staff and volunteers 21

an, social sector?

THE PURPOSE OF IMPACT MEASUREMENT Impact measurement should be driven by clear purpose: Learning, managing and improving Communicating and decision-making Holding ourselves accountable Contributing to a body of knowledge 24

WORKING TOWARDS A BETTER FUTURE How can we ensure impact measurement works? We need to be clear on questions we seek to answer: Before funding decisions/programme design During delivery After when reviewing, learning & improving

Before we design an intervention/programme/product Field What do we know? Organisations What should we do? People What are your priorities / needs / desires?

During the delivery of an intervention/programme/product Field How do we compare to others? Organisations How are we doing? What should we change? People How can we serve you better?

After the delivery of an intervention/programme/product Field How are we doing collectively? Organisations How did we do? Where did we fail? People How can we serve you better next time?

DOES MEASUREMENT KILL INNOVATION? or does innovation need learning? Funders and investors typically favour innovation But innovation without learning is a fetish The cult of the new vs what we know works Innovation but no action based on its success or failure Innovation very rarely scales in the social sector We have a proxy buyer problem, and no market to drive scaling And innovation without research is pointless What do we already know about what works and what doesn t? Do we need to innovate, or focus on investing in effective practices? Are we lacking a theoretical basis for social innovation? 29

SOCIAL INNOVATION & ORGANISATIONS Questions we need to answer for each role How can we help you? How can we serve you better? Can others serve you better? Voice What are your priorities? What are your needs? What are your desires? Services Social change What needs to change? How can we achieve change? 31

DIFFERENT QUESTIONS; DIFFERENT APPROACHES To prove what we re doing makes a difference Did our intervention work? As well as expected? Why? To improve what we re doing by learning What didn t work as well as we hoped? What can we change? To share what we learn for the benefit of all What should others know to help improve their work? To hold ourselves accountable to those we aim to serve Are we doing the best we can? Are we meeting their needs?

DON T START FROM NOTHING What do we already know from research? What do others already know? Academics Organisations Funders Do you really need to measure impact, or ensure quality?

IF YOU KNOW A LOT, MEASURE A LITTLE. IF YOU KNOW A LITTLE, MEASURE A LOT.

NO STORIES WITHOUT NUMBERS. NO NUMBERS WITHOUT STORIES.

LEARN TOGETHER Are there other organisations you can work with? Could you create a group of funders with shared goals? Could you work towards shared measurement frameworks? Cheaper Accelerates learning through comparison

KEEP COMING BACK TO PURPOSE To prove what we re doing makes a difference To improve what we re doing by learning To share what we learn for the benefit of all To hold ourselves accountable to those we aim to serve

THANK YOU Please get in touch: email v - tris.lumley@thinknpc.org twitter - @trisml NPC (New Philanthropy Capital) www.thinknpc.org NPC - title of the document (can be changed under view/header and footer. Add date here if needed. 38

Vi gör det möjligt för unga att genom sina passioner förändra världen. Vi gör det möjligt för unga att genom sina passioner förändra världen Social Innova+on Summit, Malmö 25 november 2015

Fryshusets challenge Vi gör det möjligt för unga att genom sina passioner förändra världen. External and legal demands From Contributors Branch Associations (FRII, SFI mfl) Accounting standards (K3 from 2014) Internal needs Quality control Internal steering

Vi gör det möjligt för unga att genom sina passioner förändra världen. Different ways to measure The EVPA handbook: Input Output Outcome Impact (resource) (activity) (statistics) (effect in society) For effect measurement (Impact) Mötesplats Social Innovation vid Malmö Högskola evaluated different methods: SROI Emerso n Cost/ Benefit Social accounting GRI/ Tellus / UNEP Socioeconomic analysis

Vi gör det möjligt för unga att genom sina passioner förändra världen. Analyse phenomena; identify & quantify LVU Korttidshem Jourfamilj PBU Kontaktperson Överklagan Kammarrätt Advokat Länsrätt Beslut om ärende Utredning Barn MVC BVC Barnomsorg Skola Utsatta Anmälan barn Utredning Skolsköterska Skolkurator Socialtjänsten Stödresurser Polis Boende Familjehem/Behandl Familjehem/Trad Beslut Utredningshem Ärende PBU Specialpedagog Extralärare Ingen bostad Utredning Bostadsbidrag Social kontrakt/ försöksboende Bidragsförskott Stödresurs Barnomsorg Jourhem Omedelbart omhändertagande Särskilt boende Inackordering Stödresurs Skola Härbärge Stödboende Kontinuerlig kontakt Hotellhem Beroendemottagning Öppenvård Boende Överklagan Kammarrätt Advokat Utredning Beslut om ärende Försörjningssätt Läkare Karensdagar Utredning Sjukpenning Sjukersättning Inackordering Kontaktperson Länsrätt Ärende Sjuk Utredning Rehabersättning Behandlingshem LVM hem Beslut Anmälan Missbruk Dålig ekonomi Utredning Ekonomiskt bistånd A-kassa Vård/Behandling Läkarbesök vårdcentral Medicinskt vårddygn Läkemedel Akutmottagning Liten operation Medicinska Heroinist Hepatit X Infektioner... Kirurgiska Amfetaminist Misshandel Trafikolyckor Olycksfall... Missbrukets kroppsliga effekter Inkomst Inget jobb Lönearbete Utredning Vitt Aktivitetsgaranti OSA Skatteintäkter Lönebidrag Produktionsvärde Stor operation Svart Tandakuten Odontologiska Bedrägeri Polisutredning Psykakut Psyk öppenvård Psyk slutenvård Läkemedel Psykiatriska Psykiatriska symptom Missbrukets mentala effekter Hälare Snatteri Bilstöld Inbrott Skadereglering Egendomsförlust Egendomsskador Tid/Prodförlust drabbade Gripande Avgiftning Metadon Subitex Beroende Abstinens Kroppsliga effekter Langning Antabus Smuggling Prostitution Övr omkostnader Övervakning Villkorlig dom Gripande, Åtal, Dom och Straff Kontraktsvård Gripande Momsintäkter Samhällstjänst Intensivövervakning Dom Arrest Utredning Skyddstillsyn Huvudförhandling Åklagare Vilande Öppen lokalanstalt Öppen riksanstalt Häkte Advokat Åtal Anhållande Sluten lokalanstalt Skyddshäkte Arrest Sluten riksanstalt Säkerhetsanstalt Häktning Brottsutredning Häktningsförhandling Personutredning

Vi gör det möjligt för unga att genom sina passioner förändra världen. Asess costs to each activity Utdrag ur prislista (ca 250 variabler) Välfärdssamhällets Claes Olsson katalog

Vi gör det möjligt för unga att genom sina passioner förändra världen. The three cost items of Social Exclution Public suppor+ng aci+vies We help people Produc+on losses We lose manpower Financial costs We support people financially Skatter och Avgifter Produktionsförlust Utanförskapets/Marginaliseringens kostnader Insatser Försörjning

Vi gör det möjligt för unga att genom sina passioner förändra världen. Socioeconomic effect 2013 1 2 3 4 5 10 20 2013 2014 2015 2016 2017 2022 2032 Realt aktör 89 175 739 174 783 304 247 952 163 311 507 347 364 096 581 565 641 723 878 827 349 Produktionsvärde 23 378 466 48 051 399 71 939 902 96 853 924 120 681 710 224 691 054 398 854 182 Finansiellt -17 479 505-28 840 303-35 489 968-36 508 996-35 152 231-17 108 490 13 312 666 Summa 95 074 700 193 994 400 284 402 098 371 852 275 449 626 061 773 224 287 1 290 994 197

Vi gör det möjligt för unga att genom sina passioner förändra världen. Socioeconomic effect 2014 1 2 3 4 5 10 20 2014 2015 2016 2017 2018 2023 2033 Realt aktör 20 967 109 101 843 861 170 969 290 230 991 814 280 391 520 477 412 831 772 450 524 Produktionsvärde 23 813 597 48 964 515 73 573 036 99 414 834 124 004 690 227 946 039 383 597 301 Finansiellt -16 587 883-27 063 957-32 835 442-33 024 457-30 968 417-7 599 542 27 395 143 Summa 28 192 823 123 744 420 211 706 884 297 382 191 373 427 794 697 759 327 1 183 442 969

Vi gör det möjligt för unga att genom sina passioner förändra världen. Learning points Begin with simple sta+s+cs Input/output Describe the personal development Outcome Describe how this affect society Impact Evaluate the impact Socioeconomics, SROI

#SISUMMIT15 MEASURING SOCIAL IMPACT FROM POLICIES TO PRACTICE TORBJÖRN ENSTRÖM, FRYSHUSET TRIS LUMLEY, NEW PHILANTHROPY CAPITAL CAMILLA BACKSTRÖM, MÖTESPLATS SOCIAL INNOVATION

#SISUMMIT15 WIFI NETWORK: BREDBAND 2 LOGIN: GUEST / PASSWORD: GUEST