Software Quality Requirements and Evaluation (SQuaRE) & Common Industry Format (CIF) for Usability snart finns det inga ursäkter längre...

Transkript

1 Software Quality Requirements and Evaluation (SQuaRE) & Common Industry Format (CIF) for Usability snart finns det inga ursäkter längre... Åke Walldius, docent i Människa-datorinteraktion, CSC, KTH, SIS, SNSS och STIMDI:s Frukostseminarium 4:e september 2014: Användaren försvinner aldrig. Länge leve Användaren!

2 Får det se ut så här fortfarande? Vård IT-rapporten 2010 Uppföljning av användarundersökningen från 2004

3 Är den här listan på fallgropar fortfarande aktuell? Undvik att sätta upp mål, särskilt om verksamhetsnyttan Genomför allt på en gång, hela paketet, för allt hänger ihop Pruta på utbildningen, systemen är oftast självinstruerande Be användarna om synpunkter, sätt upp dem mot varandra, påpeka kostnaderna Acceptera leverantörens ord om att allt är inbyggt Välj leverantören med den billigaste tekniska lösningen och snabbast införande Välj det system som alla andra har, ingen kan få sparken för det Undvik uppföljningar, ingen gillar förändringar [IT Kartan Användare och IT-system i svenskt näringsliv (2002).]

4 När det egentligen ska gå till så här...! Bengt Göransson för ESV i maj 2010 (återgiven i Att beställla användbara it-system )

5 Roller Beställare Katalogansvarig Budgetansvarig Beställningssamordnare Scenarier Användare 1 & 2 Ett ihopvägt mått på e-tjänstens användbarhet (B = 0 100) Expertutvärdering Dokumenterar uppfyllelse enligt Per dialogprincip (mått: 5/3/1/0) Svarar på SUS (kvantifierar användarens upplevelse tillfredsställelsen) SUS (mått: 0 100) Utför scenarier E-handelstjänsten Utvärderar dialogen Observerar lösning av uppgiften Mäter och observerar Effektivitet Observatör 1 & 2 Per roll och scenarie Uppmätt och observerad effektivitet (mått: 5/3/1/0) Observationer av Ändamålsenlighet och måluppfyllelse Per roll och scenarie Ändmålsenlighet Måluppfyllelse (mått: 5/3/1/0) Bedömningskriterier 5 Väl godkänd 3 Godkänd 1 Acceptabel 0 Ej tillfredsställande Användbarhetsmåtten Ändamålsenlighet Måluppfyllelse Effektivitet Tillfredsställelse EKONOMISTYRNINGSVERKET 2010 UPPHANDLING E-HANDELSTJÄNST UTVÄRDERINGSKRITERIUM ANVÄNDBARHET V. 0.3

6 ISO : Processes for enabling, executing and assessing human-centred design within organizations Introduction The arguments for, purposes and principles... are explained in ISO whereas this part of ISO 9241 describes the processes to be performed and the work products to be used accordingly. The description of work products... are being documented in a series of International Standards for the Common industry format for usabilityrelated information. ISO applies these work products and maps them to the appropriate processes.

7 ISO : Processes for enabling, executing and assessing human-centred design within organizations

8 ISO : Processes for enabling, executing and assessing human-centred design within organizations

9 ISO : Processes for enabling, executing and assessing human-centred design within organizations

10 ISO/IEC CD 25010: Systems and software engineering Software product Quality Requirements and Evaluation (SQuaRE) Software product quality and system quality in use models.

11 ISO/IEC CD Systems and software engineering -- Systems and software Quality Requirements and Evaluation (SQuaRE) -- Common industry Format for Usability -- Evaluation Report

12 ISO/IEC CD Systems and software Quality Requirements and Evaluation (SQuaRE) -- Common industry Format for Usability -- Evaluation Report; Annex B. Example User Observation Report B.1 Introduction A user-based evaluation was performed on the 1st protoype of the redesigned Portal on June 11 and 12, 2009 at the testing facility in Rockville, MD. The goal in testing the 1st prototype was to learn how well representative samples of the organization s audiences interpreted and used the primary category links on the home page. The representative tasks and scenarios were identified from the senior leadership, operating divisions, and user data collection efforts. These tasks were the same tasks used during the benchmark testing of the original website.

13 ISO/IEC CD Systems and software Quality Requirements and Evaluation (SQuaRE) -- Common industry Format for Usability -- Evaluation Report; Annex B. Example User Observation Report B.2 Method B.2.1 Participants Total: 17 Gender Men 6 Women 11 Age under 25 1; ; ; Education level Some high school 1 High school 1 Some college 2 College graduate 6 Post graduate 7 Computer usage in hours per week <5 2 6 to to 20 6 > 20 4

14 ISO/IEC CD Systems and software Quality Requirements and Evaluation (SQuaRE) -- Common industry Format for Usability -- Evaluation Report; Annex B. Example User Observation Report B.2.2 Experimental Design Each of the participants worked with us individually for one hour. During that time, half of the participants answered questions about what the site covered, sponsorship, audience. Then they used the site in up to 23 scenarios that had been written and answered questions about their reactions to the site. The facilitator gave out the scenarios in random order. That is, each participant did the scenarios in a different order. Participants were instructed to do the scenarios without searching. The search function was not functional. The other half of the test participants were asked to describe what they had expect to find behind each primary category link on the home page without the benefit of seeing the underlying bullets in order to determine if the link labels matched the test participants expectations and why. Following this, the test participants usability tested the site with the randomly ordered scenarios as described above. In this study we were interested in understanding why the test participant chose the particular link or category and resulting path to the information. Therefore we asked each participant to Think out loud and we recorded their comments. In addition we documented the particular path followed in search of the information.

15 ISO/IEC CD Systems and software Quality Requirements and Evaluation (SQuaRE) -- Common industry Format for Usability -- Evaluation Report; Annex B. Example User Observation Report

16 ISO/IEC CD Systems and software Quality Requirements and Evaluation (SQuaRE) -- Common industry Format for Usability -- Evaluation Report; Annex B. Example User Observation Report

17 ISO/IEC CD Systems and software Quality Requirements and Evaluation (SQuaRE) -- Common industry Format for Usability -- Evaluation Report; Annex B. Example User Observation Report [All major findings] 1) Participants were very focused on topics or topic driven. 2) Participants were very focused on the items at the center of the page and forgot that there were categories below the fold. 3) Participants were very focused on the items at the center of the page and didn t see the items in the right navigation area.

18 ISO/IEC CD Systems and software Quality Requirements and Evaluation (SQuaRE) -- Common industry Format for Usability -- Evaluation Report; Annex B. Example User Observation Report

19 Software Quality Requirements and Evaluation (SQuaRE) & Common Industry Format (CIF) for Usability... its easy!