Connectingthegreatestgeneration
User1isamaleBoeingengineerwhoworkedwithearlycomputerstoassesslighting conditionsinplannedspaces.Hecurrentlyusesadesktopcomputeralmostentirelytowrite lettersinMSWordanduseemail.Hehasdifficultyseeing,hearingandremainingfocusedwhen presentedwithdistractions.Heseemedoverconfidentinhisabilities,anddidntwanttoadmit whenhewaslost,andinneedofhelp. User2isafemalekindergartenteacherwithaloveoflifelonglearningandcommunication.An iPadisherprimarydeviceandsheusesitmainlyforemailandgames.Shehadnoobvious physicalimpairments,andshowedstrongproblemsolvingskills,andconfidencewhenfaced withunfamiliarsituations.Sheaskedforhelpeasily,andevenshowedusacomicstripmaking funoutofstereotypesregardingtheelderly,andtechnology. User3isamalematerialsengineerwhohasnotusedcomputersuntilrecently.Hecurrently usesalaptoptocheckemail,writelettersinMSWord,andaccesstheinternet.Hehadnovision inoneeye,difficultyhearing,anddifficultywithfinemotormovements.Hereadilyrecognized whenhewaslostandwaswillingtoaskforhelp.
Mostusershadimpairedeyesight Fontsshouldbelargeandthe andtooktimetoscanthescreen interfaceshouldbegraphicallysimple Someusershadshakyhands whichmadecursormovement inaccurate Mostusershadtroublehearing Actionableitemsshouldhavelarge clicktargetstoreducetherequired accuracy Thesolutionshouldnotrelyonsound forcorefunctionality
Elderstendedtogetdistractedby Onlydisplaycontentthatmattersto variousoptions theuser Elderstendedtogetinputboxes, Hintsatthebottomofthescreen, andbuttonsmixedup,and helpdisplaywhattheuserhasdone, confused andwhattheycandonext
Design Choice
Wedecidedtomergesomeofourdesignsinordertogetthebestofbothworlds.Ourmodified designwaschosen,duetothewayitkeepsonlyafewimportantitemsonscreenallowingan eldernottobedistractedbyseveralchoiceswhichUser1,and3demonstratedduringthe contextualinquiry.Anotherreasonwasduetoouruserspooreyesight,byhavingonlyaselect numberofitemswecanmaketextfonts/iconslargerforreadability.Also,wefeelthatcompared tothepreviousdesignsournewversionismoreminimalistic,andeasiertotraversewiththe arrowbuttons.
Storyboards
Belowarethestoryboardseachstoryboardisdesignedoffoneoftheoriginalsketchesfollowing oneofourtasks.
Storyboard for Concept 1(Hard Task - Adding New Contact from Email):
Interactive Content
Menu Navigation
Wenumberedallthepages,andmarkedeachbuttonwiththepagenumberitpointsto,sowe cankeeptrackofthepagesmoreeasily.
Evaluation method
Tasks
Forourusertests,wegavetheparticipants3tasksrelevanttothegoalsoftheEaseMail application.Theywerevariantsonthebasictaskswediscoveredweredesiredthroughour contextualinquiry,butwithextrarequirementstotestsomeadvancedfunctionalityandits discoverability.Thefirsttaskwastosendanemailto2predeterminedrecipients.Oursecond taskwasmorecomplicatedandinvolvedbasicinboxmanagement.Theuserwasaskedto checktwoincomingmessages,replytooneofthemanddeletetheother.Finally,thethirdtask involvedbasiccontactmanagement.Theuserwasaskedtoremoveapredeterminedperson fromtheircontacts.Thistaskstartedwhereverthelasttaskleftofusuallyontheinboxscreen.
Environment
Duetothenatureofourtwoparticipantgroups,theevaluationwascarriedoutin2locations.The firstwastheCSEatrium.Thislocationwasemptyandquietatthetimeofthetesting.We gatheredtablestogethertoprovidestagingareaforthecomputerandhispaperUI.Thesecond locationwastheOdegaardLibrarywhichwasalsoaquiet,lowdistractionenvironment.We usedonelargetabletoprovidethesameamenitiesasbeforeinassimilaranarrangementas possible.Inbothcaseswegavetheparticipantapentouseasastylusontheprototype.
Participants
Ourparticipantscamefromtwodemographicgroups:2werepeerstudentsattheUniversityof WashingtonandtheotherwasastafferattheOdegaardLibrary.Thepeerswerefriendsofa groupmemberbuthadnotheardanythingaboutthisprojectpreviously.Theodegaardstaffer wasapproachedtovolunteerinourstudyonthedayoftheevaluationduetodifficultyarranginga meetingatanyofthenearbyRetirementHomeswithatruememberofourelderlyusergroup. Likewiththepeers,thestafferhadnoformerknowledgeofourproject.
Procedure
Foreachevaluationtheteamsetup3stacksofpaperprototypecomponents,onerelatedto eachofthe3maintasksaswellasanextrastackofmiscUIcomponentsincasetheuser exploredanyotherpartsoftheUI.TheuserstablewasclearedexceptfortheinitialUIscreen,a stylusandastickynotewiththefirsttaskwrittendown.Webroughttheuserover,reconfirmed thebasicsoftheconsentformtheysignedearlier(theirabilitytoleaveatwill,andthefactwe weretestingtheUInotthem,etc).Foreachtask,Nickverballytoldthemthegoalaswellas provideditinwritingonastickynote.Onlythegoalwasgiven,notanystepstoachieveit.Matt tooknotesthroughoutthetestwhileBenwasthecomputerandprovidedtheUItransitionsin responsetouserinput.
Measures
Duringthetest,wepaidattentiontoanumberofmeasures,mostlyqualitative.Themost importantmeasureweinvestigatedwereanysignsoffrustrationorconfusionfromtheuser. ThisshoweditselfintheformsofhesitancypickingaUIoptionorverbalexpressionsof confusion.Thesecondmostimportantmeasurewaswhethertheuserwassatisfiedthateach
Evaluation Results
Fromourdefinedmeasures,andobservationswewereabletoobtainqualitativeresultsthat showedweaknessesinourdesignwhichuponreflectingallowedustodevisenewsolutions.
Frustrations/Confusion
Ourfirstobservation,wasobservedduringthecompositionofanmessage,whilewatchingfor frustration,andconfusion.Userstendedtobeconfusedaboutadding,andremovingcontacts afterhavinggonefromselectingcontactstothemainbodyofthemessage.Tosolvethe confusion,wedecidedtoaddadeletebuttonshownasanaXnexttoeachcontactinorderto allowanusertoeasilyremoveancontactupondecidingtheynolongerwishtomessagethem. Also,toallowuserstoeasilyaddcontactsaftergoingtothemessagesbody,weaddedanadd recipientbutton.Thebuttonislocatedbelowallcontactswithandefaultprofilepicture,andthe additionsymbolontoptosymbolizethefunctionalityofadding.
Satisfaction
Thesecondobservation,cameafterthecompletionofantaskduringwhichtheuserstendedto beconfusedwhethertheyhadactuallyfinishedthetask,andachievedtheirexpectedresults. Surprisedthatouruserslackedthefeelingofsatisfaction,andduetothefactthatwewere measuringforitweknowwehadtogivethemsomekindofconfirmationthattheycompleted theirdesiredtask.Inordertogiveuserssatisfaction,wedecidedtoaddanconfirmationscreen foreverypieceofdatacreated,oredited.Theconfirmationscreenisshownatthebottomofthe screen,asanlineoftext,wherehelpisgiventostatethechangesmade. Thefinalobservation,camewhenanuserswishedtotakebackanaction,aftergoingpasta pointofnoreturnsuchassending,ordeletingamessage.Wedecidedtoaddamodalpopup thatconfirmstheuserwishestomaketheactionbeforeitsperformed.Thepopupisshownat thecenterofthescreen,withanconfirmationmessagetotheactionbeingperformed,andtwo buttonsonetoperformtheaction,andonetocancelit.
Time
Itshouldbenoted,thatallthoughweobservedthetimeittooktocompletesaidtasks.Our participantsmovedatabriskpacewhichshowedthatthetimeitwastakingthemtocomplete taskswasntsomuchofanconcern.Thatbeingsaid,sincewedidntreallygettorunourlow fidelitypaperprototypebyanelderly,thedesigncouldstillbechangedtomatchtheirneeds basedonlattertests.
Interface Revision
Herearethechangeswementionedintheabovesection.Thesechangesarefocusedon addingfeedbacktotheusersactions.
RemoveandaddrecipientbuttonsontheComposeMailScreen
Confirmmessage&TaskCompletionMessage
Confirmscreenatthebottomofthepagethatstatesthechangesmadeinthepreviousscreen.
Interactive Prototype
Overview
Linktoourinteractiveprototype:http://easemail.daemonfstudios.com/ Theinteractiveprototypewasimplementedinawebsiteusingphptoshowthedynamiccontent andcsstodefinethestyleofthelayout.Theoveralldesignisalmostidenticaltothelowfidelity prototype.Allthescreensinthepaperprototypewereconvertedtowebpageswhicharelinked withhyperlinks.
Interactiveinfobaratthebottomshowsthesystemstatusandguidetheusertodo specifictasks
Feedback
Whenitcametimetogatherfeedbackonourinteractiveprototype,wedecidedtohaveour stakeholdersperformawalkthrough.Duringwhichweusedthreedifferentresearchinstruments inordertogathercriticalfeedbackonwhatourusersthought,andhowtheyinteractedwithour prototype.Thefirstwasobservingforbottomlinenumericdatasuchasthenumberoftimes usersshowedconfusion,orthenumberofunnecessarybuttonclicks.Atthesametimewealso gatheredprocessdatainregardstodata/observationsthatstuckouttousinthewalkthroughas beingodd,orsignificant.Afterthewalkthrough,wefinishedbygivinganquestionnairewherewe gatheredsubjectivefeedbackinregardstowhattheuserthoughtoftheprototype,andwhat changestheyfeltwereneeded.Pleasescrolltotheappendixformoreinformationonthescript usedforthewalkthrough,ortheevaluationprocess. Evaluator1isanoldergentlemanaroundtheageoffortytwowhofitintobeingaenduser,as hehastroubleworkingwithcomputersdespiteusingoneforwork.Throughthewalkthrough evaluator1wasabletoguidehimselfthroughtheprototypethankstothescriptmakinggood timedespiteshowingacouplesignsofconfusion,andgettinglostafewtimeswhichseemed normalforanfirsttimeuse.Notablefeedbackgatheredcameasprocessdatasuchasnot knowingwhithertheemailhadbeensentthefirsttimeduetothefactthattheconfirmation messageseemedhiddenatthebottomofthescreen.Thesecondpiececamewhenthe evaluatorreadthetasktoaddacontactfromanmessagewithoutreadingtheinstructionshe proceededtomanagecontactsonlytorealizehecouldntaddacontactfromthemenu,thus leadinghimtorequestthefunctionalitytoaddacontactwithoutreceivinganmessagefirst. Whenaskedwhatheliked,hestatedthedesignwassimplistic,andeasytouse.Whenasked whathedidntlike,hestatedthathewishedthesendbuttonwasmoreintuitivetoanactualsend button. Evaluator2isanyoungermanwhofitintothecategoryofbeinganUIexpertduetohis technicalbackground.Hewasabletonavigatethroughtheprototypewithease,andwasmuch fasterthanevaluator1,showinglittleconfusion.Heonlygotlostoncelikeevaluator1in mistakingthecontactsbuttonforaddingancontact.Otherwise,mostofthenoteworthyfeedback cameduringthequestionnaire.Whenaskedwhatheliked,evaluator1statedthathethoughtthe prototypefollowedanminimalistdesign.Whenaskedwhathedidntlike,herepliedthatreading fromlefttorightwithmessageswasanpain,andthatthetextwastoosmallinanmessagebox ifitdidnthaveanpictureofthecontactinit,asitrequiredfocusinginonthesmalltext.Despite thecriticismwhenaskedwhohethoughtwouldusethiskindofemail,headmittedthatit seemedlikesomethingforelderly,andcouldlookpastreadingfromlefttorightforthem. Fromevaluators1and2feedback,webelievethatitsimportantforustomakethetextlarger foreachemailintheinboxthatlacksthecontactspicture,andtoaddthefunctionalityforadding contactsinthemanagecontactspagewhichwasntaddedpriortonowduetotimeconstraints.
Appendix
Consent Form 1
Consent Form 2
Consent Form 3
Raw Data
User1
Compose Message (completed):
Navigatedwithease&precision EasilyNavigatedtoInbox Mistooksometextforanbutton Notroubleinfulfillingtask Wasntsureifcontactwasdeletedafterbeingsentbackhome
User2
Compose Message (completed):
UnderstoodUIactions,andtaskfornavigatingtocomposemessage Tookabittorealizehowtoaddmultiplecontacts,andmanagethem Wasntsureifmessagewasactuallysentatfirst NavigatedInboxwithease Wasconfusedaboutthecontactsattachedtothemessage Deletedcontactwithouttrouble
User3
Compose Message (completed):
NavigatedUIatbriskpace,addingcontactseasily Assumedinputboxeswereclickable Uponnavigatingtoinbox,hadtothinkaboutmessagesforabit Also,hadtothinkaboutthedetailsbuttonforanmessage,andwhatitdoes Uponbeingtakenbacktoinboxafterdeletingmessage,userwasntsureiftask wascompleted Realizedhowtomanagecontactswithouttrouble,shownbypace Accidentlydeletedcontact,andwishedtotakeitback
Menu
ComposeNewMessage,ManageContactandCheckInbox
Script:
Task 1: Open an New Message from Wanda Fuqua
1. ClickonInbox 2. ClickonQuestionsonHWfromWandaFuqua
Evaluation Technique:
Bottom Line Data:
Numberoftimesusermakesagesture,orcommenttoshowconfusion Numberoftimesuserclicksbuttonsoutofproceedingorder UserrealizeshomebuttontakesuserbacktoMainMenu Howlongdidittakeforthefirst,second,andthirdtask
Questionnaire:
1. 2. 3. 4. Whatdidyoulikeaboutit? Whatdidntyoulikeaboutit? Whatdidyouthinkoftheboxbuttons? Wouldyouuseitagain?
UI Expert
1. Whodoimaginewouldusethiskindofemail?