English 3050: Technical Communication I

To: Ms. Amy Ann Lataweic

From: Kindeep Dhatt
Date: February 21, 2016
Subject: User Test Results for How to Calculate a Basic Limit

Introduction
To determine the effectiveness of a WikiHow instruction set, especially for math problems, a
usability test was established for the "How To Calculate a Basic Limit" instruction set. The main
purpose of this WikiHow page is to show the reader how a basic calculus limit problem can be
solved. Because the content on this WikiHow page is specifically targeted for math students,
conducting the usability test was beneficial for the WikiHow community. Not only are there
instructions showing how a problem is solved step by step, there are also tips on how to figure
out some problems quicker.
The instructions are written in simple terminology, and the pictures attached to each step, show a
visual to help break down each step. To evaluate the usability of this instruction set, an
understandability test was created to identify issues that can arise for readers when using the
instruction set.

Objectives
The objective of this usability assessment is to measure the understanding of the more important
points in the set of instructions, and to recognize if they are easily accessible for the reader to
pinpoint. Also, the user test was necessary to discover any problems within the set of
instructions, and to see if something was confusing and needed to be clarified.

Method
A few background questions were asked to the student taking the test, before they were allowed
to begin the understandability assessment. These questions were just quickly recorded so the test
taker's level of knowledge on calculating limits could be determined. The test consisted of the
background questions, the four limit problems, hints, and post-test interview questions.
It was noted, with both beginner and expert level students, how many hints they needed to help
them figure out how to go about the limit problem. The hints they needed in certain sections
during the test, helped identify which steps needed re-wording to better explain what needs to be
figured out within the problem. Additionally, the amount of time they took to complete the four
questions, was also recorded.
The user test created for this instruction set was conducted on Wayne State University students:
beginner and expert levels. These students were tested so there would be data from students with
expert knowledge on calculating limits, and also students with little to no knowledge on

calculating limits. This was important so the instruction set can be established as extremely
helpful, which is the main objective of this experiment. There was a beginner student who took
this usability test, specifically one that had not calculated limits before, and that made it easier to
find what points needed to be clearer in the set of instructions so beginner level math students are
aided in a more efficient manner. Same with expert level students, even though they are highly
skilled in calculating limits, there are still some components of the instruction set that they found
confusing, as well. It was easier to recognize where the problems in the instruction set occurred,
when they asked for hints.
The background questions, and post-test interview questions, helped with how difficult the
student found the test, based on their previous knowledge on limits. Background questions
helped recognize the potential of the student, and also helped predict how easy or difficult the
student should find the exam. With the interview questions, they were used to identify why they
asked for hints, and what information they felt was missing or needs to be added to the
instructions. In a way, the interview questions were advice for the improvement of the WikiHow
set, and help find a way to make it easier for the reader of the set to access important
information, first.

Results
After reviewing the tests taken and incorporating all aspects of the test (including
background/interview questions and hints), a few issues were addressed. The first issue that the
test takers ran across was the order of the instructions. This came from both the users that had
taken the test. They felt as if they didn't know where to look first considering there were so many
pictures, and not enough wording within the steps. One user proposed it would be more efficient
for the steps to first write out the steps, then have the picture at the end of the step. That being
said, they did mention that the steps were simple enough to understand, and they didn't feel as if
they were too lengthy and complicated.
The second problem that occurred was from the beginner level test taker. They proposed that the
pictures should be further broken down into more steps. When it came time for them to look at
how a sample problem was done, they said it appeared as a bunch of numbers written together,
with no direction of in which order the steps were done considering they were not numbered.
They advised numbering the steps and placing the steps further apart, so it is clearer what to do
in each step shown in the picture. However, they did also state that the images helped them better
understand what the written out steps meant.
The last issue that was expressed by the expert level test taker, was that even though the wording
used in the written part of the instructions was simple, it should be more specific. One example
that they provided us was that the letter "c" should be written out as "constant", and the
definition of a constant should be given.
After observing the users taking the test, and helping them out by providing hints, I have
analyzed all their results. The beginner level student scored much higher than expected. The
expectations of this student were based on their previous knowledge on the topic, which was
determined by the background questions. Even though this student struggled with navigating

through the images provided in the steps, they still were able to figure it out and find the
WikiHow set helpful, the downfall being that it took them longer to complete the assessment.
With the expert level student, they scored perfectly and completed it within the expected amount
of time. They understood the concept behind the instruction set and were experienced with the
calculations. Therefore, they knew how to easily access the important information given in the
images. With these results, and the information that was obtained from having this usability
assessment performed, changes were made in the instruction set to better help the targeted math
student audience.

Conclusion
This research was incredibly significant as it had identified revisions that the WikiHow
instruction set needed. Changes that needed to occur included new images with numbered steps,
rearranging the images to be placed after the step was written out, and rephrasing the sentences
within each step and writing out variables instead of abbreviating them. Overall, these revisions
needed to be made in order to produce a more efficient and beneficial set of WikiHow
instructions.

Appendix
A calculator was provided to both of the participants that took the test.

Figure A: Step 2
shown during
userability test
Figure B: Step 2
after revision

Background
Questions:
1) What is
the
highest
level of
math you have taken?
2) On a scale of 1-10, how familiar are you with solving limits?
3) Have you ever solved a limit before?
Beginners answers:
1) MAT 1010
2) 1
3) No

Experts answers:
1) Calculus III
2) 9 (not perfect)
3) Yes

Data Recorded:
Participant

Number of Hints
Needed

Number 1
(Beginner)

Number 2
(Expert)

Time Taken on
Each problem
1) 1 min
2) 7 min
3) 6 min
4) 10 min
1) >1min
2) 2 min
3) 4 min
4) 2 min

Total Time to
Complete
Assignment

24 minutes

>9 minutes