By
Radzuan Razali
Afza Shafie
S.Rajalingam
1
Contents:
Part One: Probability, Random Variables and Distribution
Chapter 1
1.1 Introduction
1.2 Sample Space, probability of events, counting rule
1.3 Conditional probability
1.4 Multiplication rule
1.5 Bayes theorem
Chapter 2:
2.1 Introduction
2.2 Discrete random variable
2.3 Discrete probability distribution
2.4 Special functions for discrete probability distribution
Chapter 3:
3.1 Introduction
3.2 Continuous random variable
3.3 Continuous probability distribution
3.4 Special functions for continuous probability distribution
Chapter 4:
4.1 Introduction
4.2 The definition and the difference between sample and population
4.3 Graphical display of data: Stem and leaf, and Box-plot
4.4 The mean, variance and standard deviation of the data
2
Chapter 5:
5. Random sample, Central Limit Theorem, Normal Approximation and Statistical process
control: X-bar and R-charts.
5.1 Introduction
5.2 Random sample
5.3 The sampling distribution of X
5.4 Central Limit Theorem
5.5 Normal Approximation for Binomial and Poisson distributions.
5.6 Statistical process control: X-bar and R-charts
Chapter 6:
6.1 Introduction
6.2 Test about a sample mean for large sample, population variance is known
6.3 The P-value for the test and confidence interval for mean
6.4 Test about sample mean for small sample, population variance is unknown
6.5 Test about sample mean for small sample, population variance is unknown but the
sample size is large, n > 30.
6.6 The P-value for the test and confidence interval for mean
6.7 Test about proportion
6.8 The P-value for the test and confidence interval for proportion
6.9 Confidence interval for proportion
6.10 Test about variance
6.11 The P-value for the test and confidence interval for variance
Chapter 7:
7.1 Introduction
7.2 Test about the difference between the means of two populations with variances are
known
7.3 The P-value for the test and confidence interval between the means of two
populations
7.4 Test about the difference between the means of two populations with variances are
unknown but assuming to be equal
7.5 The P-value for the test and confidence interval between the means of two
populations
3
7.6 Test about the difference between the means of two populations with variances are
unknown but assuming there are not equal
7.7 The P-value for the test and confidence interval between the means of two population
means.
7.8 Test about the difference between the means of two population means with variances
are unknown but the samples sizes for both populations are large, n1 > 30 and n2 > 30.
7.9 The P-value for the test and confidence interval between the means of two populations
7.10 Test about the difference between the proportions of two populations
7.11 The P-value for the test and confidence interval between the proportions of two
populations
Chapter 8:
8.1 Introduction
8.2 Least squares estimator to determine the intercept and slope
8.3 Assessment of the regression: standard error of estimate, coefficient of determination
and t-test of the parameters.
8.4 Significance test for the regression model
Chapter 9:
9.1 Introduction
9.2 Normal equations
10. The coefficient of determination
11. 8.4 Confidence intervals and significance tests
Chapter 8:
Appendix
4
Preface
This book provides an introduction to probability and statistics, with particular emphasis on
applications in applied sciences, technology and engineering. Typically introductory texts on
engineering statistics spend a great deal of time on basic probability ideas for the first several
chapters. In fact, basic probabilities can easily fill up a standard introductory course. Because
engineering students often have only one probability/statistics course, the material needs to be
reorganized in order to allow for coverage of statistical methodology.
This book will be divided to four parts; part 1 is related to the basic concept of probability and
the distributions as in the Chapter 1 till Chapter 4. Chapter 1, we give a brief introduction to the
basic concept of the probability. In Chapter 2, we introduce the definition of discrete random
variables and the probability distributions. The continuous and their probability distributions will
be discussed in Chapter 3.
The engineering students also must be given some experience on how to do a basic data analysis.
The inferential statistics are important as a part of statistical methods to do the data analysis. Part
III is covering the inferential statistics such as in the Chapter 6 till Chapter 9. In Chapter 6, we
introduce the hypothesis testing for single population and the hypothesis testing for two
populations will be discussed in Chapter 7. While in Chapter 8 and Chapter 9, we introduce the
simple and multiple linear regressions, respectively.
Finally, in part IV, we also want the students have some experience on the real application in
engineering. The related topics such as a factorial design and design of experiment will be
discussed in the Chapter 10.
Afza Shafie
Radzuan Razali
5
April 2010.
Chapter 1
Learning objectives:
1.1 Introduction
Probability theory refers to the study of randomness and uncertainty. Probability forms
the basis knowledge which we can make inferences about a population based on the
distribution and it’s provide methods for quantifying the chances or likelihood associated
with various outcomes. Probability helps to explain a lot of everyday occurrences and we
actually discuss it frequently.
Probability also has been used everyday in engineering and technology. For example: the
probability of a good part being produce, the reliability of a new machine (reliabilities are
actually probabilities) etc.
An engineer wants to be fairly certain that the percentage of good rods is at least 90%;
otherwise he will shut down the process for recalibration. How certain that he has at least
90% of the 1000 rods are good?
6
1.1.1 Definition:
Some definitions or terms in basic probability must be known and well understand.
Among the definitions are:
Random Process is a situation in which possible results are known but actual results
cannot be predicted with certainty in advance.
In the process of collecting data before analysis and interpretation being done, the method
of how to model the random experiment is crucial. The terms related to it such as sample
space and an event are important.
Example 1.1:
7
Example 1.2:
Toss a coin for three times and observed the number of heads. The sample space is,
S = {0, 1, 2, 3}
The sample space for the lifetime of a machine (in hours) is,
S = { t | t ≥ 0 } = [ 0, ∞ )
The sample space for the number of calls at a telephone exchange during a specific time
interval is,
S = {0, 1,….}
The knowledge in set theory is important to understand the basic of probability. The
union of events A and B denoted by A U B and read “A or B” is the event consisting of all
outcomes that are either in A or in B or in both events.
The intersection of A and B denoted by A ∩ B and read “A and B”, is the event consisting
of all outcomes that are in both A and B.
The complement of event A, denoted by AC, is the event of all outcomes in the sample
space S that are not contained in event A.
If two events A and B have no outcomes in common they are said to be mutually
exclusive or disjoint events. This means that if one of the events occurs the other cannot.
For example, in the experiment tossing a die repeatedly, in the long run, what would we
expect that the probability of even number will occurs, P(E=2 or 4 or 6)?
8
In this experiment, an event is even number will occur three times, so n=3. The total
possible outcomes is six, so N=6. Hence the probability of even number will occur is,
P(E=2 or 4 or 6)=3/6=0.5
Condition of Probability
A probability denoted by P is a rule (or function) which assigns a number between 0 and
1 to each event and must satisfies:
P(Ø ) = 0 , P(S) = 1,
P( A1 A2 ...) P( A1 ) P( A2 ) ...
P( A ') 1 P( A)
For example, if P(rain tomorrow) = 0.6 then P(no rain tomorrow) = 0.4
Example 1.3:
An oil-prospecting firm plans to drill two exploratory wells. Past evidence is used to
assess the possible outcomes listed in the following table:
9
Solution:
Events A, B and C are mutually exclusive because the occurrence of one event
precludes the occurrence of either of the other two.
P(A or B) = P(A) + P(B) = 0.97 (probability at most one well produces oil or
gas)
P(B or C) = P(B) + P(C)= 0.15 (probability at least one well produces gas or oil
P(B’) = 1 – P(B) = 0.88 (probability both wells not produce or both produce oil or gas)
P(A B) 0
Thus
P(A B) P(A) P(B)
This can be expanded to consider more than two mutually exclusive events.
Example 1.4
One of the residential in Ipoh, 45% of all households subscribe to the Sinar Harian
newspaper published in a nearby city, 75% subscribe to the Utusan Malaysia, and 30% of
all households subscribe to both papers. Draw a Venn diagram for this problem.
If a household is selected at random, what is the probability that it subscribes to
a) At least one of the two newspapers
b) Exactly one of the two newspapers
Solution:
10
The probability of an event A equals the number of outcomes (sample points) contained
in A divided by the total number of possible outcomes. That is:
Important condition: all outcomes are equally likely to occur. Inefficient when n(S) is
large.
Eliminates the need for listing each simple event and help to easily assigned probabilities
to various events when the outcomes are equally likely. Especially helpful if the sample
space is quite large.
If there are k elements ( or things) to choose and there are n1 choices for the first
element, n2 for the second element, and so on to nk choices for the kth element,
then the number of possible ways of selecting them is only applies when elements are
different or the order of elements matters.
Example 1.5:
Solution:
The number of ways of permutation of k objects from n distinct objects will be denoted
by the symbol Pk,n
n!
Pk ,n Pkn
( n k )!
11
Example 1.6:
8 teaching assistants are available to grade an exam of four questions. Wish to select a
different assistant to grade each question (only one assistant per question). How many
possible ways can the assistant are chosen for grading?
Solution:
The number of ways of combination of k objects from n distinct objects is denoted by the
symbol Ck,n
n n!
Ck ,n Cnk
k k!( n k )!
Permutation vs. Combination
Permutations are larger in number than combinations: e.g., the three numbers (1,2, 3), (1,
3,2) (2,3,1) , (3,1,2), (3,2,1) are all different permutations of the numbers 1, 2 and 3.
However, they all represent the same combination of numbers.
n n! P
Cnk k ,n
k k !(n k )! k !
Example 1.7:
Solution
The number of rankings that can be assigned to the top five competitors is
15 15!
Ckn 3,003
5 5!10! 12
1.3 Conditional Probability; Independent Events;
Sometimes it is useful to know the probability that an event will occur given that another
event occurred. Given two possible events, if we know that one event occurred then this
information can be applied in calculating the other event’s probability.
p ( A B)
p ( A B) , provided p( B) 0
p ( B)
p ( A B)
p( B A) , provided p( A) 0
p( A)
Example 1.8:
The Information Resource Center (IRC), UTP displays three types of books entitled
“Science” (S), “Engineering” (E), and “Technology” (T). Reading habits of randomly
selected reader with respect to these types of books are
a) P( S | E )
b) P( S |E U T )
c) P( S | reads at least one )
d) P( S U E | T)
Solution:
13
S E
0.03
0.02 0.07
0.05
0.08
0.04
0.20
T
p( S E ) 0.08
p( S E ) 0.3478
p( E ) 0.23
p( S E T ) 0.12
p( S E T ) 0.2553
p( E T ) 0.47
p( S E T ) 0.22
p( S E T ) 0.5946
p(T ) 0.37
The probability of both events occurring can be calculated by rearranging the terms in the
expression of conditional probability.
P ( A B ) P ( A B ) P ( B)
Two events A and B are called independent if the probability of event A is not affected by
the occurrence of event B, so P( A | B) P( A)and P( A B) P( A) P( B)
Example 1.9:
In rolling a fair die, let event A = {1, 3, 5} and event B = {4, 5, 6}.
Are events A and B independent?
14
Solution:
Example 1.10:
Solution:
P( A B) P( A | B). P( B)
P( A B) P( A). P( B)
If events A1, …….., Ak are independent then,
P( A1 A2 ... Ak ) P( A1 ) P( A2 ) P( Ak )
15
Multiplication rule is most useful when the experiment consists of several stages in
succession. The conditioning event, B, describes the outcome of the first stage and A the
outcome of the second, so that P( A| B) – conditioning on what occurs first will often be
known.
Example 1.11:
During a space shot, the primary computer system is backed up by two secondary
systems. They operate independently of one another, and each is 95% reliable. What is
the probability that all three systems will be operable at the time of the launch?
Solution
Let,
A1: event main system is operable
A2: event first backup is operable
A3: event second backup is operable
Suppose B1, B2 ,…, Bn are mutually exclusive and exhaustive in S, then for any event A
n n
P( A) P( A Bi ) P( A | Bi ) P( Bi )
i 1 i 1
Suppose B1, B2 ,…, Bn are mutually exclusive and exhaustive (whose union is S). Let A
be an event such that P(A) > 0. Then for any event Bj , j =1, 2, …, n,
P( A Bk ) P( A | Bk ) P( Bk )
P( Bk | A) n
P( A | B ) P( B )
P( A)
i i
i 1
Example 1.12:
A store stocks bulbs for LCD projector from three suppliers. Suppliers A, B, and C
supply 10%, 20%, and 70% of the bulbs respectively. It has been determined that
company A’s bulbs are 1% defective while company B’s are 3% defective and company
16
C’s are 4% defective. If a bulb is selected at random and found to be defective, what is
the probability that it came from supplier B?
Solution:
0.2 0.03
0.1714
0.1 0.01 0.2 0.03 0.7 0.04
17
Exercise Chapter 1:
2. A digital scale is used that provide weights to the nearest gram. Let event A: a weight
exceeds 11 grams, B: a weight is less than or equal to 15 grams, C: a weight is greater than or
equal to 8 grams and less than 12 grams. What is the sample space for this experiment? and
find
3. Samples of building materials from three suppliers are classified for conformance to air-
quality specifications. The results from 100 samples are summarized as follows:
Conforms
Yes No
R 30 10
Supplie S 22 8
r T 25 5
Let A denote the event that a sample is from supplier R, and B denote the event that a sample
conforms to the specifications. If sample is selected at random, determine the following
probabilities:
4. The compact discs from a certain supplier are analyzed for scratch and shock resistance. The
results from 100 discs tested are summarized as follows:
Scratch
Resistance
High Low
High 30 10
Shock Medium 22 8
Resistance Low 25 5
18
Let A denote the event that a disc has high shock resistance, and B denote the event that a
disc has high scratch resistance. If sample is selected at random, determine the following
probabilities:
5. The reaction times ( in minutes) of a reactor for two batches are measured in an experiment.
6. When a die is rolled and a coin is tossed, use a tree diagram to describe the set of possible
outcomes and find the probability that the die shows an odd number and the coin shows a
head.
7. A bag contains 3 black and 4 while balls. Two balls are drawn at random one at a time
without replacement.
8. An oil-prospecting firm plans to drill two exploratory wells. Past evidence is used to assess
the possible outcomes listed in the following table:
9. In a residential suburb, 60% of all households subscribe to the metro newspaper published in
a nearby city, 80% subscribe to the local paper, and 50% of all households subscribe to both
papers. Draw a Venn diagram for this problem. If a household is selected at random, what is
the probability that it subscribes to
(a) at least one of the two newspapers
(b) exactly one of the two newspapers
19
10. In a student organization election, we want to elect one president from five candidates, one
vice president from six candidates, and one secretary from three candidates. How many
possible outcomes?
11. Suppose each student is assigned a 5 digit number. How many different numbers can be
created?
12. A chemical engineer wishes to conduct an experiment to determine how these four factors
affect the quality of the coating. She is interested in comparing three charge levels, five
density levels, four temperature levels, and three speed levels. How many experimental
conditions are possible?
13. A menu has five appetizers, three soup, seven main course, six salad dressings and eight
desserts. In how many ways can
(a) a full meal be chosen?
(b) a meal be chosen if either and appetizer or a soup is ordered, but not both?
14. Ten teaching assistants are available to grade a test of four questions. Wish to select a
different assistant to grade each question (only one assistant per question). How many
possible ways can the assistant be chosen for grading?
15. Participant samples 8 products and is asked to pick the best, the second best, and the third
best. How many possible ways?
16. Suppose that in the taste test, each participant samples eight products and is asked to select
the three best products. What is the number of possible outcomes?
17. A contractor has 8 suppliers from which to purchase electrical supplies. He will select 3 of
these at random and ask each supplier to submit a project bid. In how many ways can the
selection of bidders be made?
19. Three balls are selected at random without replacement from the jar below. Find the
probability that one ball is red and two are black.
20. A university warehouse has received shipment of 25 printers, of which 10 are laser printers
and 15 are inkjet models. If 6 of these 25 are selected at random by a technician, what is the
probability that exactly 3 of those selected are laser printers?
21. There are 17 broken light bulbs in a box of 100 light bulbs. A random sample of 3 light bulbs
is chosen without replacement.
(a) How many ways are there to choose the sample?
20
(b) How many samples contain no broken light bulbs?
(c) What is the probability that the sample contains no broken light bulbs?
(d) How many ways to choose a sample that contains exactly 1 broken light bulb?
(e) What is the probability that the sample contains no more than 1 broken light bulb?
22. An agricultural research establishment grows vegetables and grades each one as either good
or bad for taste, good or bad for its size, and good or bad for its appearance. Overall, 78% of
the vegetables have a good taste. However, only 69% of the vegetables have both a good
taste and a good size. Also, 5% of the vegetables have a good taste and a good appearance,
but a bad size. Finally, 84% of the vegetables have either a good size or a good appearance.
(a) if a vegetable has a good taste, what is the probability that it also has a good size?
(b) if a vegetable has a bad size and a bad appearance, what is the probability that it has a
good taste?
23. A local library displays three types of books entitled “Science” (S), “Arts” (A), and
“Novels” (N). Reading habits of randomly selected reader with respect to these types of
books are
24. A batch of 500 containers for frozen orange juice contains 5 that are defective. Two are
selected at random, without replacement, from the batch. Let A and B denote that the first
and second selected is defective respective
(a) Are A and B independent events?
(b) If the sampling were done with replacement, would A and B be independent?
25. Everyday (Mon to Fri) a batch of components sent by a first supplier arrives at certain
inspection facility. Two days a week, a batch also arrives from a second supplier. Eighty
percent of all batches from supplier 1 pass inspection, and 90% batches of supplier 2 pass
inspection. On a randomly selected day, what is the probability that two batches pass
inspection?
26. The probability is 1% that an electrical connector that is kept dry fails during the warranty
period of a portable computer. If the connector is ever wet, the probability of a failure during
the warranty period is 5%. If 90% of the connectors are kept dry and 10% are wet, what
proportion of connectors fail during the warranty period?
27. Computer keyboard failures are due to faulty electrical connects (12%) or mechanical defects
(88%). Mechanical defects are related to loose keys (27%) or improper assembly (73%).
21
Electrical connect defects are caused by defective wires (35%), improper connections (13%)
or poorly welded wires (52%). Find the probability that a failure is due to
(a) loose keys
(b) improperly connected or poorly welded wires.
28. During a space shot, the primary computer system is backed up by two secondary systems.
They operate independently of one another, and each is 90% reliable. What is the probability
that all three systems will be operable at the time of the launch?
29. A store stocks light bulbs from three suppliers. Suppliers A, B, and C supply 10%, 20%, and
70% of the bulbs respectively. It has been determined that company A’s bulbs are 1%
defective while company B’s are 3% defective and company C’s are 4% defective. If a bulb
is selected at random and found to be defective, what is the probability that it came from
supplier B?
30. A particular city has three airports. Airport A handles 50% of all airline traffic, while airports
B and C handle 30% and 20%, respectively. The rates of losing a baggage in airport A, B and
C are 0.3, 0.15 and 0.14 respectively. If a passenger arrives in the city and losses a baggage,
what is the probability that the passenger arrives at airport A?
31. A company rated 75% of its employees as satisfactory and 25% unsatisfactory. Of the
satisfactory ones 80% had experience, of the unsatisfactory only 40%. If a person with
experience is hired, what is the probability that (s)he will be satisfactory?
32. In a certain assembly plant, three machines, B1, B2, B3, make 30%, 45% and 25%,
respectively, of the products. It is known from past experience that 2%,3% and 2% of the
products made by each machine, respectively, are defective. Now, suppose that a finished
product is randomly selected.
(a) What is the probability that it is defective?
(b) If a product was chosen randomly and found to be defective, what is the probability that
it was produced by machine B3?
33. Three machines A, B and C produce identical items of their respective output 5%, 4% and
3% of the items are faulty. On a certain day A has produced 25%, B has produced 30% and
C has produced 45% of the total output. An item selected at random is found to be faulty.
What are the chances that it was produced by C?
34. Suppose that a test for Influenza A, H1N1 disease has a very high success rate: if a tested
patient has the disease, the test accurately reports this, a ’positive’, 99% of the time, and if a
tested patient does not have the disease, the test accurately reports that, a ’negative’, 95% of
the time. Suppose also, however, that only 0.1% of the population have that disease.
(a) What is the probability that the test returns a positive result?
(b) If the patient has a positive, what is the probability that he has the disease?
(c) What is the probability of a false positive?
22
35. An insurance company charges younger drivers a higher premium than it does older drivers
because younger drivers as a group tend to have more accidents. The company has 3 age
groups: Group A includes those less than 25 years old, have a 22% of all its policyholders.
Group B includes those 25-39 years old, have a 43% of all its policyholders, Group C
includes those 40 years old and older, have 35% of all its policyholders. Company records
show that in any given one-year period, 11% of its Group A policyholders have an accident.
The percentages for groups B and C are 3% and 2%, respectively.
(a) What is the probability that the company’s policyholders are expected to have an accident
during the next 12 months?
(b) Suppose Mr. Chong has just had a car accident. If he is one of the company’s
policyholders, what is the probability that he is under 25?
23
Chapter 2
Learning objectives:
2.1 Introduction
Example 2.1:
Select a soccer player; the random variable Y is the number of goals the player has
scored during the season.
The test marks for 100 engineering students; the random variable Z is the average number
of goals scored by the students.
There are two types of random variables called a discrete random variable and a
continuous random variable.
24
2.3 Continuous random variable
The measured values for continuous random variables are in terms of real number in the
range. It can be any values within the range. The weight of students in this class is the
example of a continuous random variable.
Example 2.2:
Identify whether the random variable below is discrete or continuous random variable.
Solution:
(i) discrete
(ii) discrete
(iii) continuous
(iv) discrete
(v) continuous
(vi) continuous
(vii) continuous
(viii) discrete
Suppose the experiment is flipping a coin two times. This simple experiment can have
four possible outcomes or sample space: HH, HT, TH, and TT. Now, let the random
variable X represent the number of Heads that result from this experiment. The random
variable X can only take on the values 0, 1, or 2, so it is a discrete random variable.
25
The probability distribution for this experiment appears as below.
The above table represents a discrete probability distribution and the probability function,
P(X=xi) is called probability mass function (pmf) of X because it relates each value of a
discrete random variable with its probability of occurrence.
The pmf, P(X=xi) of a discrete random variable X must satisfied two conditions;
(i) 0 P( X xi ) 1
(ii) P( X xi ) 1
xi
Given pmf, the probability of X occurs can be calculated. For example the probability at
most one occurs is P( X 1) P( X 0) P( X 1)
Example 2.3:
Two balls are drawn at random in succession without replacement from an urn containing
4 red balls and 6 black balls. Find the probabilities of all the possible outcomes.
Solution:
Possible RR RB BR BB
outcomes
X 2 1 1 0
Here, x1 = 2, x2 = 1, x3 = 1, x4 = 0
Now, the probability of getting 2 red balls when we draw out the balls one at a time is:
Likewise, for the probability of red first is 4/10 followed by black is 6/9 (because there
are 6 black balls still in the urn and 9 balls all together). So:
X 2 1 0
P(X=x) 2/15 8/15 5/15
Example 2.4:
X 0 1 2 3 4 5
P(X=x) 1/10 1/5 k 1/5 3/10 1/10
Solution:
P( X xi ) 1/ 10 1/ 5 k 1/ 5 3 / 10 1/ 10 1 k 1/ 10 .
xi
27
2.4.2 The cumulative distribution function (cdf)
F ( x) P( X x) P( X xi )
xi x
Example 2.5:
Given pmf,
X 2 1 0
P(X=x) 2/15 8/15 5/15
Solution:
For x < 0, F ( x) P( X x) 0
For 0 x 1, F ( x) P( X 0) P( x 0) 5 / 15
For x 2, F ( x) P( X 2) P( x 0) P( x 1) P( x 2)
5 / 15 8 / 14 2 / 15 1
0 ,x 0
5 / 15 ,0 x 1
F ( x) 13 / 15 ,1 x 2
1 ,x 2
28
2.4.3 The mean and the variance of X
Given the pmf of X, P(X=x), all the parameters of X such as the mean, the variance and
the standard deviation can be determined by using the expectation definition.
n
E ( X ) xi P( X xi )
i 1
n
Var ( X ) 2 E ( X 2 ) ( E ( X )) 2 xi2 P( X xi ) 2
i 1
Example 2.6:
X 2 1 0
P(X=x) 2/15 8/15 5/15
Solution:
n
E ( X ) xi P( X xi ) 2(2 / 15) 1(8 / 15) 0(5 / 15) 12 / 15 0.8
i 1
n
Var ( X ) 2 E ( X 2 ) ( E ( X )) 2 xi2 P( X xi ) 2
i 1
2 (2 / 15) 1 (8 / 15) 0 (5 / 15) (0.8) 2
2 2 2
16/15 - 0.64 0.427
29
2.5 Special functions for discrete probability distribution
There are many special discrete probability distributions such as Bernoulli distribution,
Binomial distribution and Poisson distribution.
The experiment conducted with only two possible outcomes. In an experiment of tossing
a fair coin for 1 time and X is the number of head. There are only two possible outcomes,
X =0 or X=1 with probability distribution:
If the Bernoulli experiment conducted for n times, and the random variable X is the
number of success, then the probability distribution of X is called Binomial distribution
with pmf,
n
P( X x) p x q n x , x 0,1, 2, 3,.......
x
By using the definition, it can be shown that, if X is a Binomial distribution, then the
mean of X is E(X) = np and the variance of X, is Var(X) = npq.
Example 2.7:
In the experiment of tossing a fair coin for 10 times, and X is the number of head.
(i) What is the pmf of X?.
(ii) Find the probability the head will appear exactly 5 times.
(iii) What is the probability no head?
(iv) Find the mean and the variance of X.
Solution:
10
P( X x) (0.5) x (0.5)10 x , x 0,1, 2, 3,.......
x
30
10 10!
(ii) P( X 5) (0.5) 5 (0.5) 5 (0.5) 5 (0.5) 5 0.246
5 5!5!
10 10!
(iii) P( X 0) (0.5) 0 (0.5)10 (0.5) 0 (0.5)10 0.00097
0 0!10!
e x
P( X x) , x 0,1, 2, 3,.......
x!
where is the mean of X for the interval of interest.
By using the definition, it can be shown that, if X is a Poisson distribution, then the mean
of X is E(X) = and the variance of X, is Var(X) = .
Example 2.8:
Anne's answering machine receives about 6 telephone calls between 8 a.m. and 10 a.m.
What is the probability that Anne receives more than 1 call in the next 15 minutes?
Solution:
Let X = the number of calls Anne receives in 15 minutes. (The interval of interest is 15
minutes. The random variable X takes on the values 0, 1, 2,.. If Anne receives, on the
average, 6 telephone calls in 2 hours, then Anne will receives 1/8 = 0.75 calls in 15
minutes, on the average. So, it means that is 0.75.
Hence, the probability that Anne receives more than 1 call in the next 15 minutes is,
P( X 1) 1 P( X 1) 1 [ P( x 0) P( X 1)]
e 0.75 (0.75) 0 e 0.75 (0.75)1
1 1 (0.472 0.354) 0.174
0! 1!
31
Exercise 2
2. Let,
x 0 1 2 3
0.15 0.25 k 0.35
3. At UTP, the business students run an investment club. Each semester they create investment
portfolios in multiples of RM1,000 each. Records from the past several years show the
following probabilities of profits (rounded to the nearest RM50). In the table below, x =
profit per RM1, 000 and P(x) is the probability of earning that profit.
32
4. Let X denote the number of bars of service on your cell phone whenever you are at an
intersection with the following probabilities:
x 0 1 2 3 4 5
0.05 0.15 0.20 0.35 0.15 0.1
5. A local cab company is interested in the number of pieces of luggage a cab carries on a taxi
run. A random sample of 260 taxi runs gave the following information. x = number of pieces
of luggage and f is the frequency with which taxi runs carried x pieces of luggage.
x: 0 1 2 3 4 5 6 7 8 9 10
f: 42 51 63 38 19 16 12 10 6 2 1
6. A Professor estimates the probability that he will receive at least one telephone call at home
during the hours of 5pm to 7pm on a weekday to be 1/3. Use the formulas for computing
binomial probabilities to answer the following questions:
(a) What is the probability that he will receive at least one call on all five of the next five
weekday nights?
(b) What is the probability that he will not receive a call on any of the next five weekday
nights?
(c) What is the probability that he will receive a call on at least four of the next five weekday
nights?
7. The probability of successfully landing a plane using a flight simulator is given as 0.80. Nine
randomly and independently chosen student pilots are asked to try to fly the plane using the
simulator.
(a) What is the probability that all the student pilots successfully land the plane using the
simulator?
(b) What is the probability that none of the student pilots successfully lands the plane using
the simulator?
(c) What is the probability that exactly eight of the student pilots successfully land the plane
using the simulator?
33
8. Suppose X has a Poisson distribution a mean of 7 Determine the following.
(a) P(X = 0);
(b) P(X = 5);
(c) P(X < 3); and
(d) P( X 4) .
9. At the Mc Donald drive-thru window of food establishment, it was found that during slower
periods of the day, vehicles visited at the rate of 15 per hour. Determine the probability that
(a) no vehicles visiting the drive-thru within a ten-minute interval during one of these slow
periods;
(b) only 3 vehicles visiting the drive-thru within a ten-minute interval during one of these
slow periods; and
(c) at least three vehicles visiting the drive-thru within a ten-minute interval during one of
these slow periods.
10. The number of cracks in a section of PLUS highway that are significant enough to require
repair is assumed to follow a Poisson distribution with a mean of two cracks per kilometer.
Determine the probability that
(a) there are no cracks at all in 2km of highway;
(b) at least one crack in 500meter of highway; and
(c) there are exactly 3 cracks in 0.5km of highway.
34
Chapter 3
Learning objectives:
3.1 Introduction
If the outcomes of the experiment conducted are continuous random variables, its
probability distribution is called a continuous probability distribution or probability
density function, pdf.
The pdf, f(x) of a continuous random variable X must satisfied two conditions;
(j) 0 f ( x) 1
(ii)
f ( x)dx 1
Given pdf, the probability of X occurs can be calculated. For example the probability at
most one occurs is P( X 1) 1 f ( x)dx
Example 3.1:
35
Solution:
3 0 3 8
Example 3.2:
3x 2 , 0 x 1
f ( x)
0 , elsewhere
Find,
Solution:
(i) 0.5 1
P( X 0.5) f ( x)dx 0 3x 2 dx x 3 (0.5) 3
0.5 0.5
0 8
0.75
P(0.5 X 0.75) 0.5 f ( x)dx 0.5 3x 2 dx x 3
0.75 0.75
0.5
19
(0.75) 3 (0.5) 3
64
36
(ii) The cdf of X,
x
For x 0, F ( x) P( X x) f ( x)dx 0
x 0 x
For 0 x 1, F ( x) P( X x) f ( x)dx 0dx 3x 2 dx x 3
0
x 0 1 x
For x 1, F ( x) P( X x) f ( x)dx 0dx 3x 2 dx 0dx 1
0 1
0 ,x 0
F ( x) x 3 ,0 x 1
1 , x 1
Given the pdf of X, f(x), all the parameters of X such as the mean, the variance
and the standard deviation can be determined by using the expectation definition.
E ( X ) xf ( x)dx
Var ( X ) 2 E ( X 2 ) ( E ( X )) 2 xf ( x)dx 2
Example 3.3:
37
3 2
x ,0 x2
f ( x) 8
0 , elsewhere
Solution:
The mean of X is
23 3x 4 2 3
E ( X ) xf ( x)dx x 3 dx 1.5
08 32 0 2
2 3
Var ( X ) 2 x 2 f ( x)dx 2 x 2 x 2 dx (1.5) 2
0 8
23 9 3 5 2 9 12 9 3
x 4 dx x 0.15
08 4 40 0 4 5 4 20
The random variable X is a uniform distribution, and then the pdf of X is given
by,
1
,a x b
f ( x) b a
0 , elsewhere
38
3.2.2 Exponential distribution
e x ,x 0
f ( x)
0 , elsewhere
Example 3.4:
Let X is the number of individuals failing in a large group and has a exponential
distribution. If we assume that the mean of X under a certain situation is 10, what
is the probability that more than 20 will fail at the same time?
Solution:
e x ,x 0
f ( x)
0 , elsewhere
Hence,
P( X 20) 20 (0.1)e 0.1x dx e 0.1x e 2 0.135
20
The random variable X is a Normal distribution, and then the pdf of X is given by,
( x )2
1
f ( x) e 2
, x
2
39
X ~ N(
1
f ( z) ez
, z
2
2
Z is a random variable normally distributed with mean 0 and variance 1, and
always be written as,
Z ~ N(0,1)
The probability of z occurs can be calculated from pdf and the values of the
integration P(Z z ) f ( z )dz ( z ) are tabulated in the Standard Normal
z
Distribution Table.
Example 3.5:
Solution:
The random variable X is the time employees spend commuting to work and
X ~ N(
Hence,
x 25 15
P( X 25) P P( z 2)
5
1 P( z 2) 1 (2) 1 0.977 0.023
40
Exercise 3
kx 2 for 1 x 1
f (x)
0, elsewhere
k x , 1 x 2
f ( x)
0 , elsewhere
Find
(a) the value of constant k
(b) P(X < 1)
(c) the mean of X
(d) the standard deviation of X.
kxe2 x ,x 0
f ( x)
0 ,x 0
Find
(a) the value of constant k
(b) P(X > 1)
(c) P(0 < X < 2)
(d) the mean of X
(e) the variance of X.
41
kx2 ,0 x 3
f ( x)
0 , elsewhere
Find
(a) the value of constant k
(b) the cdf, F(x)
(c) P(X >1)
(d) the mean of X
(e) the variance of X.
5. Find the cumulative probability distribution of X given that the density function is
k (1 x 4 ), for 0 x 1
f ( x)
0, elsewhere
Find
(a) the value of constant k
(b) the cdf, F(x)
(c) P(0.25 < X < 0.5)
(d) the mean of X
(e) the variance of X.
9. The time between telephone calls to ASTRO, a cable television payment processing
center follows an exponential distribution with a mean of 1.5 minutes. What is the
probability that the time between the next two calls
(a) at least 45 seconds?
42
(b) will be between 50 to 100 seconds?; and
(c) at most 150 seconds?
10. The mean weight of 500 UTP students is 68kg and the variance is 72.25kg. Find the
probability of students who weight
(a) between 65kg and 72kg
(b) more than 70kg
11. An average LCD Projector bulb manufactured by the ABC Corporation lasts 300 days
with variance of 2500days. By assuming that the bulb life is normally distributed,
what is the probability that the bulb will last
(a) at most 365 days?
(b) between 250days and 350days?
(c) at least 400days?
12. The line width of a tool used for semiconductor manufacturing is assumed to be
normally distributed with a mean of 0.5 micrometer and a standard deviation of 0.05
micrometer.
(a) What is the probability that a line width is greater than 0.62 micrometer?
(b) What is the probability that a line width is between 0.47 and 0.63 micrometer?
(c) The line width of 90% of samples is below what value?
oooOOOooo
43
Chapter 4
Learning objectives:
4.1 Introduction
The major use of inferential statistics is to use information from a sample to infer
something about a population. A population is a collection of data whose
properties are analyzed. The population is the complete collection to be studied; it
contains all subjects of interest. A sample is a part of the population of interest, a
sub-collection selected from a population. A parameter is a numerical
measurement that describes a characteristic of a population, while a statistic is a
numerical measurement that describes a characteristic of a sample. In general, we
will use a statistic to infer something about a parameter.
The mean is the sum of all numbers in the list divided by the total numbers in the
list. If the given list is Statistical Population then the mean is called Population
Mean and the given list is a Statistical Sample, then the mean is called Sample
mean. The mean has an expected value of μ, known as the population mean. The
sample mean makes a good estimator of the population mean, as its expected value
which is as the same as the population mean.
44
Population Mean and Variance are defined as:
N
xi 1 N
Mean i 1 Variance σ 2 ( xi )
2
N N i 1
n
xi 1 N
Mean x i 1 Variance s 2 ( xi x)
2
n n 1 i 1
Example 4.1:
Given the sample data as 55, 68, 90, 42, 89, 70. Find the sample mean and the
sample variance of this data.
Solution:
n
xi 55 68 90 42 89 70 414
x i 1
69
n 6 6
1 n 1 2 i 1
n
s2 ( xi x )
2
xi
n 1 i 1 n 1 i 1 n
2
1 (414)
[30334 ] 353.6
5 6
45
4.3 A Stem and Leaf plot
Data can be shown in a variety of ways including graphs, charts and tables. A
Stem and Leaf plot is a type of graph that is similar to a histogram but shows
more information. The Stem-and-Leaf plot summarizes the shape of a set of data
(the distribution) and provides extra detail regarding individual values.
The data is arranged by place value. The digits in the largest place are referred to
as the stem and the digits in the smallest place are referred to as the leaf (leaves).
The leaves are always displayed to the left of the stem. Stem and Leaf plots are
great organizers for large amounts of information. It provides an at ‘a glance’ tool
for specific information in large sets of data, otherwise one would have a long of
marks to sift through and analyze. The totals of data, median and mode are also
can be determined by Stem and Leaf plots. They are usually used when there are
large amounts of numbers or data to analyze. Series of scores on sports teams,
series of temperatures or rainfall over a period of time, series of classroom test
scores are examples of when Stem and Leaf plots could be used.
Example 4.2:
77 80 82 68 65 59 61
55 50 62 61 70 69 64
65 70 62 65 65 75 76
85 80 82 83 79 79 71
80 77 89
Use the Stem and Leaf plot to determine the mode and the median for the
temperatures.
Solution:
First step should be to place the numbers in order from smallest to the largest.
Temperatures
Tens Ones
5 059
6 11224555589
7 001567799
8 0002235 9
46
4.4 A Box plot
Step 2: Find the median, Q2, the lower quartile, Q2 and the upper quartile, Q3 of a
given set of data.
Step 3: Find the interquartile range (IQR). The IQR is the difference between the
upper quartile and the lower quartile.
Step 5: Calculate the 1.5IQR and determine the range of 1.5IQR from upper
quartile and the lower quartile. The value(s) that place outside of the
1.5IQR range called the outlier(s). The value(s) that place outside of the
3IQR range called the extreme outlier(s).
Example 4.3
Suppose that thirty UTP students live in Village 2. These are the following ages:
18, 20, 21, 26, 24, 19, 25, 20, 22, 21,
19, 24, 25, 28, 24, 20, 26, 20, 35, 17,
18, 24, 20, 21, 22, 27, 25, 28, 27, 24.
47
Step 1: Place the numbers in order from smallest to the largest.
17, 18, 18, 19, 19, 20, 20, 20, 20, 20,
21, 21, 21, 22, 22, 24, 24, 24, 24, 24,
25, 25, 25, 25, 26, 26, 27, 27, 28, 35.
Step 2: Find the median, Q2, the lower quartile, Q1 and the upper quartile, Q3 of a
given set of data.
outlier
17 28 o35
48
Exercise 4:
1. Find the mean, median and mode for the following observations:
6.5 7.8 4.6 3.7 6.5 9.2 12.1 6.5 3.7 10.8
2. Find the mean, median and mode for the following observations:
2.3 3.6 2.6 2.8 3.2 3.6 4.3 5.2 6.9 2.8 3.6
4. The following data are direct solar intensity measurements (watts/m2) on different
days at a location in southern Spain: 562, 869, 708, 775, 775, 704, 809, 856, 655, 806,
878, 909, 918, 558, 768, 870, 918, 940, 946, 661, 820, 898, 935, 952, 957, 693, 835,
905, 939, 955, 960, 498, 653, 730, 753. Calculate the sample mean, variance and
sample standard deviation.
5. Find the mean, variance and standard deviation of the following samples of marks for
the probability and statistics final examination.
6. Find the mean, variance and standard deviation of the following samples of marks for
the engineering drawing course.
98.4 98.1 98.0 97.8 96.4 95.2 94.3 92.6 91.8 90.5
89.6 88.7 87.3 86.8 85.7 84.2. 83.7 82.8 80.5 80.8
79.7 78.2 77.4 77.4 76.8 75.9 74.2 73.9 72.6 71.4
69.8 68.6 67.5 66.8 65.2 64.4 63.7 62.8 61.4 60.7
59.2 58.3 58.5 57.6 56.9 55.2 54.7 53.9 52.9 51.2
59.6 48.0 47.8 46.5 45.9 44.6 43.8 42.7 41.8 40.6
39.8 37.4 36.8 36.5 35.6 34.9 33.2 33.8 32.7 31.6
49
7. The shear strengths of 100 spot welds in a titanium alloy follow. Construct a stem-
and-leaf diagram for the weld strength data and comment on any important features
that you notice.
5408 5431 5475 5442 5376 5388 5459 5422 5416 5435
5420 5429 5401 5446 5487 5416 5382 5357 5388 5457
5407 5469 5416 5377 5454 5375 5409 5459 5445 5429
5463 5408 5481 5453 5422 5354 5421 5406 5444 5466
5399 5391 5477 5447 5329 5473 5423 5441 5412 5384
5445 5436 5454 5453 5428 5418 5465 5427 5421 5396
5381 5425 5388 5388 5378 5481 5387 5440 5482 5406
5401 5411 5399 5431 5440 5413 5406 5342 5452 5420
5458 5485 5431 5416 5431 5390 5399 5435 5387 5462
5383 5401 5407 5385 5440 5422 5448 5366 5430 5418
8. The data that follow represent the yield on 90 consecutive batches of ceramic
substrate to which a metal coating has been applied by a vapor-deposition process.
(a) Construct a cumulative frequency plot and histogram for the yield
(b) Construct a stem-and-leaf display for these data.
(c) Find the median, the quartiles, and the 5th and 95th percentiles for the yield
50
9. The average age of the football players on each team of the premier league as follows.
(a) Construct a cumulative frequency plot and histogram for the yield
(b) Construct a stem-and-leaf display for these data.
(c) Find the median, the quartiles, and the 5th and 95th percentiles for the yield
10. The following “ cold start ignition time” of an automobile engine obtained for a test
vehicle are as follows:
1.75 1.92 2.62 2.35 3.09 3.15 2.53 1.91
(a) Calculate the sample median, the quartiles and the IQR
(b) Construct a box plot of the data.
11. The following data are the joint temperatures of the O-rings (°F) for each test firing or
actual launch of the space shuttle rocket motor (from Presidential Commission on the
Space Shuttle Challenger Accident, Vol. 1, pp. 129–131): 84, 49, 61, 40, 83, 67, 45,
66, 70, 69, 80, 58, 68, 60, 67, 72, 73, 70, 57, 63, 70, 78, 52, 67, 53, 67, 75, 61, 70, 81,
76, 79, 75, 76, 58, 31.
12. Ipoh Pantai Hospital compiles data on the length of stay by patients in short-term
hospitals. A random sample of 28 patients yielded the following data on length of
stay, in days.
3 6 15 7 3 55 1
4 4 12 18 9 6 12
5 10 13 7 1 23 9
6 8 11 9 4 21 10
oooOOOooo
51
Chapter 5
Learning objectives:
Central limit theorem says that if the sample size is large, and a random sample is
a set of independent random variables X1, X2, …, Xn has a normal distribution
with mean, and variance, then the sample mean, X is also normally
distributed with mean, and variance, n. That is
X ~ N ( , 2 / n)
Example 5.1:
52
Solution:
The binomial and Poisson distributions are discrete random variables, whereas the
normal distribution is continuous. We need to take this into account when we are
using the normal distribution to approximate a binomial or Poisson using a
continuity correction.
The Central Limit Theorem says that as n increases, the binomial distribution
with n trials and probability p of success gets closer and closer to a normal
distribution. That is, the binomial probability of any event gets closer and closer
to the normal probability of the same event.
That is, if we have a random variable X ~ Bin(n , p) and n is large and p is small
such that np > 5, than X can be calculated approximately using the Normal
distribution. It means that the random variable X will be normally distributed with
mean μ = np and variance, 2 np(1 p) i.e X ~ N().
53
Example 5.2:
Suppose in experiment of tossing a fair coin for 20 times. What is the probability
of getting between 9 and 11 heads?
Solution:
Since n is large and np > 5, then we can use normal approximation to find the
probability. It mean that now, X is normally distributed with mean np =10 and
variance 5. i.e X ~ N (10, 5). Hence,
The normal distribution can also be used to approximate the Poisson distribution
for large values of (the mean of the Poisson distribution).
That is, if we have a random variable X ~ Poisson () and is large than X can be
calculated approximately using the Normal distribution. It means that the random
variable X will be normally distributed with mean μ = and variance, 2 i.e
X ~ N ()
Example 5.3:
A car hire firm has 20 cars to hire. The number of demands for a car is hired per
day is a Poisson distribution with mean of 5. Calculate the probability that at most
ten cars will be hired in one day.
Solution:
Let a random variable X denotes the number of demands for a car.
The given mean value is 5. By the Poisson distribution
54
e x
P( X x ) , x 0, 1, 2, 3, 4, . ........, 20
x!
Hence,
Statistical process control (SPC), is a powerful tools that implement the concept
of prevention as a shift from the traditional quality by inspection/correction. SPC
is a technique that employs statistical tools for controlling and improving
processes. It is an important ingredient in continuous process improvement (CPI)
strategies. It uses simple statistical means to control, monitor, and improve
processes.
histograms
cause-and-effect diagrams
Pareto diagrams
control charts
scatter or correlation diagrams
run charts
process flow diagrams
The most important SPC tool is called control charts. That is a graphical
representations of process performance over time concerned with how (or
whether) processes vary at different intervals and identifying nonrandom or
assignable causes of variation. The control charts are also providing a powerful
analytical tool for monitoring process variability and other changes in process
mean. There are two common charts use in the SPC. The X - chart and R-chart.
The X and Range, R Charts are a set of control charts for variables data (data that
is both quantitative and continuous in measurement, such as a measured
dimension or time). The X - chart monitors the process location over time, based
on the average of a series of observations, called a subgroup. While the R-chart
monitors the variation between observations in the subgroup over time.
55
The X - chart or R- chart are used when you can rationally collect measurements
in groups (subgroups) of between two and ten observations. The charts' x-axes are
time based, so that the charts show a history of the process. The data is time-
ordered; that is, entered in the sequence from which it was generated.
In order to construct the chart, the sample mean, the average of the sub-group and
the limits must be calculated.
1 n
The sample mean is calculated from a set of n data values as x xi .
n i 1
1 m n
The average of the subgroups data is calculated as x xij
mn j 1i 1
where n is the subgroup size and m is the total number of subgroups included in
the analysis.
This x is a centre line of the chart and is called the estimate process mean.
1 m
The average range is calculated as r ri , where r is range between the largest
m i 1
and the smallest value in each subgroup.
The upper and lower limits for the X - chart are calculated by using the formula
While the upper for the R-chart is calculated by using the formula D4 r and for
lower limit using the formula D3 r where D4 and D3 can be find from the process
control chart table.
After the centre line and limits are calculated, and then the chart can be
constructed by plotting the observations of sample number versus x for X -chart
and the sample number versus r for R-chart.
Example 5.4:
56
We will illustrate the use of X and R control charts to assess the statistical
stability of this process. The table presents 20 samples of five parts each. The
values given in the table have been coded by using the last three digits of the
dimension; that is, 31.6 should be 0.50316 inch.
Sample Number x1 x2 x3 x4 x5 X r
1 33 29 31 32 33 31.6 4
2 33 31 35 37 31 33.4 6
3 35 37 33 34 36 35.0 4
4 30 31 33 34 33 32.2 4
5 33 34 35 33 34 33.8 2
6 38 37 39 40 38 38.4 3
7 30 31 32 34 31 31.6 4
8 29 39 38 39 39 36.8 10
9 28 33 35 36 43 35.0 15
10 38 33 32 35 32 34.0 6
11 28 30 28 32 31 29.8 4
12 31 35 35 35 34 34.0 4
13 27 32 34 35 37 33.0 10
14 33 33 35 37 36 34.8 4
15 35 37 32 35 39 35.6 7
16 33 33 27 31 30 30.8 6
17 35 34 34 30 32 33.0 5
18 32 33 30 30 33 31.6 3
19 25 27 34 27 28 28.2 9
20 35 35 36 33 30 33.8 6
57
Exercise 5
1. Suppose X1, X2, …, X20 is a sample from normal distribution N ( 2) with = 5,
2 = 4. Find X
(a) Expectation and Variance of
X of
(b) Distribution
2. Given that X is normally distributed with mean 50 and standard deviation 4, compute
the following for n=25.
(a) Mean and variance of X
(b) P( X 49)
(c) P( X 52)
(d) P( 49 X 51.5)
3. Given that X is normally distributed with mean 20 and standard deviation 2, compute
the following for n=40.
(a) Mean and variance of X
(b) P( X 19)
(c) P( X 22)
(d) P(19 X 21.5)
4. Let X denote the number of flaws in a 1 in length of copper wire. The pmf of X is
given in the following table
X=x 0 1 2 3
P(X=x) 0.48 0.39 0.12 0.01
100 wires are sampled from this population. What is the probability that the average
number of flaws per wire in this sample is less than 0.5?
5. At a large university, the mean age of the students is 22.3 years, and the standard
deviation is 4 years. A random sample of 64 students is drawn. What is the
probability that the average age of these students is greater than 23 years?
6. Assuming an equal chance of a new baby being a boy or a girl, what is the probability
that 60 or more out of the next 100 births at Pantai Hospital will be girls?
7. If 10% of UTP students are international students, what is the probability that fewer
than 100 in a random sample of 818 students are coming from overseas?
8. Suppose that a sample of n = 1,600 tires of the same type are obtained at random from
an ongoing production process in which 8% of all such tires produced are defective.
What is the probability that in such a sample 150 or fewer tires will be defective?
58
9. For overseas flights, an airline has three different choices on its dessert menu—ice
cream, apple pie, and chocolate cake. Based on past experience the airline feels that
each dessert is equally likely to be chosen.
(a) If a random sample of four passengers is selected, what is the probability that at
least two will choose ice cream for dessert?
(b) If a random sample of 21 passengers is selected, what is the approximate
probability that at least two will choose ice cream for dessert?
10. Suppose that at a certain automobile plant, the number of work stoppage is a Poisson
distribution with an average per day due to equipment problems during the production
process is 12.0.What is the approximate probability of having 15 or fewer work
stoppages due to equipment problems on any given day?
11. The number of cars arriving per minute at a toll booth on a particular bridge is
Poisson distributed with a mean of 2.5.What is the probability that in any given
minute
(a) no cars arrive?
(b) not more than two cars arrive?
If the expected number of cars arriving at the toll booth per ten-minute interval is
25.0, what is the approximate probability that in any given ten-minute period
12. A component part for a jet aircraft engine is manufactured by an investment casting
process. The vane opening on this casting is an important functional parameter of the
part. We will illustrate the use of X and R control charts to assess the statistical
stability of this process. The table presents 20 samples of five parts each. The values
given in the table have been coded by using the last three digits of the dimension; that
is, 31.6 should be 0.50316 inch.
59
Sample Number x1 x2 x3 x4 x5 X r
1 33 29 31 32 33 31.6 4
2 33 31 35 37 31 33.4 6
3 35 37 33 34 36 35.0 4
4 30 31 33 34 33 32.2 4
5 33 34 35 33 34 33.8 2
6 38 37 39 40 38 38.4 3
7 30 31 32 34 31 31.6 4
8 29 39 38 39 39 36.8 10
9 28 33 35 36 43 35.0 15
10 38 33 32 35 32 34.0 6
11 28 30 28 32 31 29.8 4
12 31 35 35 35 34 34.0 4
13 27 32 34 35 37 33.0 10
14 33 33 35 37 36 34.8 4
15 35 37 32 35 39 35.6 7
16 33 33 27 31 30 30.8 6
17 35 34 34 30 32 33.0 5
18 32 33 30 30 33 31.6 3
19 25 27 34 27 28 28.2 9
20 35 35 36 33 30 33.8 6
13. The overall length of a skew used in a knee replacement device is monitored using
and R charts. The following table gives the length for 20 samples of size 4.
(Measurements are coded from 2.00 mm; that is, 15 is 2.15 mm.)
Observation Observation
Sample 1 2 3 4 Sample 1 2 3 4
1 16 18 15 13 11 14 14 15 13
2 16 15 17 16 12 15 13 15 16
3 15 16 20 16 13 13 17 16 15
4 14 16 14 12 14 11 14 14 21
5 14 15 13 16 15 14 15 14 13
6 16 14 16 15 16 18 15 16 14
7 16 16 14 15 17 14 16 19 16
8 17 13 17 16 18 16 14 13 19
9 15 11 13 16 19 17 19 17 13
10 15 18 14 13 20 12 15 12 17
60
(a) Using all the data, find trial control limits for and R charts, construct the chart,
and plot the data.
(b) Use the trial control limits from part (a) to identify out-of-control points. If
necessary, revise your control limits, assuming that any samples that plot outside
the control limits can be eliminated.
(c) Assuming that the process is in control, estimate the process mean and process
standard deviation.
14. The thickness of a printed circuit board (PCB) is an important quality parameter. Data
on board thickness (in cm) are given below for 25 samples of three boards each.
Sample 1 2 3 Sample 1 2 3
1 0.0629 0.0636 0.0640 14 0.0645 0.0640 0.0631
2 0.0630 0.0631 0.0622 15 0.0619 0.0644 0.0632
3 0.0628 0.0631 0.0633 16 0.0631 0.0627 0.0630
4 0.0634 0.0630 0.0631 17 0.0616 0.0623 0.0631
5 0.0619 0.0628 0.0630 18 0.0630 0.0630 0.0626
6 0.0613 0.0629 0.0634 19 0.0636 0.0631 0.0629
7 0.0630 0.0639 0.0625 20 0.0640 0.0635 0.0629
8 0.0628 0.0627 0.0622 21 0.0628 0.0625 0.0616
9 0.0623 0.0626 0.0633 22 0.0615 0.0625 0.0619
10 0.0631 0.0631 0.0633 23 0.0630 0.0632 0.0630
11 0.0635 0.0630 0.0638 24 0.0635 0.0629 0.0635
12 0.0623 0.0630 0.0630 25 0.0623 0.0629 0.0630
13 0.0635 0.0631 0.0630
(a) Using all the data, find trial control limits for and R charts, construct the chart,
and plot the data.
(b) Use the trial control limits from part (a) to identify out-of-control points. If
necessary, revise your control limits, assuming that any samples that plot outside
the control limits can be eliminated.
(c) Assuming that the process is in control, estimate the process mean and process
standard deviation.
oooOOOooo
61
Chapter 6
6. Hypothesis Testing – One population
Learning objectives:
6.1 Introduction
62
In hypothesis testing there will be a correct decision or false decision would be
made on the null hypothesis as summarize in this table.
The risk of rejecting the null hypothesis when we should not reject it is called
type I error with probability α. It means that we make a false decision because we
reject H0 when actually H0 is true with probability α.
While when we accept H0 but actually H0 is not true, then we make a wrong
decision and this decision is called type II error is. The probability of type II error
is . We cannot determine β (beta) with the statistical tools you learn in this
course.
The probability type I error, α is called the level of significance and (1- α)100%
is called the confidence level of the test and (1 − β) is called the "power" of the
test.
In hypothesis testing there are three types of test on any parameters of interest
called two tailed (sided) test, upper tailed test and lower tailed test such as in the
table below.
63
statistic. The choice of this test statistics is depend on the parameter of interest
that we want to test. The Central Limit Theorem states that for large sample sizes
(n > 30) drawn randomly from a population, the distribution of the means of those
samples will approximate normality, even when the data in the parent population
are not distributed normally but the population variance is known then a Z-
statistic is usually used for large sample sizes (n > 30). However, often large
samples are not easy to obtain and the population variance is unknown, then the t-
distribution can be used. The population standard deviation is estimated by the
sample standard deviation, s. For test the population variance or standard
deviation, the -statistic is used. In case of performing multiple comparisons by
one way ANOVA, the F-statistic is normally used.
It is the part of the sample space (critical region) where the null hypothesis H0 is
rejected. The size of this region is determined by the probability () of the sample
point falling in the critical region when H0 is true. is also known as the level of
significance, the probability of the value of the random variable falling in the
critical region. Also it should be noted that the term "Statistical significance"
refers only to the rejection of a null hypothesis at some level . It implies that the
observed difference between the sample statistic and the mean of the sampling
distribution did not occur by chance alone.
If the test statistic falls in the rejection/critical region, then we may conclude that
H0 is rejected, it means that there are enough evidence to support the alternative
hypothesis. Otherwise we fail to reject H0 means that there are no evidence to
support the claim that the H1 is true.
In hypothesis testing, there are seven steps to perform any statistical test:
6.2 Testing about the mean for large sample size and the variance is known
64
If the parameter of interest is to test about the mean for population when the
variance is known or the sample size is very large, then the test can be performed
as below:
Step 2: H 0 : 0 versus H1 : 0 or H1 : 0 or H1 : 0
x 0
Step 3: Test statistic: Z 0 ~ N (0, 1)
/ n
Step 4: The critical value, at significant level is Zfor one tailed (sided) test and
Zfor two tailed (sided) test.
Test the hypothesis that the mean age of UTP students is less than 21, given a
random sample of 20 individuals who have a mean of 20 and assume that the age
is normally distributed with variance of 20.
i. Test the hypothesis that the mean age is less than 21. Use alpha = 0.05.
ii. What is the P-value for this test?
iii. Construct 95% two-sided CI on the mean strength.
iv. Use the CI found in part (iii) to test the hypothesis.
Solution:
i. (1) The parameter of interest is to test the true mean age of UTP students, μ.
(2) The hypothesis Testing:
H 0 : 0 21 vs H1 : 0 21
(3) The test statistics is:
x 0
z0
/ n
(6) Computation
x 21, 2 20
20 21
z 0 1
20 / 20
Since zo > -1.65, so we failed to reject H0 and conclude that not enough
evidence to say the true mean age of UTP students is less than 21 years
old at α = 0.05.
ii. The P-value for this test is [(-1)]=0.159. Since P-value > 0.05, then we failed
to reject H0.
66
iii. A 95% two-sided CI on mean strength is
x z 0.025 x z 0.025
n n
20 20
20 1.96 20 1.96
20
20
18.04 21.96
6.3 Testing about the mean when the population variance is unknown
If the parameter of interest is to test about the mean for population when the
variance is unknown or the sample size is small, then to perform the test same as
for variance is known. Except that in step 3, instead of using the Z statistic, now
the test statistic will be replaced by T statistic and will be replaced by s the
sample standard deviation.
Step 2: H 0 : 0 versus H1 : 0 or H1 : 0 or H1 : 0
x 0
Step 3: Test statistic: T ~ t n1 , if 0
s/ n
Step 4: The critical value, at significant level is tn-1for one tailed (sided) test
and t, n-1for two tailed (sided) test.
67
Upper tailed test, 0 P-value = P(Tn-1 > t)
Lower tailed test, 0 P-value = P(Tn-1 < t)
Example 6.2:
i. Using the P-value approach, test the hypothesis that the mean is not 17.0,
ii. Construct 95% two-sided CI on the mean.
iii. Use the CI found in part (ii) to test the hypothesis.
[4 marks]
Solution:
H 0 : 0 17 vs H1 : 0 17
68
x 0
t0
s/ n
(6) Computation
x 16.98, s 0.3188
16.98 17
t0 0.1537
0.3188 / 6
From t-table, t0 = 0.1537 with 5 df is fall < 0.267 for which > 0.4,so the
P-value > 2(0.4) = 0.8
Since P-value > 0.05, then we fail reject H0 and we conclude that the true
mean is 17 at α = 0.05.
s s
x t0.025,5 x t0.025,5
n n
0.3188 0.3188
16.98 2.571 16.98 2.571
6 6
16.645 17.3146
iii. Since 17 is fall in the interval, so we fail to reject H0 and conclude the true
mean is 17at α = 0.05.
In hypothesis testing, the procedure to test about the proportion of the population
is the same as the procedure to test about the mean when the population variance
is known.
Step 2: H 0 : p p0 versus H1 : p p0 or H1 : p p0 or H1 : p p0
69
Step 3: Test statistic:
pˆ p0 X
Z0 ~ N (0, 1) , if p p0 , where pˆ
p0 (1 p0 ) / n n
Step 4: The critical value, at significant level is Zfor one tailed (sided) test and
Zfor two tailed (sided) test.
70
6.5 Testing about the variance
For the parameter of interest is to test about the population variance or standard
deviation, same steps are used except in step 3, the test statistic used in this test is
test. The steps are following:
Step 2: H 0 : 2 02 versus H1 : 2 02 or H1 : 2 02 or H1 : 2 02
(n 1) s 2
2 ~ n21 , if 2 02
2
Step 4: The critical value, at significant level is Zfor one tailed (sided) test and
Zfor two tailed (sided) test.
71
Two tailed test, 2 02 (n 1) s 2 (n 1) s 2
2
2 / 2,n1 12 / 2,n1
Upper tailed test, 2 02 (n 1) s 2
2
12 / 2,n1
Lower tailed test, 02 (n 1) s 2
2
2 / 2,n1
Example 6.3:
Solution:
(6) Computation
50(0.37) 2
02 76.0556
(0.3) 2
72
(7) Result and Conclusion:
Since 76.0556 < 67.50, thus we reject the null hypothesis and conclude that
the engineers claim is true at the 0.05 level of significance.
(ii). From the 2 table, 02.025,50 71.42, 02.01,50 76.15 .Since 71.42<76.0556<
76.15, so the P-value is 0.01 < p < 0.025. Because the P-value is <0.05,
then we reject the null hypothesis.
(n 1) s 2 (n 1) s 2
2
2 / 2, n 1 12 / 2, n 1
50(0.37) 2 50(0.37) 2
2
71.42 32.36
0.0958 0.2115
2
0.309 0.459
Since =0.3 is outside of the interval, then we reject the null hypothesis
and conclude that the engineers claim is true at the 0.05 level of
significance.
oooOOOooo
73
Chapter 6
1. A manufacturer of sprinkler systems used for fire protection in office buildings claims
that the true average system- activation temperature is 1300. A sample of 9 systems
when tested yields an average activation temperature of 131.080F. If the distribution
of activation times is normal with standard deviation 1.50F, does the data contradict
the firm’s claim at level of significance = 0.01. What is the P-value for this test?
2. A random sample of 50 battery packs is selected and subjected to a life test. The
average life of these batteries is 4.05 hours. Assume that the battery life is normally
distributed with standard deviation equals 0.2 hour. Is there evidence to support the
claims that mean battery life exceeds 4 hours? Use a = 0.05. What is the P-value for
this test?
3. The flow discharge of Perak River (measured in m3/s) was obtained at random. 40
readings were collected and the mean flow discharge was found to be 3.815m3/s with
a standard deviation of 0.5m3/s.
(a) Test the hypothesis that mean flow discharge at Perak River is not equal to 4m3/s .
Use =0.05;
(b) Use the P-value approach to test the hypothesis null.
(c) Construct a 95% two-sided CI on mean flow discharge. What is conclusion?
5. A new process for producing synthetic diamonds can be operated at a profitable level
only if the average weight of the diamonds is greater than 0.5 karat. To evaluate the
profitability of the process, six diamonds are generated with recorded weights, 0.46,
0.61, .52, .48, .57 and .54 karat.
(a) At 5% significance level Do the six measurements present sufficient evidence that
the average weight of the diamonds produced by the process is in excess of .05
karat?
(b) Use the P-value approach to test the hypothesis null.
(c) Construct a 95% CI on the average weight of diamonds.
74
6. One of the Cigarette Company claims that their cigarettes contain an average of only
10mg of tar. A random sample of 25 cigarettes shows the average tar content to be
12.5 mg with standard deviation of 4.5mg.
(a) Construct a hypothesis test to determine whether the average tar content of
cigarettes exceeds 10mg. using the P-value approach;
(b) Construct a 95% two-sided CI on the average tar content of cigarettes.
8. A survey done one year ago showed that 45% of the population participated in
recycling programs. In a recent poll a random sample of 1250 people showed that 588
participate in recycling programs.
(a) Test the hypothesis that the proportion of the population who participate in
recycling programs is greater than it was one year ago. Use a 5% significance
level.
(b) Construct a 95% two-sided CI on the proportion.
9. A Ipoh city council member gave a speech in which she said that 18% of all private
homes in the city had been undervalued by the county tax assessor’s office. In a
follow-up story the local newspaper reported that it had taken random sample of 91
private homes. Using professional evaluator to evaluate the property and checking
against county tax records it found that 14 of the homes had been undervalued.
(a) Does this data indicate that the proportion of private homes that are undervalued
by the county tax assessor is different from 18%? Use a 5% significance level.
(b) Construct a 95% two-sided CI on the proportion.
10. Engineers designing the front-wheel-drive half shaft of a new model automobile
claim that the variance in the displacement of the constant velocity joints of the shaft
is less than 1.5 mm. 20 simulations were conducted and the following results were
obtained, x 3.39 and s = 1.41.
(a) At α = 0.05, do these data support the claim of the engineers?
(b) What is the P-value for this test?
(c) Construct a two-sided CI for
11. An Aerospace Engineers claim that the standard deviation of the percentage in an
alloy used in aerospace casting is greater than 0.3. 51 parts were randomly selected
and the sample standard deviation of the percentage in an alloy used in aerospace
casting is s =0.37.
(a) At α = 0.05, do these data support the claim of the engineers?
(b) What is the P-value for this test?
75
(c) Construct a 95% two-sided CI for . What is conclusion?
12. The scientists claim that the variance of sugar content of the syrup in canned peaches
thought to be 18 mg2. From a random sample of 10 cans yields a sample deviation of
4.8mg.
(a) At α = 0.05, do these data support the claim of the scientists?
(b) What is the P-value for this test?
(c) Construct a 95% two-sided CI for . What is the conclusion?
oooOOOooo
76
Chapter 7
Learning objectives:
Understand the procedure or steps to perform the test for two populations.
Do a testing about the different between the two mean when the
populations variance are known.
Do a testing about the different between the two mean when the
populations variance are unknown but assume to be equal.
Do a testing about the different between the two mean when the
populations variance are unknown but assume to be not equal.
Do a testing about the different between the two proportions.
Perform the testing about the different between the two variances.
7.1 Introduction
In hypothesis testing for two populations, the procedure or method is the same as
in hypothesis testing for one population. But now we want to test the different
between two parameters of interest of populations. For example, we want to test
about the different between the two mean of the two populations, and or to
test the different between two proportions of the two populations, p1 and p2.
In this hypothesis testing there are three types of test on any parameters of interest
called two tailed (sided) test, upper tailed test and lower tailed test such as in the
table below.
In hypothesis testing for two populations, the procedure to perform the test is the
same as in the hypothesis testing for one population.
77
(i) Identify the parameter of interest.
(ii) State the hypothesis: Null Hypothesis and Alternate Hypothesis
(iii) Determine the appropriate Test Statistic
(iv) Determine the critical value
(v) Determine the Rejection/Critical Region or P-value or 100(1-)% confidence
intervals
(vi) Calculate the Test Statistic
(vii) Make a decision or conclusion based on step (v).
7.2 Testing about the different between the two means, when the both population
variances are known.
If the parameter of interest is to test about the different between the two means for
two populations when both variances are known, then the test can be performed as
below:
Step 1: To test about the different between two means, and when both
population variances, 12 and 22 are known
Step 2:
H 0 : 1 2 0 versus H1 : 1 2 0 or H1 : 1 2 0or H1 : 1 2 0
( x 1 x 2 ) ( 1 2 )
Step 3: Test statistic: Z 0 ~ N (0, 1)
12 22
n1 n2
Step 4: The critical value, at significant level is Zfor one tailed (sided) test and
Zfor two tailed (sided) test.
78
ii. P-Value approach:
Example 7.1:
i. Test the hypothesis that both propellants have the same mean burning rate,
using the P-value approach.
ii. Construct a two-sided 95% CI on the difference in means, 12.
iii. What is the practical meaning of this interval?
Solution:
79
(i) (1) The parameter of interest is the difference in mean fill volume, μ1 - μ2 ,
variances, 12 and 22 are known
H 0 : 1 2 0 versus H1 : 1 2 0
( x1 x 2 )
z0 ~ N (0, 1)
12 22
n1 n2
(18 24)
z0 6.32
9 9
20 20
P-value = 2[1-(6.32)]=2[1-1]=0
Since P-vale < 0.05, then we reject H0 . Both propellants are not the
same mean burning rate.
2 2 2 2
( x1 x 2 ) z0.025 1 2 ( x1 x 2 ) z0.025 1 2
n1 n2 n1 n2
9 9 9 9
(18 24) 1.96 (18 24) 1.96
20 20
20 20
7.859 1 2 4.141
iii. Since is not in the interval then we reject H0. Both propellants
are not the same mean burning rate.
80
7.2 Testing about the different between the two means, when the both population
variances are unknown.
If the parameter of interest is to test about the different between the two means for
two populations when both variances are unknown, then the test can be classified
into two cases. First case we assume that the populations variances are the same,
12 22 and second case is we assume that the variances are not equal, 12 22 .
Testing about the different between the two means, when the both
population variances are unknown but 12 22 . The test can be
performed as below:
Step 1: To test about the different between two means, and when both
population variances, 12 and 22 are unknown but 12 22 .
Step 2:
H 0 : 1 2 0 versus H1 : 1 2 0 or H1 : 1 2 0 or H1 : 1 2 0
( x 1 x 2 ) ( 1 2 )
t0 , with (n1 n 2 2) df
1 1
sp
n1 n 2
where
(n1 1) s12 (n 2 1) s 22
s 2p
n1 n 2 2
Step 4: The critical value, at significant level is tfor one tailed (sided) test and
tfor two tailed (sided) test.
81
Lower tailed test, 1 2 0 t 0 t , n1 n2 2
Example 7.2:
Professor Adams taught the same large lecture course for two terms. Except
for negligible differences the two courses were the same. However, one met at
8a.m. and the other met at 11a.m. The two courses were given final exams of
the same degree of difficulty and covering the same material. Both exams
were worth 100 points. A random sample of 49 students from the 8a.m. class
had an average score of 73.2 with standard deviation 8.1. A random sample of
36 students from the 11:00a.m. class had an average score of 78.1 with
standard deviation 10.0. Assume that the population variances are the same
and the data are drawn from a normal distribution.
i. Does this data indicate that the mean score for the 11:00 a.m. class is
higher than the mean score for the 8a.m. class? Use a 5% significance
82
level.
ii. What is the P-value for this test?
iii. Construct a two-sided 95% CI on the difference in average scores.
Solution:
(i) (1) The parameter of interest is to test the mean score at 11am, is better
than the mean score at 8am,
(2) Hypothesis testing:
H 0 : 1 2 0
vs
H1 : 1 2
( x 1 x 2 ) ( 1 2 )
t0 , with n1 n 2 2 df
1 1
sp
n1 n 2
where
(n1 1) s12 (n 2 1) s 22
s 2p
n1 n 2 2
(6) Computation:
Computations:
83
(7) Result and conclusion:
Since t0 < -1.658, then we have to reject H0 at =0.05. The mean score
for the two tests are the same. There is enough evidence to say that test
at 11am is better result from test at 8am.
From t-table with 83 df, t0 =2.5 is between t= 2.358 and t=2.617, which
give 0.005<p<0.01. Since P < 0.05, thus we reject H0 at the 0.05 level of
significance and conclude that there is enough evidence to say that test at
11am is better result from test at 8am.
iii. A 95% CI for the difference in mean before and after the policy change
where t0.025,22 =1.98 is
Testing about the different between the two means, when the both
population variances are unknown but 12 22 . The test can be
performed as below:
Step 1: To test about the different between two means, and when both
population variances, 12 and 22 are unknown but 12 22 .
Step 2:
H 0 : 1 2 0 versus H1 : 1 2 0 or H1 : 1 2 0 or H1 : 1 2 0
84
( x 1 x 2 ) ( 1 2 )
t0
s12 s 22
n1 n2
2
s12 s 22
v n1 n2
s12 / n1
2
s 22 / n2
2
n1 1 n2 1
Step 4: The critical value, at significant level is tvfor one tailed (sided) test
and tvfor two tailed (sided) test.
85
Upper tailed test, s12 s 22
1 2 0 ( 1 2 ) ( x1 x 2 ) t / 2, v
n1 n2
Lower tailed test, s12 s 22
1 2 0 ( x 1 x 2 ) t / 2 , v ( 1 2 )
n1 n2
Example 7.3:
i. Do the data support the claim that the two companies produce material
with different mean wear? Use 0.05, and assume that each population is
normally distributed but their variances are not equal. What is the P-value
for this test?
ii. Construct a two-sided 95% CI that will address the questions in part(i)
and (ii) above.
(6 marks)
Solution:
(i) (1) The parameter of interest is to test the different between the two means,
and variance unknown but not equal.
(2) Hypothesis testing:
H 0 : A B 0
vs
H1 : A B 0
(3) Test statistics is:
86
( x A x B ) ( A B )
t0
s A2 s B2
n A nB
(4) Critical value
2 2
s A2 s B2 2 2 82
v n A nB
25 25 27
2
s A / nB
2
2
s A / nB
2
22
2
82
2
/ 24 / 24
nA 1 nB 1 25 25
t0.025, 27 = 3.057
(6) Computation:
x A 20, xB 12, s A 2, s B 8, n A nB 25
So
(20 12)
t0 4.85
2 2 82
25 25
Since t0 > 3.057, thus we have to reject the null hypothesis and enough
evidence to support that the means are difference.
P-value for the test is P < 0.0001, since t0 = 4.85 with 27 df is falls > 3.69
for which > 0.0005.
87
x A 20, x B 12, s A 8, s B 2, n A nB 25
s A2 s B2 s2 s2
( x A x B ) t / 2 , v A B ( x A x B ) t / 2 , v A B
n A nB n A nB
82 2 2 82 2 2
(20 12) 3.057) A B (20 12) 3.057)
25 25 25 25
2.9582 A B 13.0427
From CI, since 0 is not in the interval, so we reject H0. Strong
evidence to support that and B are difference
7.3 Testing about the different between the two proportions, p1 and p2.
If the parameter of interest is to test about the different between the two
proportions of two populations, then the test can be performed as below:
Step 2:
H 0 : p1 p2 0 versus H1 : p1 p2 0 or H1 : p1 p2 0or H1 : p1 p2 0
( pˆ 1 pˆ 2 ) ( p1 p 2 )
Step 3: Test statistic: Z 0 ~ N (0, 1)
1 1
pˆ (1 pˆ )
n1 n2
x1 x 2
where, pˆ
n1 n2
Step 4: The critical value, at significant level is Zfor one tailed (sided) test
and Zfor two tailed (sided) test.
88
ii. P-Value approach:
Example 7.4:
Solution:
i. (1) The parameters of interest are to test the proportion of hypertension
patients on sodium restricted diets, pA and non-hypertension patients, pB
(2) Hypothesis testing:
89
H 0 : p A pB
vs
H1 : p A pB
(3) Test statistics is:
( pˆ A pˆ B ) ( p A p B ) x A xB
z0 , where pˆ
1 1 n A nB
pˆ (1 pˆ )
n A nB
Since z0 > 1.65, then we reject H0. It means that enough evidence to claim that
the proportion of patients on hypertension is higher than non hypertension
patients
90
n A 55, nB 149, x A 24, x B 36, pˆ A 0.44, pˆ B 0.24
pˆ A (1 pˆ A ) pˆ B (1 pˆ B ) pˆ A (1 pˆ A ) pˆ B (1 pˆ B )
( pˆ A pˆ B ) z / 2 p A p B ( pˆ A pˆ B ) z / 2
nA nB nA nB
(0.44)(0.56) (0.24)(0.76)
(0.44 0.24) (1.96) p A pB
55 149
(0.44)(0.56) (0.24)(0.76)
(0.44 0.24) (1.96)
55 149
0.052 p A p B 0.348
7.3 Testing about the different between the two variances, 12 and 22 .
If the parameter of interest is to test about the different between the two variances
of two populations, then the test can be performed as below:
Step 2:
H 0 : 12 22 0 versus H1 : 12 22 0 or H1 : 12 22 0or H1 : 12 22 0
s12
Step 3: Test statistic: F0 2
s2
Step 4: The critical value, at significant level is ffor one tailed (sided) test
and ffor two tailed (sided) test.
91
ii. 100(1-)% Confidence Interval on the ratio of two variances
Alternative 12
Hypothesis, H1 Reject H0 IF 1 falls outside of the interval
22
Two tailed test, s12 12 s12
12 22 0 f 1 / 2, n2 1, n1 1 f / 2,n2 1,n1 1
s 22 22 s 22
Upper tailed test, 12 s12
12 22 0 0 f ,n 1,n 1
22 s 22 2 1
Example 7.4:
(ii) Find the 95% two-sided confidence interval on the ratio of two variances.
Solution:
i. (1) The parameters of interest are to test the difference between the two
variances of pollution indexes, and
s12
F0
s 22
92
1 1
F0 f 0.025,12,13 3.15 or F0 f 0.975,12,13 0.32
f 0.025,12,13 3.15
(6) Computation:
s12 0.0340
F0 2 0.648
s 2 0.0525
(7) Result and conclusions:
Since 0.32<F0 < 3.15, then we cannot reject H0. It means that not enough
evidence to say that the variances of the two pollution indexes are different.
s12 12 s12
f 1 / 2 , n2 1, n1 1 f / 2,n2 1,n1 1
s 22 22 s 22
s12 1 12 s12
f / 2,n2 1,n1 1
s 22 f / 2,n2 1,n1 1 22 s 22
0.0340 1 2 0.0340
12 (3.15)
0.0525 3.15 2 0.0525
12
0.206 2 2.041
2
12
From CI, since =1 is in the interval, so we cannot reject H0. It means that
22
not enough evidence to say that the variances of the two pollution indexes are
different.
93
Exercise 7
1. A random sample of size n = 25 taken from a normal population with = 5.2 has a
mean equals 81. A second random sample of size n = 36, taken from a different
normal population with = 3.4, has a mean equals 76.
(a) Do the data indicate that the true mean value 1 and 2 are different? Carry out a
test at = 0.01
(b) Find 90% CI on the difference in mean strength
2. Two machines are used for filling plastic bottles with a net volume of 16.0 oz. The fill
volume can be assumed normal with, s1 = 0.02 and s2 = 0.025. A member of the
quality engineering staff suspects that both machines fill to the same mean net
volume, whether or not this volume is 16.0 oz. A random sample of 10 bottles is
taken from the output of each machine with the following results:
(a) Do you think the engineer is correct? Use the p – value approach.
(b) Find a 95% CI on the difference in means.
3. Two machine are used to fill plastic bottles with dishwashing detergent. The standard
deviations of fill volume are known to be 10.01 and = 0.15 fluid ounce for two
machines, respectively. Two random samples of n1 = 12 bottles from machine 1 and
n2=10 bottles from machine 2 are selected, and the sample mean fill volumes are
x 1 =30.61 x 2 =30.24 fluid ounces. Assume normality.
(a) Test the hypothesis that both machines fill to the same mean volume. Use the P-
value approach;
(b) Construct a 90% two-sided CI on the mean difference in fill volume; and
(c) Construct a 95% two-sided CI on the mean difference in fill volume. Compare
and comment on the width of this interval to the width of the interval in part (ii).
4. To find out whether a new serum will arrest leukemia, 9 mice, all with an advanced
stage of the disease are selected. 5 mice receive the treatment and 4 do not. Survival,
in years, from the time the experiment commenced are as follows:
At the 0.05 level of significance can the serum be said to be effective? Assume the
two distributions to be of equal variances.
5. A new policy regarding overtime pay was implemented. This policy decreased the
pay factor for overtime work. Neither the staffing pattern nor the work loads changed.
To determine if overtime loads changed under the policy, a random sample of
94
employees was selected. Their overtime hours for a randomly selected week before
and for another randomly selected week after the policy change were recorded as
follows:
Employees: 1 2 3 4 5 6 7 8 9 10 11 12
Before: 5 4 2 8 10 4 9 3 6 0 1 5
After: 3 7 5 3 7 4 4 1 2 3 2 2
Assume that the two population variances are equal and the underlying population is
normally distributed.
(a) Is there any evidence to support the claim that the average number of hours
worked as overtime per week changed after the policy went into effect. Use a P-
value approach in arriving at this conclusion.
(b) Construct a 95% CI for the difference in mean before and after the policy change.
Interpret this interval.
6. The diameter of steel rods manufactured on two different extrusion machines is being
investigated. Two random samples of sizes n1 = 15 and n2 = 17 are selected, and
x1 8.37, s12 0.35 and x2 8.68, s22 0.40 respectively. Assume that data are drawn
normal distribution with equal variances.
(a) Is there evidence to support the claim that the two machines produce rods with
different mean diameters ? Use the p – value approach.
(b) Construct a 95% CI on the difference in mean rod diameter.
7. The following data represent the running times of films produced by 2 motion-picture
companies. Test the hypothesis that the average running time of films produced by
company 2 exceeds the average running time of films produced by company 1 by 10
minutes against the one-sided alternative that the difference is less than 10 minutes?
Use a = 0.01 and assume the distributions of times to be approximately normal with
unequal variances.
Time
Company
X1 102 86 98 109 92
95
8. Two companies manufacture a rubber material intended for use in an automotive
application. 25 samples of material from each company are tested, and the amount of
wear after 1000 cycles is observed. For company 1, the sample mean and standard
deviation of wear arex1 20.12mg / 1000cycles and s1 1.9mg / 1000cycles and for
company 2, we obtain
(a) Do the sample data support the claim that the two companies produce material
with different mean wear? Assume each population is normally distributed but
unequal variances?
(b) Construct a 95% CI for the difference in mean wear of these two companies.
Interpret this interval.
9. Professor A claims that a probability and statistics student can increase his or her
score on tests if the person is provided with a pre-test the week before the exam. To
test her theory she selected 16 probability and statistics students at random and gave
these students a pre-test the week before an exam. She also selected an independent
random sample of 12 students who were given the same exam but did not have access
to the pre-test. The first group had a mean score of 79.4 with standard deviation 8.8.
The second group had sample mean score 71.2 with standard deviation 7.9.
(a) Do the data support Professor A claims that the mean score of students who get a
pre-test are different from the mean score of those who do not get a pre test before
an exam. Use the P-value approach and assume that their variances are not equal.
(b) Construct a 95% CI for the difference in mean score of students who get a pre-test
and those who do not get a pre-test before an exam. Interpret this interval.
10. A vote is to be taken among residents of a town and the surrounding county to
determine whether a proposed chemical plant should be constructed. If 120 of 200
town voters favour the proposal and 240 of 500 county residents favour it, would you
agree that the proportion of town voters favouring the proposal is higher than the
proportion of county voters? Use a = 0.05
11. The rollover rate of sport utility vehicles is a transportation safety issue. Safety
advocates claim that the manufacturer A’s vehicle has a higher rollover rate than that
of manufacturer B. One hundreds crashes for each of this vehicles were examined.
The rollover rates were pA=0.35 and pB=0.25.
(a) By using the P-value approach, does manufacturer A’s vehicle has a higher
rollover rate than manufacturer B’s?
(b) Construct a 95% one-sided CI on the difference in the two rollover rates of the
vehicle. Interpret this interval.
96
12. Professor Rady gave 58 A’s and B’s to a class of 125 students in his section of
English 101. The next term Professor Hady gave 45 A’s and B’s to a class of
115students in his section of English 101.
(a) By using a 5% significance level, test the claim that Professor Rady gives a higher
percentage of A’s and B’s in English 101 than Professor Hady does. What is
comment?
(b) Construct a 95% one-sided CI on the difference in the percentage of A’s and B’s
in English 101 given by this two professors.
13. The diameter of steel rods manufactured on two different extrusion machines is being
investigated. Two random samples of sizes n1 = 15 and n2 = 17 are selected, and
x1 8.37, s12 0.35 and x2 8.68, s22 0.40 respectively.
(a) Is there evidence to conclude that the variance of the diameter of steel rods is
different for the two machines? Use the p – value approach.
(b) Construct a 95% two-sided CI on the difference in mean rod diameter.
14. Professor A claims that a probability and statistics student can increase his or her
score on tests if the person is provided with a pre-test the week before the exam. To
test her theory she selected 16 probability and statistics students at random and gave
these students a pre-test the week before an exam. She also selected an independent
random sample of 12 students who were given the same exam but did not have access
to the pre-test. The first group had a mean score of 79.4 with standard deviation 8.8.
The second group had sample mean score 71.2 with standard deviation 7.9.
(a) Do the data support Professor A claims that the mean score of students who get a
pre-test are different from the mean score of those who do not get a pre test before
an exam. Use the P-value approach and assume that their variances are not equal.
(b) Construct a 95% two-sided CI for the difference in mean score of students who
get a pre-test and those who do not get a pre-test before an exam. Interpret this
interval.
15. The melting points of two alloys used were investigated by melting 15 samples of
each material. The sample standard deviation for alloy 1 was 2.34oF and for alloy 2
was 2.5oF.
(a) Do the sample data support a claim that both alloys have the same variance
melting point?. Use
(b) Construct a 95% two-sided confidence interval on the ratio of the two variances.
16. A study was conducted to test whether there are differences between two variances of
petrol consumptions of two types of petrol, RON95 and RON97. Five cars were
selected at random and the data of petrol consumptions in km/liter for each petrol
types are obtained as follow:
97
Km per liter
RON95 RON97
Car 1 8.9 9.2
Car 2 7.5 7.8
Car 3 8.2 8.5
Car 4 8.6 8.8
Car 5 9.5 9.4
(a) Do the sample data support a claim that both petrol types have the same variance
of petrol consumptions?. Use Use = 0.05.
(b) Construct a 95% two-sided confidence interval on the ratio of the two variances.
oooOOOooo
98
Chapter 8
Learning Outcomes:
Use the least squares method to estimate the intercept and slope of the liner
regression model
Carry out tests to determine if the model obtained is an adequate fit to the data
Construct confidence intervals on regression parameters
8.1 Introduction
Regression models are statistical models which describe the variation in one (or
more) variable(s) when one or more other variable(s) vary. Inference based on
such models is known as regression analysis. There are two types of regression
models called simple linear regression model and multiple linear regression
models.
The simple refers to the fact that this regression model has only one response or
dependent variable and one independent variable. The fitted line has the slope
equal to the correlation between the dependent variable, y is also referred to as the
response and independent variable, x is also referred to as regressor or predictor
variable corrected by the ratio of standard deviations of these variables. The
intercept of the fitted line is such that it passes through the center of mass (x, y) of
the data points. The statistical relation between x and y may be expressed as
follows:
Y 0 1 x
(8.1)
Where, 0 is called the intercept of the regression and 1 is the slope of the
regression. These two parameters called regression coefficients. The slope, 1 ,
can be interpreted as the change in the mean value of Y for a unit change in x.
99
The random error term, , is assumed to follow the normal distribution with a
mean of 0 and variance of 2 . Since Y is the sum of this random term and the
mean value, E(Y), (which is a constant), the variance of Y at any given value of x
is also 2 . Therefore, at any given value of x, say xi, the dependent variable Y
follows a normal distribution with a mean of 0 1 xi and a standard deviation
of 2 .
The true regression line corresponding to Equation (8.1) is usually never known.
However, the regression line can be estimated by estimating the coefficients
0 and 1 for an observed data set. The estimates of, ̂ 0 and ̂1 , are calculated
using least squares method. The estimated regression line, obtained using the
values of ̂ 0 and ̂1 , is called the fitted line. The least square estimates, ̂ 0 and
̂1 , are given by
n
n
y i
x
i 1 i 1
n i
xi y i
̂1 i 1 n
2
x
n
i
n
i 1
xi
2
i 1 n
(8.2)
and
ˆ0 y ˆ1 x
(8.3)
n n
yi xi
where y i 1
is the mean of all the observed values and x i 1
is the mean
n n
of all values of the predictor variable at which the observations were taken.
Once the ̂ 0 and ̂1 are known, the fitted regression model can be written as:
yˆ ˆ0 ˆ1 x
(8.4)
100
Where ŷ is the fitted or estimated value based on the fitted regression model. It
is an estimate of the mean value, E(Y). The fitted value, ŷ for a given value of the
predictor variable, xi, may be different from the corresponding observed value, yi.
The difference between the two values is called the residual,
ei yi yˆ i
(8.5)
The fitted regression model, equation (8.4) can be used to estimate the value of
response, y for a certain value of predictor variable x.
The regression model can be evaluated by three method of assessment. There are,
the error of estimate, , the coefficient of determination, R2 and testing the slope
of the regression.
The error of estimate is a square root of the error of sum of squares divided by
SS E
error degree of freedom, n-2. i.e . The smaller the more successful
n2
is the linear regression model in explaining the response, y.
R2 = 1 - SSE/SST
The significance of the fitted regression model can be tested by using the t-
ˆ1
student’s test on the parameter, ̂1 . The test statistic is t 0 . If
se( ˆ1 )
t t
0 , then the null hypothesis, ˆ 0 is rejected. It means that the
/ 2.n 2 1
101
regression model is adequate and fitted to the data otherwise there is no
relationship between x and y.
The analysis of variance (ANOVA) can also be used to test for the significance of
regression as in the table below:
Where,
n
SS R ( yˆ i y ) 2 is called regression sum of squares which measures variability
i 1
explained by the regression model.
n n
SS E ( yi yˆ i ) 2 ei2 is called error sum of squares which measures of
i 1 i 1
unexplained variability in the response.
2
n
yi
n n
SS T S yy ( yi y ) yi
2 2 i 1 is called total sum of squares which
i 1 i 1 n
measures of the total variability in the response.
n n n
SST ( yi y ) 2 ( yi yˆ i ) 2 ( yˆ i y ) 2 SS E SS R
i 1 i 1 i 1
If the value of F is large compared to f,1, n-2, then the regression model is
significant.
102
A 100 (1- a )% confidence level on the slope ̂1 in a simple linear regression is
given by
1 x2
ˆ 2 se( ˆ0 ) ˆ 2 ( )
where se( ˆ1 ) and
n S XX
S XX
Example 8.1
The following measurements of the specific heat of a certain chemical were made
in order to investigate the variation in specific heat with temperature.
Temperature oC 0 10 20 30 40 50
Specific heat 0.51 0.55 0.57 0.59 0.63 0.65
Example 8.2
The following data were collected on 8 lung cancer patients where x measures the
number of years the patient smoke cigarette (or any form of nicotine product) and
y is the physician’s subjective evaluation of the extent of lung damage on a scale
of 0 to 100.
x (years) 25 35 22 15 48 39 42 31
y (0-100) 55 60 50 30 75 70 71 55
103
An analysis of variance is conducted using a statistic software package and the
output is displayed in the table below:
Analysis of Variance
Source Df SS MS F p–
value
Regression 1 1290.84 1290.84 19.331 0.005
Residual Error 6 400.66 66.777
Total 7 1691.50
104
Exercise 8
1. The manager of a car plant wishes to investigate how the plant’s electricity usage
depends upon the plant production. The data is given below
Production 4.51 3.58 4.31 5.06 5.64 4.99 5.29 5.83 4.7 5.61 4.9 4.2
(RMmillion)
(x)
Electricity 2.48 2.26 2.47 2.77 2.99 3.05 3.18 3.46 3.03 3.26 2.67 2.53
Usage
(y)
2. An experiment was set up to investigate the variation of the specific heat of a certain
chemical with temperature. The data is given below
Temperature 50 60 70 80 90 100
o
F
(x)
Heat 1.60 1.63 1.67 1.70 1.71 1.71
(y) 1.64 1.65 1.67 1.72 1.72 1.74
105
Analysis of variance
Source DF SS MS F
Regression 1 23965 23965 63.70
Residual 18 6772 376
Total 19 30737
4. An chemical engineer wants to model the relationship between the purity of oxygen
(y) produced in a chemical distillation process and the percentage of hydrocarbons
(x ) that are present in the main condenser of the distillation unit. A statistical analysis
is carried out and the output is displayed in the table given.
Analysis of variance
Source DF SS MS F
Regression 1 152.13 152.13 12.86
Residual 18 21.25 1.18
Total 19 173.38
(a) Estimate the purity of oxygen when the percentage of hydrocarbon 1%.
(b) Obtain a 95 % confidence interval for the true slope β.
(c) Test for significance of regression for a = 0.05.
5. Regression methods were used to analyze the data from a study investigating the
relationship between roadway surface temperature (x) and pavement deflection (y).
The data follow.
106
Temperature x Deflection y Temperature x Deflection y
74.5 0.641 72.1 0.631
74.0 0.637 71.2 0.641
72.4 0.630 73.0 0.631
75.2 0.644 72.7 0.634
76.0 0.639 71.4 0.638
(a) Estimate the intercept and slope regression coefficients. Write the estimated
regression line.
(b) Compute SSE and estimate the variance.
(c) Find the standard error of the slope and intercept coefficients.
(d) Show that
(e) Compute the coefficient of determination, R2. Comment on the value.
(f) Use a t-test to test for significance of the intercept and slope coefficients at
. Give the P-values of each and comment on your results.
(g) Construct the ANOVA table and test for significance of regression using the P
value. Comment on your results and their relationship to your results in part (f).
(h) Construct 95% CIs on the intercept and slope. Comment on the relationship of these
CIs and your findings in parts (f) and (g).
6. The designers of a database information system that allows its users to search
backwards for several days wanted to develop a formula to predict the time it would
be take to search. Actually elapsed time was measured for several different values of
days. The measured data is shown in the following table:
Number of Days 1 2 4 8 16 25
Elapsed Time 0.65 0.79 1.36 2.26 3.59 5.39
(a) Estimate the intercept and slope regression coefficients. Write the estimated
regression line.
(b) Compute SSE and estimate the variance.
(c) Find the standard error of the slope and intercept coefficients.
(d) Show that
(e) Compute the coefficient of determination, R2. Comment on the value.
(f) Use a t-test to test for significance of the intercept and slope coefficients at .
Give the P-values of each and comment on your results.
(g) Construct the ANOVA table and test for significance of regression using the P-value.
Comment on your results and their relationship to your results in part (vi).
(h) Construct 95% CIs on the intercept and slope. Comment on the relationship of these
CIs and your findings in parts (vi) and (vii).
107
Chapter 9
9. Multiple Linear Regression
Learning Outcomes:
9.1 Introduction
Multiple regressions (the term was first used by Pearson, 1908) is to learn more
about the relationship between several independent or predictor variables and a
dependent or criterion variable. It is an extension of a simple linear regression
model.
Consider the following data consisting of n sets of values
( y1 , x11 , x 21 , ....x k1 )
( y 2 , x12 , x 22 , ....x k 2 )
.
( y n , x1n , x 2 n , ....x kn )
The value of the dependent variable yi is modeled as
Y 0 1 x1 .... k xk (9.1)
The true regression line corresponding to Equation (9.1) is usually never known.
However, the regressions model can be estimated by estimating the coefficients
0 , 1 , 2 , . . . ., k for an observed data set.. The estimated regressions model is
108
obtained using the values of ˆ0 , ˆ1 , ˆ2 , . . ., ˆk are called the fitted model
equations. The least square estimates, ˆ0 , ˆ1 , ˆ2 , . . ., ˆk are given by
These equations can be solved by using matrices. Then we have the fitted
regression model as given below
The analysis of variance (ANOVA) can also be used to test for the significance of
regression as in the table below:
Where,
109
n
SS R ( yˆ i y ) 2 is called regression sum of squares which measures variability
i 1
explained by the regression model.
n n
SS E ( yi yˆ i ) 2 ei2 is called error sum of squares which measures of
i 1 i 1
unexplained variability in the response.
2
n
yi
SS T S yy ( yi y ) 2 yi2 is called total sum of squares which
n n
i 1
i 1 i 1 n
measures of the total variability in the response.
n n n
SST ( yi y ) 2 ( yi yˆ i ) 2 ( yˆ i y ) 2 SS E SS R
i 1 i 1 i 1
If the value of F0 is large compared to f,,k, n-(k+1), then the multiple regression
model is significant.
Example 9.1:
110
i. Estimate the multiple linear regression equation for the data.
ii. Test whether the regression explained by the model obtained in part (i) is
significant at the 0.01 level of significance.
Solution:
i. Using the computer for computations, the following results were observed.
Analysis of Variance
Source DF SS MS F P
Regression 2 10953.334 5476.667 13647.872 0.000
Residual Error 7 2.809 0.401
Total 9 10956.143
Since F > f0.01, 2, 7 = 9.55, then we reject H0. It means that the regressions
are significant.
111
Exercise 9
Test Number y x1 x2
1 1.6 1 1
2 2.1 1 2
3 2.4 2 1
4 2.8 2 2
5 3.6 2 3
6 3.8 3 2
7 4.3 2 4
8 4.9 4 2
9 5.7 4 3
10 5 3 4
112
(b) Fit a multiple linear regression model to these data.
3. A study was performed to investigate the shear strength of soil (y) as it related to
depth in meter (x1) and percentage moisture content (x2). Ten observations were
collected and the following summary quantities obtained:
(a) Estimate the parameters to fit the multiple regression models for these data.
(b) What is the predicted strength when x1=18meter and x2= 43%.
4. A set of experimental runs were made to determine a way of predicting cooking time
y at various levels of oven width x1, and temperature x2. The data were recorded as
follows:
y x1 x2
6.4 1.32 1.15
15.05 2.69 3.4
18.75 3.56 4.1
30.25 4.41 8.75
44.86 5.35 14.82
48.94 6.3 15.15
51.55 7.12 15.32
61.5 8.87 18.18
100.44 9.8 35.19
111.42 10.65 40.4
113
Brightness (%): 54 61 65 100 100 100 50 57 54
Contrast (%): 56 80 70 50 65 80 25 35 26
Useful range (ng): 96 50 50 112 96 80 155 144 255
6. A study was performed on wear of a bearing y and its relationship to x1 = oil viscosity
and x2 = load. The following data were obtained:
114
Chapter 10
10.1 Introduction
• Factor: variable whose influence upon the response variable is being studied
in the experiment.
• Factor Level: different modes or settings of a factor.
• Trial (or runs): applying of a treatment to an experimental unit.
• Treatment or level combination: specific combination of the levels of
different factors.
• Experimental units (subjects): the basic unit for which the response
measurement are collected.
• Replicates: number of experimental units on which a particular treatment is
applied.
• A factorial experiment means that in each complete replicate of the
experiment all possible combinations of the levels of the factors are
investigated.
115
• The effect of a factor is defined as the change in response produced by a
change in the level of the factor.
• Main effect: the primary factors in the study that change the response
variable.
Interaction effect: the change in response variable is due to an interaction
between the factors
A factor is a variable that can take one of several levels used to differentiate one
group from another. An experiment has a one-way, or completely randomized
design if several levels of one factor are being studied and the individuals are
randomly assigned to its levels. (There is only one way to group the data.)
Analysis of variance (ANOVA) is the technique used to determine whether more
than two population means are equal. One-way ANOVA is used for completely
randomized, one-way designs. The response variable is the variable you’re
comparing. The factor variable is the categorical variable being used to define the
groups. We will assume k samples (groups). The one-way is because each value is
classified in exactly one way. Examples include comparisons by gender, race,
color, etc. There are some condition or assumption have to be made such as the
data are randomly sampled. the variances of each sample are assumed equal and
the residuals are normally distributed. The null hypothesis is that the means are all
equal and the alternative hypothesis is that at least one of the means is different.
The ANOVA doesn’t test that one mean is less than another. Its only test whether
all means are equal or at least one is different. The hypothesis is:
H 0 : F M B
vs
H 1 : at least one mean is not equal
One-way ANOVA table is:
Source of variation SS DF MS F P
Between SStreatment k-1 MStreatment = MStreatment/MSerror
group/Treatment SStreatment/k-1
Within group SSerror N-k MSerror=SSerror/N-
(Error) k
Total SStotal N-1
Calculation of SS:
Grand Mean:
The grand mean is the average of all the values when the factor is ignored. It is a
weighted average of the individual sample means.
116
2 2
k k
xi ni xi
x i 1 k i 1
k
N ni N ni
i 1 i 1
x
n x n x
1 1 ....... nk xk
2 2
2
n1 n2 ....... nk
Total variation:
The variation between observations and the grand mean given by
x x x x
k n 2 k n
2
SSTotal = ij ij
i 1 j 1 i 1 j 1
k k 2
SSTreatment ni ( xi x) 2 ni xi x
i 1 i 1
OR
SS Error SSTotal SSTreatment
The between group/treatment df is one less than the number of groups. If we have
three groups/treatments, then df for treatment is 2.
The within group df is the sum of the individual df’s of each group. Let say the
sample sizes are 7, 9, and 8. Then the df for within treatments is = 6 + 8 + 7 = 21.
The total df is one less than the sample size. If the total observations is 24 then the
df for total is 24 – 1 = 23.
117
Example:
The statistics classroom is divided into three rows: front, middle, and back. The
Professor noticed that the further the students were from him, the more likely they
were to miss class or sleep in the class. He wanted to see if the students sit in front
and near to him will did better on the exams. A random sample of the students in
each row was taken. The score for those students on the exam was recorded as
Solution:
x x 2
n
Front 82, 83, 97, 93, 55, 67, 53 530 41,994 7
Middle 83, 78, 68, 61, 77, 54, 69, 51, 63 604 41,404 9
Back 38, 59, 55, 66, 45, 52, 52, 61 428 23.460 8
2
k
xi
(1562) 2
x i 1 k 101,660.2
N ni
24
i 1
Calculation of SS:
k n 2 k n
SSTotal xij x xij2 x
i 1 j 1 i 1 j 1
k
( xij ) 2
SSTreatment
j 1
x
i 1 ni
(530) 2 (604) 2 (428) 2
101,660.2
7 9 8
40,128.57 40,535.11
118 22,898 - 101,660.2
1,901.48
SS Error SSTotal SSTreatment
5,287.8 - 1,901.48
3,386.32
One-Way ANOVA
Source of variation SS DF MS F P
Between 1901.48 2 950.74 5.90 0.009
group/Treatment
Within group 3386.32 21 161.25
(Error)
Total 5287.80 23
Since F > FCritical = 3.47, then we reject the null hypothesis that the means score of
the three rows in class were the same. So we can conclude that at least one row has
a different mean.
We can also use the p-value to make a decision. From ANOVA table, P-value =
0.009, which is less than the significance level of 0.05, so we reject the null
hypothesis. There is enough evidence to support the claim that there is a difference
in the mean scores of the front, middle, and back rows in class. The ANOVA
doesn’t tell which row is different.
Factorial design can be used to identify factors with significant effects on the
response, to identify (discover) interactions among factors, to identify which
factors have the most important effects on the response and last to decide whether
further investigation of a factor’s effect is justified. The 2k factorial design means
that the experiment has been setup with k factors at 2 levels for each factor. The
objective is to test and to determine which are the main effects and the
interactions are important of all k factors at 2 levels.
The Analysis of Variance (ANOVA) can be used to analyze the data from
experimental designs. From the ANOVA, the null hypothesis – that the effect is
equal to 0 is tested. When H0 is rejected, this provides evidence that the factor
involved actually affect the outcome (response). However some assumptions
should be made before we do the analysis. Among the assumptions are the same
numbers of replicates for each treatment, at least 2 replications for each cells, and
each treatment is a random sample from a normal population.
119
10.5 The 22 factorial design
The 22 factorial design means that the experiment has been setup with 2 factors at
2 levels for each factor. The objective is to test and to determine which are the
two main effects and the interactions are important of all 2 factors at 2 levels. In
one experiment, the example of two factors is factor A: reaction time and factor
B: reaction temperature. For factor A, the two levels are time at 1 hour and 2
hours. These levels can also be denoted as – (minus) for one level and + (plus) for
another level. For factor B, the two levels are 35oC (-) and 55oC (+). This can be
explained by the table below:
Factor A (Time)
1 hour 2 hours
(-) (+)
o
35 C Yields Yields
Factor B ( - ) measured measured
(Temperature) x111, x112 , x113 x121, x122 , x123
o
55 C Yields Yields
( + ) measured measured
x211, x212 , x213 x221, x222 , x223
where, n = 3 replications and xijk, k = 1,..,n are the observations in the cell (i,j).
The levels can be in the form of variable data (numbers) or attribute data such as
male and female, on and off. Normally the levels will be designated one level as
high (+) and the other level as low (-) as explained in the table below:
Factor A
(Time)
Low High
( -) (+)
Low (1) a
Factor B (-)
(Temperature) High b ab
(+)
120
All possible treatment combination of the level of the factors or called factorial
experiment is given in a design or test matrix for 22 factorial designs as follows:
The letters (1), a, b and ab represents the total of all n observations at each
treatment combination.
The effect of main factors, factor A and factor B and the effect of AB interaction
can be calculated using the formula below.
a ab b (1) 1
A a ab b (1)
2n 2n 2n
b ab a (1) 1
B b ab a (1)
2n 2n 2n
ab (1) a b 1
AB (1) ab a b
2n 2n 2n
The effects of main factors and the interaction factor can be tested by using the
two-way ANOVA table.
121
ANOVA Table:
2
SS A
1
a ab b (1) (Contrast A)
4n 4n
2
SS B
1
b ab a (1) (Contrast B)
4n 4n
2
SS AB
1
(1) ab a b (Contrast AB)
4n 4n
1 2 n
SS T xijk xijk
2 n
2
i 1 k 1 4n i 1 k 1
j 1 j 1
122
10.8 Least square regression model
The final regression model can be determined from the ANOVA table. For
instance that the interaction factor between A and B is not significant, then the
final regression model is,
Example 1:
An engineer is interested in the effect of cutting speed (A) and tool
geometry (B) on the life in hours of a machine tool. Two cutting speeds and
two different geometries are used. Three experimental tests were done at each of
the four combinations. The data are as follows:
123
Solution:
124
ANOVA Table:
Source of variation SS df MS F0
A 12 1 12 1.321
B 675 1 675 74.315
AB 192 1 192 21.138
Error 72.667 8 9.083
Total 951.667 11
Conclusion:
The effect of A is not significant because F0 < 5.32. But because F0 is greater
than 5.32 for B and AB so it means that the effects of factor B and the interactions
are significant to the effective life of the machine.
125
Exercise 10
1. UTP wishes to compare four programs for training staff to perform a certain task.
Twenty new staffs are randomly selected to the training programs, with 5 in each
program. At the end of the training, a test is conducted to see how quickly trainees
can perform the task. The number of times the task is performed per minute is
recorded for each trainee and the results as in table below:
Program 3 9, 8, 7, 8, 11
Program 4 10, 6, 9, 9, 10
2. A farmer wants to determine which type of fertilizer is best for growing mango trees
in his orchard. He chooses three types of fertilizers, F1, F2 and F3 and treats two
mango trees to each tree is recorded in table below:
F1 32, 40
F2 43, 42
F3 20, 10
126
Arsenic Level
B– B+
(Low - 55%) (High – 59%)
Deposition Time
14.037 13.880
14.165 13.860
A - (Long) 13.972 14.032
13.907 13.914
14.821 14.888
14.757 14.921
A + (Short) 14.843 14.415
14.878 14.932
Total lifetime of 3
Design Material
Treatment AB components
A B
Combinatio (in hours)
n
(1) - - + 122
a + - - 60
b - + - 120
ab + + + 118
127
i. Perform a two way analysis of variance to estimate the effects of design and
material expense on the component life time if the sum squares of total are 1050.
ii. Based on your results in part (a), what conclusions can you draw from the
factorial experiment?
iii. Indicate which effects are significant to the lifetime of a component.
iv. Write the least square fitted model using only the significant sources.
5. An engineer suspects that the surface finish of metal parts is influenced by the type of
paint used and the drying time. He selected two drying times, 20 and 30 minutes and
used two types of paint. Three parts are tested with each combination of paint typoe
and drying time. The data are as follow:
i. Compute the estimates of the effects and their standard errors for this design.
ii. Perform an analysis of variance of the appropriate regression model for this
design. Include in your analysis hypothesis tests for each coefficient, as well as
residual
Temperature (°F)
Material Low High
1 130 155 20 70
74 180 82 58
2 138 110 96 104
168 160 82 60
128
i. Compute the estimates of the effects and their standard errors for this design.
ii. Perform an analysis of variance of the appropriate regression model for this
design. Include in your analysis hypothesis tests for each coefficient, as well as
residual analysis. State your final conclusions about the adequacy of the model.
Compare your results to part (c) and comment.
Test Position
L R
1.66 1.84
Cleaning SD 1.90 1.84
Method 1.92 1.62
-4.21 -7.58
SRD -1.35 -2.20
-2.08 -5.36
i. Compute the estimates of the effects and their standard errors for this design.
ii. Perform an analysis of variance of the appropriate regression model for this
design. Include in your analysis hypothesis tests for each coefficient, as well as
residual analysis. State your final conclusions about the adequacy of the model.
Compare your results to part (c) and comment.
oooOOOooo
129