Significance Testing & Histogram

Significance testing tells us whether an improved design is truly better than the current or baseline design. These tests compare the difference BETWEEN the two designs to the inherent piece to piece variation WITHIN either design. If this difference is small, we conclude that it was caused by the inherent variation. If the difference is large, we conclude that it was not caused by just the inherent variation, therefore there must be a true difference in design. NOTE: in manufacturing, we sometimes refer to the "B" or better process and the "C" or current process rather than to improved and current design; the meaning is the same.

Contents:
histogram worksheet

sig_test worksheet

calculations worksheet

Significance Testing & Histogram

Significance testing tells us whether an improved design is truly better than the current or baseline design. These tests compare the difference BETWEEN the two designs to the inherent piece to piece variation WITHIN either design. If this difference is small, we conclude that it was caused by the inherent variation. If the difference is large, we conclude that it was not caused by just the inherent variation, therefore there must be a true difference in design. NOTE: in manufacturing, we sometimes refer to the "B" or better process and the "C" or current process rather than to improved and current design; the meaning is the same.

Contents:
histogram worksheet contains an entry form for two sets of data: improved design/process and current design/process sig_test worksheet performs a one-sided "t" test and a B vs. Csm non-parametric overlap test calculations worksheet performs the calculations for the previous two worksheets "in the background"

Clear Data
enter no. of cells

Histogram
16 current design 0.720239264 0.87997763 0.698347491 0.967920924 0.89093852 0.768939688 0.979765513 0.744343026 0.758758624 0.813299193 0.87428732 0.813768408 0.927555077 1.059644079 0.869381485 1.081713983 0.854998003 0.879125048 0.732057518 0.942658338

revision B 0.463107225 0.449017518 0.412119895 0.334684594 0.604551566 0.393878249 0.658453247 0.534678567 0.420851833 0.447924581 0.467230717 0.603271367

Histogram
7 6 5 4 3 2 1 0

frequency

0.381373931 0.428063267 0.474752604 0.521441941 0.568131278 0.614820615 0.661509951 0.708199288 0.754888625 0.801577962 0.848267299 0.894956636 0.941645972 0.988335309 1.035024646 1.081713983

upper limit of cell

revision B current design

current design
1.035024646 1.081713983 1.12840332 1.175092657 1.221781993 1.26847133 off scale

t-test
select significance level 0.9 0.95 x 0.99 0.999 SIGNIFICANT at the chosen level

B vs. Csm
to show an improvement... revision B > current design revision B < current design x

no overlap--improved IS better!

Histogram Calculations group 1 group 2 overall 0.658453 1.081714 1.081714 0.334685 0.698347 0.334685 0.046689 max min cell size

t-test calculation

B vs. C

cell no.

upper limit of group 1, no. group 2, no. cell data in cell data in cell

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20

0.381374 0.428063 0.474753 0.521442 0.568131 0.614821 0.66151 0.708199 0.754889 0.801578 0.848267 0.894957 0.941646 0.988335 1.035025 1.081714 1.128403 1.175093 1.221782 1.268471 off scale count

1 3 4 0 1 2 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 12

0 0 0 0 0 0 0 1 3 2 2 6 1 3 0 2 0 0 0 0 0 20

0 0.95 selection of 0 significance 0

critical value:

0 selection 1

0 1

0.95
1 - prob(t)

"1" if error: 0

"1" if error: 0 1 if test passes:

histogram

test for overlaps