Non-Normal Data F test and T test

bobdoering

Stop X-bar/R Madness!!
Trusted Information Resource
#11
I certainly wanted you to be comfortable with the idea that what you are testing is truly "good enough" to prove bad versus good in your product. For ours, as an example, it simply is not adequate.

But...it still poses the amount of error in the tensile testing process and whether the sources of error not related to the actual failure mode are statistically insignificant an not masking the condition you are trying to make a decision on.

If it is black and white good versus bad for your product than you may be fine....and blessed...

But..is it true?
 
Elsmar Forum Sponsor

Miner

Forum Moderator
Staff member
Admin
#12
Hi Bev,

Thanks for your response and guidance.....attached is my excel file. The first page is the data as taken, the second page has the one outlier data point I removed and replaced with a Median value data point 32.00. The process I am examining has very limited data history, settings etc.

Thanks again...

Regards,
Marty
Marty,

You forgot to attach the data file.:eek:
 

optomist1

A Sea of Statistics
Trusted Information Resource
#13
Hi Bev Take II,

Thanks for your response and guidance.....attached is my excel file. The first page is the data as taken, the second page has the one outlier data point I removed and replaced with a Median value data point 32.00. The process I am examining has very limited data history, settings etc.

Thanks again...

Regards,
Marty
 

Attachments

Bev D

Heretical Statistician
Staff member
Super Moderator
#14
sorry for the delay - I was out of the office last week.

I have attached my analysis.
first I always just plot the data and look at it. (best statistical analysis tool you have)

I ran a simple t-test (assuming unequal variances - JMP will automatically assess and perfrom the correct test). I also plotted the confidence intervals on the means (they are the two green diamond shapes wihtthe points of ht ediamonds representing the confidence limits.) I also performed the analysis with and without the extreme value. When you look at the charts you will see that this is much ado about nothing. The statistical analysis isn't really helpful at all. the plots of the data however, are very telling.

The automatic crimping tool has a lower mean, BUT the spread of the individual data points is so large that that very small difference in the mean hardly matters at all.
 

Attachments

optomist1

A Sea of Statistics
Trusted Information Resource
#15
Hi Bev,

No hurry, thanks for your assistance.

This site is fantastic...and thank you for your consistent input and guidance.

Thank you for the analysis...well put much ado about nothing......I agree with your assessment....and especially as a first step simply plotting the data.

I guess I could re-run the test with a larger sample size, and tighter confidence intervals, but I don't have the extra time. For me current purposes this may be sufficient

Regards,
Marty
 

optomist1

A Sea of Statistics
Trusted Information Resource
#16
Hi Bev,

I was sitting here thinking about my last response.....I don't think it made sense. If I chose to re-run with larger samples....this would or should result in narrower CIs and I would be more likely to detect differences, which is not a concern here. If I ran the test for mean differences and had not detected a difference then it might make sense.

Make sense??

Regards,
Marty
 

Miner

Forum Moderator
Staff member
Admin
#17
I think the key issue here is not the statistics, but what you will do with the results.

Let me summarize a few key points from the previous posts as well as my own analysis:

  • There is a statistical difference between both sets of data regardless of the test used (e.g., t-test, 1-way ANOVA, Mann-Whitney, Mood's Median, etc.) or whether the outlier is included or not.
  • Is this difference of any practical importance? That is, will it make you reject the automatic process?
  • Despite the fact that the manual process has a higher median, the outlier may be an indicator that the manual process is susceptible to sporadic crimping defects.
  • Despite the fact that the automatic process has a lower median, you may be able to make adjustments to increase this median.
  • The outlier may be an indication of testing issues, such as slippage.
I think you need to focus on the cause of the outlier. If it is a product of the test, address the test. If it is a product of the manual process, it may be additional support for the automated process. You may also want to consider a DOE on the automated process to see whether the median of this process may be increased.
 
Last edited:

optomist1

A Sea of Statistics
Trusted Information Resource
#18
Hi Miner,

Thank you for the thorough and thoughtful response;

During the interim I looked into the "testing procedure", your last bullet is right on. The testing device is susceptable to slippage due to improper loading of the sample.

This has been addressed by a visual and written clarification to the test procedure regarding proper loading and orientation of the test specimen.

Regarding DOE, I am considering this for a future effort.

Thanks again...

Regards,
Marty
 

Bev D

Heretical Statistician
Staff member
Super Moderator
#19
Optomist1: To address your question concerning large sample sizes and tighter confidence intervals and to expand on what Miner said -
  • Yes the confidence intervals will be tighter.
  • Yes in general larger sample sizes and therefore tighter confidence intervals will 'detect' smaller differences
  • BUT every test you could possibly run (and we must remember that just because we can doesn't mean we should) already indicates a small difference exists. so why run more samples?
  • The automatic process has a lower 'average' pull strength with or without the extreme value. given teh nature of pull strength my assumption is that you are looking for a process with a HIGHER pull strength than the current manual process? If so no amount of re-sampling will change the fact that the automatic process is worse (not much but still...)
  • The mean is not of any real help here. The real clue to improving this process lies in the variation of the individual values.
 

optomist1

A Sea of Statistics
Trusted Information Resource
#20
Hi Bev,

Thanks for the follow up...I agree with you and Miner......for this particular situation, investigating the process variation further, will not be cost effective. With a specification tensile strength minimum of 13lbs, and in both cases the process means are +2X spec and both mins are approx 2x spec, doing so will not be worth while.

Thank you.....

Regards,
Marty
 
Thread starter Similar threads Forum Replies Date
P Ppk results shown as asterisk after the transformation of Non-normal data Using Minitab Software 4
L How to evaluate the process capability of a data set that is non-normal (cannot be transformed and does not fit any known distribution)? Capability, Accuracy and Stability - Processes, Machines, etc. 12
R Non Normal Data in a historically normal process Capability, Accuracy and Stability - Processes, Machines, etc. 6
Y Process Capability for Non-Normal Data - Philosophical Questions Capability, Accuracy and Stability - Processes, Machines, etc. 6
P Non-normal Data Cpk Statistical Analysis Tools, Techniques and SPC 5
S Non-Normal Data - Measurement for "straightness" with a 0.001" max tolerance Capability, Accuracy and Stability - Processes, Machines, etc. 10
D Calculating Cpk on Non-Normal Data Distribution Capability, Accuracy and Stability - Processes, Machines, etc. 10
J Non-Normal Distribution Data - Tolerance Intervals and Minitab Using Minitab Software 7
M t-test with Non Normal Data Statistical Analysis Tools, Techniques and SPC 16
K Non-Normal Data Analysis Literature, Websites, Books for Learning Quality Tools, Improvement and Analysis 2
R Transforming or not Transforming - Dealing with Non-Normal Data Statistical Analysis Tools, Techniques and SPC 10
M Non-Normal Data & Minitab Statistical Analysis Tools, Techniques and SPC 17
M Non Normal Data Managing - Clements Method to get Process Characteristics Statistical Analysis Tools, Techniques and SPC 8
M How to Do Ppk on Non-Normal Data Capability, Accuracy and Stability - Processes, Machines, etc. 10
T Non-normal data for Cp Cpk indices Statistical Analysis Tools, Techniques and SPC 1
U Calculate Z-Score for Non-Normal Data - I have two set of data Statistical Analysis Tools, Techniques and SPC 9
S Capability Analysis of Non-Normal Data Statistical Analysis Tools, Techniques and SPC 23
T Cp and Cpk calculation for Non-normal data? Statistical Analysis Tools, Techniques and SPC 11
T Capability with Non-Normal Data - Component Strength Statistical Analysis Tools, Techniques and SPC 11
Y Perform 2 ways ANOVA in minitab with non normal data involved Using Minitab Software 5
B How to identify whether my data is non-normal? Statistical Analysis Tools, Techniques and SPC 26
U Quality control with non-normal, censored and truncated data examples needed Statistical Analysis Tools, Techniques and SPC 0
BradM Use of Non-Parametric Statistics and Non-Normal Data Statistical Analysis Tools, Techniques and SPC 33
N Analysis of non-normal stratified data for cpk/ppk? Rupture test Capability, Accuracy and Stability - Processes, Machines, etc. 6
R P-value is 0.05 - Normal or non-normal data? Capability, Accuracy and Stability - Processes, Machines, etc. 31
L How to calculate tolerance intervals for non-normal data? Reliability Analysis - Predictions, Testing and Standards 13
J Is a t-test used in non-normal data analysis? Six Sigma 7
C Analyzing Data with a Non-Normal distribution Statistical Analysis Tools, Techniques and SPC 41
A Capability Analysis - Dealing with non-normal data in Minitab Using Minitab Software 8
V MINITAB and non-normal unilateral tolerance data - Cannot confirm Ppk values Using Minitab Software 15
J Non-Normal Data - Transforming the Data to Normal Statistical Analysis Tools, Techniques and SPC 12
R Bootstraping and Resampling Statistics - Capability for non-normal variable data Inspection, Prints (Drawings), Testing, Sampling and Related Topics 6
A Non-normal Distributions in SPC - How do I Normalize Data? Statistical Analysis Tools, Techniques and SPC 55
N Apply control limits to a non-normal distribution Statistical Analysis Tools, Techniques and SPC 13
R Non-normal Distribution Selection where the system is constantly being corrected Capability, Accuracy and Stability - Processes, Machines, etc. 11
V Process Capability for parameters with non-normal distribution. Capability, Accuracy and Stability - Processes, Machines, etc. 16
M Is it possible to get Natural Tolerance (Tn) with Non Normal Distribution? Statistical Analysis Tools, Techniques and SPC 9
B Test of Means or Medians for Non Normal Populations? Using Minitab Software 6
S Which Normality Test more acceptable to FDA; Also, Non-Normal Threshold? Qualification and Validation (including 21 CFR Part 11) 5
S How you define 'Normal & Abnormal' Conditions and 'Routine & Non-routine' Activities ISO 14001:2015 Specific Discussions 8
A Finding Control Limits for a Non-Normal Distribution Statistical Analysis Tools, Techniques and SPC 3
R Torque Confidence Testing (Non-normal Distribution) Statistical Analysis Tools, Techniques and SPC 5
F Non-Normal Distribution vs. Gamma Distribution Statistical Analysis Tools, Techniques and SPC 18
F Process Capability for Non-Normal Process Statistical Analysis Tools, Techniques and SPC 5
C Designing control chart for non-normal variables Statistical Analysis Tools, Techniques and SPC 3
M Cp, Cpk, Dpm, or other? Diameter of a Hole - Non-Normal Distribution Capability, Accuracy and Stability - Processes, Machines, etc. 20
A ANSI Z1.4 or Z1.9 for non-normal distributions? Inspection, Prints (Drawings), Testing, Sampling and Related Topics 5
D Ppk of non-normal bounded proccess, one sided specification Capability, Accuracy and Stability - Processes, Machines, etc. 3
J Capability of Inherently Non-Normal Process - Plating Process Thickness Distribution Statistical Analysis Tools, Techniques and SPC 9
D Control charts for non-normal distributions - Do I need to do anything special? Statistical Analysis Tools, Techniques and SPC 5

Similar threads

Top Bottom