How to determine if an interaction is significant in GRR Anova Study

L

llapanowski - 2007

#1
I'm a software guy trying to implement an MSA study using the ANOVA method as discussed in the AIAG MSA book 3rd Edition. I've been using Minitab to verify my results. In Minitab it computes a p-value for an F value with n1,n2 degrees of freedom. Does anybody know how this is computed. I know it matches the FDIST() function in EXCEL, but I actually have to implement it. Also, I've noticed on some of the EXCEL samples instead of computing the p-value, they use the FINV() function with a probability of 0.05. I'm pretty sure this value comes from an F-Table (which I can't find one that has all the numerators, so you have to interpolate, I guess). My question on this why choose 0.05 probability. I don't see this defined in the MSA book, so is this a de facto standard? Does anyone know how to compute the F-table for a given probablity? Thanks for any input.
 
Elsmar Forum Sponsor
E

Eric York - 2010

#2
You pose, as some math geeks would say, some "nontrivial" questions.

I'll back up a bit, please forgive me if you are already intimately familiar with these concepts.

Start with the question of alpha. Yes, a significance level of .05 is sort of a default, but this is mainly because a lot of times (most even) we don't know how to set alpha. Alpha is "the probability of making a type-I error." Helpful eh? :nope: That is to say, it is the maximum probability (risk) you are willing to accept that you will be wrong if you conclude based on your sample that the population really does have the characteristic you are testing against. (Any purists out there will rail at this statement but it is more or less accurate and slightly more intuitive than the technical definition.) In a very small nutshell, the more risk-averse you are, the lower you want to set alpha.

The cool thing about choosing a level of significance is that it vastly simplifies your calculations. When you have a value x of F, you just go to the appropriate F-table for the alpha you have chosen, go to the intersection of your two degrees of freedom, and verify whether your x is bigger than the number shown. If it is, you are "statistically significant at the .05 level."

Much "less trivial" is the question of the F distribution. You will need to either code some numerical integrations that will run "on the fly" or write a routine to run a jillion integrations, then construct a few hundred :notme: F-tables that fit your expected needs and that your code will reference during the calculations performed by your application. If you choose the second method you may want to design your tables with all alpha for a specific pair of df in one table instead of all df for a set alpha in one table. This way you can target more easily your expected sample sizes and shorten lookup times.

Here is a decent link that will give you the equations you need for the calculations: http://en.wikipedia.org/wiki/F_distribution There are a couple different ways to go about the calculations. You will need to at the least reference the Beta function or the regularized incomplete Beta function. Possibly the most direct would be to go directly to the cumulative density function (cdf). (If you use the pdf you will be nesting integrals.) Your p-value for a given value x of F and degrees of freedom d1, d2 is 1-G(x, d1, d2) where G is the cdf.

Hope this helps. :cfingers:

Eric
 
B

Bill Ryan - 2007

#3
Wow :mg:

Excellent first posts by both of you :thanx:

I'm going to have to reread (and probably think a bit about) Eric's answer to a very good question before I can do anything other than welcome you both to the Cove :bigwave:
 
E

Eric York - 2010

#4
llapanowski,
I displayed quite prominently that fact that I'm not a programming guy! Of course you don't need a bunch of tables; you can simply put do your jillion integrations up front and store everything in a single 4-D array: One coordinate for the level of significance, one for each df, and one for the value of the F-statistic. Duh. :bonk:

Bill,
Thanks for the kind words. It does me good to occasionally return, if only momentarily, to my geek roots. :biglaugh:
 
Thread starter Similar threads Forum Replies Date
J Determine the sequence and interaction of processes - ISO9001 Clause 4.1 and 4.1 b ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 15
apestate How do I satisfy 4.1 - Identify and determine the sequence and interaction processes ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 6
A How Do I Determine Interaction of Processes in My Company? ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 22
J UDI-DI how should we interpret Device version or model to determine if a new UDI-DI is needed? EU Medical Device Regulations 0
L How to determine / validate Medical Device Storage Conditions ISO 13485:2016 - Medical Device Quality Management Systems 1
John C. Abnet ISO 9001 4.4.1 "...shall determine the processes needed..." ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 72
S Is using ANSI/ASQ Z1.4-2008 the correct sampling plan to determine Pass/Fail of Apparel measurements? AQL - Acceptable Quality Level 4
E How do you determine if hipot is necessary for a cable product? Manufacturing and Related Processes 8
J Standard used to determine if check fixture gauge is acceptable Reliability Analysis - Predictions, Testing and Standards 2
M Measurement Error - How to determine what is acceptable? Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 3
S How to determine & document Organizational Knowledge of a company Document Control Systems, Procedures, Forms and Templates 4
O Monitoring performance - How do I determine performance measurement basis within my organization? Misc. Quality Assurance and Business Systems Related Topics 4
T IEC 60601-1 - Risk assessment to determine the liquid - 11.6.3 IEC 60601 - Medical Electrical Equipment Safety Standards Series 6
Ashok sunder How to determine the internal and external issues in ISO 45001 standard? Occupational Health & Safety Management Standards 2
C ICP versus AA: How to determine appropriate specification for assay method verification Qualification and Validation (including 21 CFR Part 11) 1
samer Do we have to determine Educational level for all Staff as pr 7.2 b clause? ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 5
A Calibration of Pressure Gauge, How to Determine Calibration Tolerance General Measurement Device and Calibration Topics 1
S Supplier Qualification - How do we determine which suppliers to qualify? ISO 13485:2016 - Medical Device Quality Management Systems 9
K ISO 13485:2016 Cl. 4.2.3 - Determine QMS Processes, Monitoring, Measuring, etc. ISO 13485:2016 - Medical Device Quality Management Systems 4
A Compliance Obligations - Implementing 6.1.1 and 6.1.3 NOTE - Determine risks and... ISO 14001:2015 Specific Discussions 1
B Auditing Senior Management to determine the Effectiveness of Management Processes IATF 16949 - Automotive Quality Systems Standard 6
R What testing would you run to determine if a device is "Clean"? 21 CFR Part 820 - US FDA Quality System Regulations (QSR) 4
B Maximum Material Condition with Bonus - Determine Cpk for this one kpc Measurement Uncertainty (MU) 2
Q Tissue Adherence Test to determine how Tissue sticks to Gauze Other US Medical Device Regulations 2
C DOE - How to determine optimal settings and transposing data Statistical Analysis Tools, Techniques and SPC 2
insect warfare Cannot determine what type of medical device this product is.... 21 CFR Part 820 - US FDA Quality System Regulations (QSR) 2
Buckyb Are KPIs a requirement to determine Process Effectiveness? AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 14
M Is a Real Time Stability Study required to determine Expiration Date? EU Medical Device Regulations 9
K How to determine rated input power for the markings? IEC 60601 - Medical Electrical Equipment Safety Standards Series 2
I How to determine the thread wire size needed - Buttress Thread Gauge General Measurement Device and Calibration Topics 3
M How to determine Process Capability using Minitab 17 Capability, Accuracy and Stability - Processes, Machines, etc. 6
V How does ASQ determine Exam Cutoff Marks Professional Certifications and Degrees 2
R How to Determine Working Voltage & Tolerance for Isolation Barriers? IEC 60601 - Medical Electrical Equipment Safety Standards Series 2
apestate How to determine all regulatory and statutory requirements to be met? ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 6
J Gage R&R Study (Crossed) - How to determine Process Tolerance Using Minitab Software 4
D How can I determine a process metrics? Manufacturing and Related Processes 1
D Can I use the % Tolerance to determine the actual process tolerance? Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 12
R How to determine the Thickness tolerance of the Cold Rolled Steel Manufacturing and Related Processes 6
T Technical regulations that determine the acceptable limits of cigarettes General Measurement Device and Calibration Topics 4
J How does Layout Inspection determine Reference Value? Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 1
Q PPAP - How to determine the "Design Record Change Level" APQP and PPAP 2
K 7.6 c) c) Have Identification in order to determine Calibration Status Calibration Frequency (Interval) 3
S How to determine part that is most difficult to sterilize Other Medical Device Related Standards 10
G How to determine if a Standard is Auditable General Auditing Discussions 15
L Who and when to determine AQL for our product inspection AQL - Acceptable Quality Level 1
R 4 Factors 3 Level DOE to determine which factors are significant Using Minitab Software 2
C How to determine a sample size for comparison purposes ? Quality Tools, Improvement and Analysis 2
S How to determine Preventive Maintenance and Calibration Grace Periods General Measurement Device and Calibration Topics 4
J How to determine a Capability Study for Low-Volume Suppliers Capability, Accuracy and Stability - Processes, Machines, etc. 3
C Statistics equation to determine the number of samples in a lot Statistical Analysis Tools, Techniques and SPC 8

Similar threads

Top Bottom