# DOE: High variance and small effects in Minitab

I

#### Imai89

I have a question, a colleague said that Minitab leads to wrong interpretations in DoE for high variance and small effects. He would have used 3 replications of the matrix. Since only the mean value is considered with DoEs, a significant effect is shown even though the variance were very high and therefore the effects were significant. Is this true, or is his statement from my colleague wrong? If so, how can this effect be countered? I think the variance is observed by the F-Value/p-Value?

Thank you very much!
Max

#### Miner

##### Forum Moderator
Staff member
The issue does not originate with Minitab. All hypothesis testing, whether a t-test or the F-test in an ANOVA, is sensitive to sample size (replicates in DOE). Too few samples and the test is under powered and cannot see real differences. Too many samples and the test is over powered and can see differences that are of no practical importance. It sounds like your colleague's DOE was over powered with too many replicates. The correct approach is to design the experiment, determine the smallest difference that is of practical importance, then calculate the required number of samples/replicates to see that difference. Minitab can calculate this using the Power and Sample Size routine.

Asterisk in DOE minitab software Using Minitab Software 23
Selecting factors for screening DoE design Statistical Analysis Tools, Techniques and SPC 8
Including Repeats in DoE using Minitab Using Minitab Software 5
DoE - Number of runs in Plackett-Burman (Minitab) Using Minitab Software 2
DoE (Design of Experiments) - Multiple responses with different factors Using Minitab Software 2
Power point training slides on DOE (Design of Experiments) Wanted Training - Internal, External, Online and Distance Learning 2
I have 3 different factors - DOE help Statistical Analysis Tools, Techniques and SPC 3
Do I need to approach galvanized steel sheet flatness issue with DOE? Problem Solving, Root Cause Fault and Failure Analysis 9
V Screening DOE with 7 Input factors and 4 responses - Significant factors Using Minitab Software 1
H Taguchi mixed model DoE [L16 (4^3 2^6): factors interaction and ANOVA calculation Using Minitab Software 3
R Is there any Excel .xls Spreadsheet available for DOE with 3 factors? Six Sigma 1
N DOE (design of experiments) in Minitab 16 Using Minitab Software 6
D Interpretation of DOE interaction plot Using Minitab Software 8
D Minitab - Design combinations (DOE) Using Minitab Software 4
C DOE - How to determine optimal settings and transposing data Statistical Analysis Tools, Techniques and SPC 2
N 3 factor - 3 level experiment with DoE and Minitab Using Minitab Software 10
M DOE: Significant factor or not Using Minitab Software 2
P When can we apply DOE (Design of Experiments)? Six Sigma 8
S DOE Analysis - Experiments with 5 Factors Statistical Analysis Tools, Techniques and SPC 11
R [Minitab] DOE Output vs. Actual Data Using Minitab Software 6
Blocking In a DOE Six Sigma 1
P Screening DOE: A coming up headache story Quality Tools, Improvement and Analysis 4
P Cyclic Effect Factoring in DOE (Design of Experiments) Quality Tools, Improvement and Analysis 1
Analysing Results after DOE Using Minitab Software 1
Analysis of DOE Results and Model Finalization Using Minitab Software 4
J How to Estimate the Number of Replicates on a DOE (Design of Experiments) Six Sigma 5
R 4 Factors 3 Level DOE to determine which factors are significant Using Minitab Software 2
K Minitab Lack-of-Fit Test in DOE (Design of Experiments) Using Minitab Software 4
Injection Moulding Minitab DOE - All P Values are 0 Using Minitab Software 7
G Setting up a 3 Factor, 2 Level,2 response DOE in Minitab Using Minitab Software 7
Z A DOE in Minitab - 3 factors and 3 levels for each factor Using Minitab Software 12
M Taguchi L4 Orthogonal Array Design of Experiments (DOE) in an Excel spreadsheet Excel .xls Spreadsheet Templates and Tools 3
Linking the FMEA Causes & Action Plan with DOE Experiments or Experimentation Design FMEA and Control Plans 1
B DOE Question: 3 factors with 2 levels and 1 factor with 3 levels Six Sigma 2
Z Help with running 3 factor DOE factor optimization Using Minitab Software 2
H Minitab DOE Analysis of Data and Transforming Using Minitab Software 4
Help Setting Up and Analyzing 3 Factor 2 Level Full Factorial Design for DOE Using Minitab Software 3
B Taguchi DOE (Design of Experiments) example using Minitab Using Minitab Software 3
C 3 Factor DOE (Design of Experiments) Template Document Control Systems, Procedures, Forms and Templates 0
How to analyze DOE: 2 Factor, 4 Level Experiment Six Sigma 7
J DOE Analysis Experiment, 5 factors, 4 factors having 3 levels, and 1 factor having 5 Using Minitab Software 38
B Analyze 'Factorial Design' or 'Variability' - Difference when used for DOE Analysis? Using Minitab Software 1
L DOE (Design of Experiments) suggestions Using Minitab Software 7
L DOE (Design of Experiments) - Analyse Variation with Minitab Using Minitab Software 5
E 5^2 DOE (Design of Experiments) with 3 Replications, 5 Levels 2 Factors Statistical Analysis Tools, Techniques and SPC 6
T DOE Multi level Taguchi - I am doing a Capstone Project Using Minitab Software 10
R To Find Out Second Order Model from First Order Factorial Design (DOE) Using Minitab Software 9
B Which type of DOE was likely used for this transfer function? Six Sigma 4
Taguchi DOE Analysis - What S/N ratio (Nominal is best or smaller is better) to use? Quality Tools, Improvement and Analysis 5