Process Stability & Sampling - Can Sampling detect an Unstable Process?

P

philip1985

#1
Hi all!

My first post on the forum. Nice to meet you!

Anyway, I am in the manufacturing industry for medical products, and would like to seek clarification on a few issues.

Firstly, regarding new production introduction, the management has tasked me to do 100% inspection on finished goods, the reason being that the process is unstable and they told me that only in a stable process can I resort to sampling. By the way, our company is currently using the ANSI/ASQ Z1.4-2008 Level I at AQL of 0.65%. I always thought that the inspection should be independent of the process stability. In fact, if the process is so unstable, I should be able to pick it out via sampling. Therefore, this criteria of having a stable process before I can use such sampling tools boggles me. Clarification is really welcome here.

Secondly, Level I samping seems to be abit lax here, I hear that most industries are currently using at least Level II sampling standard. Moreover, I am in the medical manufacturing industry. Any input will be great!

Lastly, on a specific note, let's say I want to find out the confidence level I have if I find no defects on a size 50 sample from a daily batch of 250 units. How do I go about it? AQL is at 0.65% as well.

Thanks alot for any help! Really appreciated!
 
Elsmar Forum Sponsor

Steve Prevette

Deming Disciple
Staff member
Super Moderator
#3
Hi all!

Firstly, regarding new production introduction, the management has tasked me to do 100% inspection on finished goods, the reason being that the process is unstable and they told me that only in a stable process can I resort to sampling. By the way, our company is currently using the ANSI/ASQ Z1.4-2008 Level I at AQL of 0.65%. I always thought that the inspection should be independent of the process stability. In fact, if the process is so unstable, I should be able to pick it out via sampling. Therefore, this criteria of having a stable process before I can use such sampling tools boggles me. Clarification is really welcome here.

Thanks alot for any help! Really appreciated!
If a process is unstable, you increase the risk that a short term fluctuation won't be detected since you aren't measuring and plotting every result.

There are some criteria for increased sampling frequency and decreased sampling frequency in the standard. However, I'd suggest shifting temporarily to a 100% sampling for 25 to 50 sequential product, and plotting that on a control chart to see if it is in control or not. If in control, I'd suggest starting random sampling and also plot the results on a control chart to detect subtle shifts across several sequential results. If not in control, work on getting the product in control, using future updates of the control chart to help you.
 

Jim Wynne

Staff member
Admin
#4
Hi all!

My first post on the forum. Nice to meet you!

Anyway, I am in the manufacturing industry for medical products, and would like to seek clarification on a few issues.

Firstly, regarding new production introduction, the management has tasked me to do 100% inspection on finished goods, the reason being that the process is unstable and they told me that only in a stable process can I resort to sampling. By the way, our company is currently using the ANSI/ASQ Z1.4-2008 Level I at AQL of 0.65%. I always thought that the inspection should be independent of the process stability. In fact, if the process is so unstable, I should be able to pick it out via sampling. Therefore, this criteria of having a stable process before I can use such sampling tools boggles me. Clarification is really welcome here.

Secondly, Level I samping seems to be abit lax here, I hear that most industries are currently using at least Level II sampling standard. Moreover, I am in the medical manufacturing industry. Any input will be great!

Lastly, on a specific note, let's say I want to find out the confidence level I have if I find no defects on a size 50 sample from a daily batch of 250 units. How do I go about it? AQL is at 0.65% as well.

Thanks alot for any help! Really appreciated!
In addition to Steve's response, "unstable" doesn't necessarily mean that some parts are nonconforming. In this context, "unstable" refers to statistical stability. It's possible to have a process that's out of statistical control but still producing conforming product.
 

Tim Folkerts

Super Moderator
#5
Lastly, on a specific note, let's say I want to find out the confidence level I have if I find no defects on a size 50 sample from a daily batch of 250 units. How do I go about it? AQL is at 0.65% as well.
You might read through this thread: elsmar.com/Forums/showthread.php?t=33830
I think it will have the info you want about confidence levels.
 

Steve Prevette

Deming Disciple
Staff member
Super Moderator
#6
The binomial function in Excel spreadsheet may be used to answer the question.

The confidence level basically is the 100% minus the probability of getting the result. But I need to state it about a defect rate. I'll use your AQL in this example.

What is the probability of getting 0 defects out of 50 if the chance of a defect were 0.65%?

=BINOMDIST(0,50,0.0065,TRUE)
which equals 0.72

So, I am only 28% confident that the defect rate is 0.65% or less.
 
P

philip1985

#7
Thanks all for the prompt and detailed replies!

Something I forgot to mention, is that I am doing an attribute inspection, meaning that units are either pass or fail on a certain attribute. Does that change anything?

Thanks once again!
 

Statistical Steven

Statistician
Staff member
Super Moderator
#8
What is the probability of getting 0 defects out of 50 if the chance of a defect were 0.65%?

=BINOMDIST(0,50,0.0065,TRUE)
which equals 0.72

So, I am only 28% confident that the defect rate is 0.65% or less.
Just to add here....if you observe 0 defects in a sample of 50, you have only a 27% probability of sampling from a population whose percent defective of 0.65%. It would take a sample size of 458 to have 95% confidence.
 

bobdoering

Stop X-bar/R Madness!!
Trusted Information Resource
#9
What can be detected has a lot to do with nature of the instability. Intermittent versus systemic have two different probabilities of being caught. Also has a lot to do with the homogeneity of the material.
 
P

philip1985

#10
The binomial function in Excel spreadsheet may be used to answer the question.

The confidence level basically is the 100% minus the probability of getting the result. But I need to state it about a defect rate. I'll use your AQL in this example.

What is the probability of getting 0 defects out of 50 if the chance of a defect were 0.65%?

=BINOMDIST(0,50,0.0065,TRUE)
which equals 0.72

So, I am only 28% confident that the defect rate is 0.65% or less.
Thanks!

Using the same formula, if I asked myself what the probability was of getting 0 defects out of 20 if the chance of a defect were 0.65%,

=BINOMDIST(0,20,0.0065,TRUE) = 0.88

which means that I am only 12% confident that the defect rate is 0.65% or less.

If that is the case, why are we using such low sampling numbers if the confidence levels are so low? Can someone enlighten me? I feel like I am missing something critical here...
 
Thread starter Similar threads Forum Replies Date
B How to Demonstrate Stability and Repeatability in very Short Run Process AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 10
L Stability of the Process vs Improvement during Auditing General Auditing Discussions 8
N Evaluating Process Stability - Unstable Processes - Cpk/Ppk? Capability, Accuracy and Stability - Processes, Machines, etc. 6
S What are Process Capability and Process Stability? Statistical Analysis Tools, Techniques and SPC 2
A Multiple Process Streams - How to check the stability of the process QS-9000 - American Automotive Manufacturers Standard 3
J Need Help with FPY Data in Assembly Process Manufacturing and Related Processes 7
A When someone refuses to follow a process.... Misc. Quality Assurance and Business Systems Related Topics 21
E Software maintenance Process Software maintenance Process to IEC 6204? IEC 62304 - Medical Device Software Life Cycle Processes 3
R AS5553 Clause 3.1.7 f - "Implement a returns process....." AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 5
normhowe "The Problem with Quality Management: Process orientation, controllability and zero-defect processes as modern myths" Book, Video, Blog and Web Site Reviews and Recommendations 2
Judy Abbott General temperature used in the blasting process and laser process Manufacturing and Related Processes 2
B SOP for CNC turret punching machine for sheet metal process Manufacturing and Related Processes 0
A API Monogram audit review process Oil and Gas Industry Standards and Regulations 4
R AS9102 FAI Change in Material / Process Supplier AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 4
A Process mapping Process Maps, Process Mapping and Turtle Diagrams 1
R MDEL Process Canada Medical Device Regulations 4
optomist1 Rates Daily or Hourly Process Improvement Training Consultants and Consulting 2
S Manufacturing Process FDA FOIA Medical Device and FDA Regulations and Standards News 3
S Manufacturing Process FDA FOIA US Food and Drug Administration (FDA) 4
B Toyota PPAP Process - Three Questions APQP and PPAP 3
R Changes vs CMO - How can we simplify this process? Supplier Quality Assurance and other Supplier Issues 3
A Ethics Committee Review Process for IVD Products EU Medical Device Regulations 2
V Laser Welding Process - Impact on Electrical Properties Reliability Analysis - Predictions, Testing and Standards 4
Q Process: Knowledge Section 7.1.6 of ISO 9001:2015 ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 10
L Documented Information in Internal Audits Process (9.2) ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 4
A Sampling plan for in-process QC (medical devices) Inspection, Prints (Drawings), Testing, Sampling and Related Topics 13
R MRB (Material Review Board) Process using MS Sharepoint or MS Teams Manufacturing and Related Processes 2
M Clinical Benefit of device that only aids in a process for managing or treating disease EU Medical Device Regulations 2
C In-process inspection - Tooling and assembly lines for automotive companies AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 6
M Efficacy of an IT process after a cyber attack ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 2
N Sterilization Protocol Change in Validation Process and further impacts ISO 13485:2016 - Medical Device Quality Management Systems 1
N Riveting - special process Manufacturing and Related Processes 11
M Material incoming to the production process reflected in PFMEA FMEA and Control Plans 9
A API Spec Q1 Purchasing Process - Supplier Reevaluation based on Supplier Risks 5.6.1.4 Oil and Gas Industry Standards and Regulations 17
B Handling lower detection limits for SPC and process performance Statistical Analysis Tools, Techniques and SPC 1
D Measurables for Plastic Injection molding process Manufacturing and Related Processes 1
S Cleaning process center change ISO 13485:2016 - Medical Device Quality Management Systems 4
Z Rapid audit template for plastic parts manufacturing process Manufacturing and Related Processes 12
R Inspection and Work order process Inspection, Prints (Drawings), Testing, Sampling and Related Topics 9
T ISO 13485:2016 Clauses related to process matrix ISO 13485:2016 - Medical Device Quality Management Systems 3
A How to reduce the process SPC monitoring Capability, Accuracy and Stability - Processes, Machines, etc. 3
John Predmore Configuration Management as a process instead of a procedure AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 10
R PCBA process validation Qualification and Validation (including 21 CFR Part 11) 2
U Internal Auditor not trained but done Audit for some process Nonconformance and Corrective Action 5
B Two excellent examples of process capability analysis from Quality Magazine Capability, Accuracy and Stability - Processes, Machines, etc. 5
D ECO (Engineering Change Order) process questions ISO 13485:2016 - Medical Device Quality Management Systems 7
S Sterilization validation after changing sterilization process provider Qualification and Validation (including 21 CFR Part 11) 3
Pau Calvo Quality Management process is mandatory in ISO9001? ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 10
Tagin Template or Checklist for Process Change Document Control Systems, Procedures, Forms and Templates 5
LostLouie Manufacturer divorced from Design process, is he justified in design process deficiencies? ISO 13485:2016 - Medical Device Quality Management Systems 9

Similar threads

Top Bottom