How to sample in a real time release process?

I

IHaveNoSpaceBar

Regards all,

I am having a hard time with creating a quality inspection plan for a medical device that involves several high volume continuous process steps(cells) working in series. Essentially cell 1 feeds product into cell 2, 3, ... etc, all the way to the final step of packaging the finished good.

Customer does not have any requirements for lot sizes, but they have a fairly large amount of required CQAs. Not all CQAs are inspected automatically on the line (by machine) - about 10% of CQAs (dimension and attribute) require manual human inspections, some of which have very stringent AQL requirements (very high sample sizes is also a concern).

My main challenge is that with a continuous production cycle I don't really have any set production batch sizes - product is simply going down the conveyor to the next production step on continuous 24/7 basis.

I want to avoid doing all testing at the final step (packaging) because if we find a defect from the early steps (such as cell 1) this means that I will have to reject and possibly scrap the entire lot.

The customer expects us to release/ship product on daily basis (multiple shipments per day). I am extremely concerned with the large amount of paper work involved (medical) and can already see this as a large burden on the shop floor employees for having to create and close shop orders & device history records on daily basis. I see this as a paradox - customer wants frequent shipments but internally, we want to minimize DHR open/closure activities. There is over 40 machines that will each have a separate DHR!!!

Does anyone have any experience or recommendations regarding how to perform real time release in a high volume? I understand that this fairly new for the FDA and not much guidance material is available on this topic from what I have searched. I have seen continuous production inspection plans but they don't seem to be very popular in the medical industry - not sure if due to risk or what gives?

I have read that one approach is SPC for all critical parameters - but is that really sufficient from a regulatory perspective? I find myself having a hard time convincing the customer in performing SPC in lieu of product testing.

Sorry for the long winded topic - I am very thankful for any responses or ideas on how to proceed. Looking forward to hearing from anyone.
 

Steve Prevette

Deming Disciple
Leader
Super Moderator
I would suggest that no one does SPC "instead of sampling". You've still got to have some measurement system to collect the data.

If you can decide on a rate of sampling you want (say each item should have a 5% chance of being inspected) then you could establish some sort of random number generator that as a completed item passes the inspection station, the equivalent of dice are rolled, and if the result is in a certain range, you inspect it.
 

Statistical Steven

Statistician
Leader
Super Moderator
Regards all,

I am having a hard time with creating a quality inspection plan for a medical device that involves several high volume continuous process steps(cells) working in series. Essentially cell 1 feeds product into cell 2, 3, ... etc, all the way to the final step of packaging the finished good.

Customer does not have any requirements for lot sizes, but they have a fairly large amount of required CQAs. Not all CQAs are inspected automatically on the line (by machine) - about 10% of CQAs (dimension and attribute) require manual human inspections, some of which have very stringent AQL requirements (very high sample sizes is also a concern).

My main challenge is that with a continuous production cycle I don't really have any set production batch sizes - product is simply going down the conveyor to the next production step on continuous 24/7 basis.

I want to avoid doing all testing at the final step (packaging) because if we find a defect from the early steps (such as cell 1) this means that I will have to reject and possibly scrap the entire lot.

The customer expects us to release/ship product on daily basis (multiple shipments per day). I am extremely concerned with the large amount of paper work involved (medical) and can already see this as a large burden on the shop floor employees for having to create and close shop orders & device history records on daily basis. I see this as a paradox - customer wants frequent shipments but internally, we want to minimize DHR open/closure activities. There is over 40 machines that will each have a separate DHR!!!

Does anyone have any experience or recommendations regarding how to perform real time release in a high volume? I understand that this fairly new for the FDA and not much guidance material is available on this topic from what I have searched. I have seen continuous production inspection plans but they don't seem to be very popular in the medical industry - not sure if due to risk or what gives?

I have read that one approach is SPC for all critical parameters - but is that really sufficient from a regulatory perspective? I find myself having a hard time convincing the customer in performing SPC in lieu of product testing.

Sorry for the long winded topic - I am very thankful for any responses or ideas on how to proceed. Looking forward to hearing from anyone.

SPC in a FDA regulated industry solves one problem while creating many additional issues. I steer clear of SPC in FDA regulated processes because of an in spec out of control or out of control in spec process. The prevailing guidance from the FDA is that the manufacturer defines a batch for continuous manufacturing processes. Can be based on time (shift), number of units, etc. What complicates your DHR is the number of parent/child relationships that can be present in the process. I would suggest you flow out the process and determine natural places where you can sample. Increase sample size and decrease sample frequency at those places to get a good balance between AQL and LQ. I would define a batch as the product manufactured between sampling points. Of course, these are just suggestions based on the limited information you provided.
 

Mike S.

Happy to be Alive
Trusted Information Resource
I would suggest that no one does SPC "instead of sampling".

Maybe not in the medical device world.

"The purpose of (SAE) ARP9013/4 is to ensure conformance for each product characteristic beingverified under these methods. ARP9013/4 provides the requirements for continuous sampling, skip-lot sampling, and for statistical methods for product acceptance that do not derive from industry standard tables."
 
T

Tony_C

I am new to this forum and I am not sure this discussion is still active, but I offer the following.

- Sampling plans which require a choice of AQL actually have the underlying assumption that there is a continuous process in operation 24/7, and that from time to time a lot is withdrawn from the process and submitted for inspection. From these lots, a sample is drawn, and based upon the "Acceptable Quality Level" and the sample size, an acceptable number of nonconformances is given. (perhaps c=0 for smaller sample sizes) - and a level is given for rejection (perhaps 1 for small sample sizes).

- In addition to the "AQL", there is inherently a "LTPD" (Lot tolerance percent defective). The sampling plan will accept lots submitted for inspection which contain defect rates at the AQL with high probability - say 95%. The same sampling plan will only accept the lot with say 10% probability when the defect rate is at the LTPD. In this way, the sampling plan is actually a control chart (without the chart) which uses the binomial distribution as the underlying mathematics (p-Chart). i.e. the sampling plan accepts the process operating at the AQL defect rate but will reject when the process deteriorates to the LTPD rate.

- Most organizations would like to put blinders on because they can not convince themselves that there is any defect level which is acceptable. Mathematically, the process producing zero defects requires 100% inspection - but given the many types of human and inspection errors, Joseph Juran and others say that 100% inspection is only 80% effective.

- A more practical approach is to adjust the sample size so that "c" is always equal to zero, and the lot will be rejected upon 1 nonconformance. Ignorance can be bliss, and these plans avoid the unpleasant situation of dealing with nonconformances in inspection which come from "normally" operating processes. These c=0 sampling plans are usually based upon the hypergeometric distribution and so not assume that there is a continuous process running in the background 24/7.

Hope that helps
 
Thread starter Similar threads Forum Replies Date
T Human Factors and Usability Testing in the US - smaller sample size than the required 15 users Human Factors and Ergonomics in Engineering 2
D Contract Review Evidence/ Sample for API Monogram Licensing Oil and Gas Industry Standards and Regulations 9
D Risk Based Sample Size and Standards Compliance ISO 14971 - Medical Device Risk Management 2
Z Design verification test sample size under the scope of first in human study submission in Europe Medical Device and FDA Regulations and Standards News 3
T Mandatory requirements for design verification sample 21 CFR Part 820 - US FDA Quality System Regulations (QSR) 11
B Sample Size vs Number of Measurements Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 9
T Attribute MSA-AIAG 4th How to calculate sample size IATF 16949 - Automotive Quality Systems Standard 12
H A question about Null Hypothesis for 1 Sample T-test Statistical Analysis Tools, Techniques and SPC 6
A Sample size selection for process validation - continuous data Reliability Analysis - Predictions, Testing and Standards 9
L PQ Sample Size across multiple lots Inspection, Prints (Drawings), Testing, Sampling and Related Topics 3
S Sample size considerations in medical process qualification Reliability Analysis - Predictions, Testing and Standards 11
H How to calculate sample size and sample frequency Statistical Analysis Tools, Techniques and SPC 2
K Sample size calculation for the medical device with multiple indications. e.g. suture US Food and Drug Administration (FDA) 3
R 18 different charts? 18 sample points over 28 days Capability, Accuracy and Stability - Processes, Machines, etc. 13
V Sample Size rationale to reduce size and use special levels EU Medical Device Regulations 6
C Sample qualification to be IEC 60601-1 series tested IEC 60601 - Medical Electrical Equipment Safety Standards Series 2
Y DFMEA Sample in Semiconductor FMEA and Control Plans 2
T Cease Production Sample Procedure Manufacturing and Related Processes 1
Q Gage Pin Sets? Calibrate/Verify them all or just a sample size? General Measurement Device and Calibration Topics 22
Quality Runner Continuous monitoring of validated process – sample sizes 21 CFR Part 820 - US FDA Quality System Regulations (QSR) 3
S How to determine sample size to test when the acceptance criteria is x >= Standard value? 21 CFR Part 820 - US FDA Quality System Regulations (QSR) 7
I Mixing tank sample points Qualification and Validation (including 21 CFR Part 11) 4
T Sample size calculation Using Minitab Software 3
C What Theory is MIL-STD-105E Sample Size Code Letters Based on? Quality Tools, Improvement and Analysis 3
Stefan Mundt AS9100D Engineering sample purchases - Supplier not approved AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 3
U Determining population defect rate from sample defect rate Inspection, Prints (Drawings), Testing, Sampling and Related Topics 4
D Locking Control Limits and SPC Sample Sizes (AIAG/Automotive Requirements) Six Sigma 3
Y FMEA link to Control Plan frequency and sample size FMEA and Control Plans 20
T Noob question regarding sample size Inspection, Prints (Drawings), Testing, Sampling and Related Topics 4
S Help needed in choosing the method of calculating the minimum sample size Internal Auditing 12
P Worst case HLD sample for efficacy studies Other US Medical Device Regulations 0
D Estimate Sample Size for very rare event Using Minitab Software 1
M Summative evaluation: how many sample per participant? IEC 62366 - Medical Device Usability Engineering 5
S Determining Sample Size and Method Quality Tools, Improvement and Analysis 12
C Complaint Return Sample Size Question 21 CFR Part 820 - US FDA Quality System Regulations (QSR) 4
shimonv Frequency and sample size for lot release of EtO sterilized products EU Medical Device Regulations 2
X Sample SOC2 audit report (or a redacted one) IEC 27001 - Information Security Management Systems (ISMS) 0
A Clinical assessment sample size - Medical device Class IIb implantable (93/42 directive) EU Medical Device Regulations 2
M Sample record for verification performed by importers before placing a device on the market EU Medical Device Regulations 0
P Sample Size for Distribution Simulation Testing Inspection, Prints (Drawings), Testing, Sampling and Related Topics 11
E Any sample of a full software life cycle IEC 62304 report ( any class )? IEC 62304 - Medical Device Software Life Cycle Processes 4
G Where to buy Template / sample SCSMS Manual, checklist Supply Chain Security Management Systems 1
C Stress / Challenge Conditions for Design Verification Testing to Reduce Sample Size 21 CFR Part 820 - US FDA Quality System Regulations (QSR) 11
K How can Acceptance Number and Reject Number be larger than Sample Size on Z1.4 Table? Inspection, Prints (Drawings), Testing, Sampling and Related Topics 8
P MSA - what exactly mean "system" and master sample Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 2
J Validation Sample Size for Tray Seal Qualification and Validation (including 21 CFR Part 11) 4
D Design Verification Sample Size vs Repeats Statistical Analysis Tools, Techniques and SPC 9
S Determining sample sizes for PQ Qualification and Validation (including 21 CFR Part 11) 4
M Minimum sample size - Guidance and statistical rationale Inspection, Prints (Drawings), Testing, Sampling and Related Topics 3
L Sample Procedure from Contract Manufacturer Prospective ISO 14971 - Medical Device Risk Management 1

Similar threads

Top Bottom