Surveillance Sampling Test - Determining Sample Size

#1
Hei i'm san,

im new in this forum. already read a lot of topic in this forum, but this my first post.

currently i have a bit a problem in my surveillance sampling frequency.

I have a surveillance sampling frequency with 1 PCS PER SIZE every 15.000 PCS PER SIZE production or 1 PCS a Year PER SIZE. This is the old standard and did not have any statistical calculation to explain where the number come from (ISO/TS 16949). Now, i need to find out with the correct way.

Another information is the yearly production is around 9.000.000 PCS a year with random quantity per size (posible 0) and we have about 2.000 unique size. This is destructive test and cost a lot.

I have result data from previous surveillance for each size, but not much, only 5-10 data. But my idea is using as familiy size to get larger data.

The problem is,

What kind of statistical calculation approach to determine the correct surveillance sampling frequency with this case? I'm looking for the direct formulas or method to do.

I hope everyone that have an experience can help.

Thank you.

San.

P.S sorry for bad english.
 
Elsmar Forum Sponsor

Romvill2002

Involved In Discussions
#2
Determining Sample Size-Medical Device

Hello All,

Can you interpret below determination of sample size. What would be the confidence level if 1 out of 10 samples failed?

Sample size of 10 was purposed by test engineers for the verification of the pressure switch and regulator pressure components replacement in FACSCelesta system. There were no historical or pilot data available for sample size estimation prior to the verification study. Therefore by using the vendor specification for pressure switch along with BD internal verification acceptance criteria, the power for the purposed sample size of 10 is estimated to ensure there is sufficient power to meet the test requirement with the following assumptions.
Vendor Pressure switch specification: 10 psi ± 1
BD pressure switch verification criteria: 10 psi ± 5
Assuming the vendor also tested with sample size of 10, with mean center at 10 psi, the largest standard deviation is estimate to be 1.35 .

N Mean StDev SE Mean 95% CI T P
10 10.000 1.350 0.427 (9.034, 10.966) 0.00 1.000

Using theoretical calculated standard deviation of 1.35, the power for the purposed sample size of 10 is estimated to be greater than 99% assuming the difference of the test is at most half of allowable drift (2.5) from the target mean of 10 psi with alpha of .05
Calculating power for mean = null + difference
α = 0.05 Assumed standard deviation = 1.35

Sample
Difference Size Power
2.5 10 0.999308
 

Mike S.

Happy to be Alive
Trusted Information Resource
#3
Hei i'm san,

im new in this forum. already read a lot of topic in this forum, but this my first post.

currently i have a bit a problem in my surveillance sampling frequency.

I have a surveillance sampling frequency with 1 PCS PER SIZE every 15.000 PCS PER SIZE production or 1 PCS a Year PER SIZE. This is the old standard and did not have any statistical calculation to explain where the number come from (ISO/TS 16949). Now, i need to find out with the correct way.

Another information is the yearly production is around 9.000.000 PCS a year with random quantity per size (posible 0) and we have about 2.000 unique size. This is destructive test and cost a lot.

I have result data from previous surveillance for each size, but not much, only 5-10 data. But my idea is using as familiy size to get larger data.

The problem is,

What kind of statistical calculation approach to determine the correct surveillance sampling frequency with this case? I'm looking for the direct formulas or method to do.

I hope everyone that have an experience can help.

Thank you.

San.

P.S sorry for bad english.
As you say, what you are doing now has no statistical basis. You need to think about what you want your sampling to accomplish. Is there a problem you need to solve? Is your customer getting bad parts (how many bad/good?) and you want to prevent that? Do you have any estimate of the process capability now?

I don't think you have given enough information for anyone to give any suggestions.
 
#4
As you say, what you are doing now has no statistical basis. You need to think about what you want your sampling to accomplish. Is there a problem you need to solve? Is your customer getting bad parts (how many bad/good?) and you want to prevent that? Do you have any estimate of the process capability now?

I don't think you have given enough information for anyone to give any suggestions.
Thanks for the feedback.

This sample is final product test to comply with regulation and safety assurance. There is no problem to solve and no customer getting bad part until now. But yes, I need to prevent that.

The regulation didn't state any requirement for sampling. But we need to state by ourself. The sampling approach can be quantity basis or time basis.

All special characteristic in our process manufacturing have Cpk more than 1.33.

This problem is a finding from regulation audit. I already discuss with a lot of people and still didn't get a good answer.

If you need more detail, let me know. Thanks
 

Mike S.

Happy to be Alive
Trusted Information Resource
#5
I don’t know what the exact wording of the finding was, but I will take a guess and say perhaps the requirement was along the lines of “sampling plan must be statistically valid”, etc. but you had no proof of statistical validity.

One way to comply could be to pick a published sampling plan, one that has statistics such as OC curves published along with it, which meets your needs as determined by experts who understand the risks and consequences associated with failure. One option you could consider is to look at C=0 sampling plans published by Nicholas Squeglia (look at ASQ Quality Press for a copy).

I hope this helps at least get you started.
 
Thread starter Similar threads Forum Replies Date
T COVID, Furlough and ISO9001 Surveillance Audit Coffee Break and Water Cooler Discussions 2
Q ISO 9001:2015 man days for surveillance audit ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 11
N Post Market Surveillance Package Example Wanted ISO 13485:2016 - Medical Device Quality Management Systems 1
M Post Market Surveillance for Class II Medical Devices Medical Device and FDA Regulations and Standards News 2
N Program or application for standard time measurement in industry from video surveillance? Human Factors and Ergonomics in Engineering 1
H Post-market surveillance strategy EU Medical Device Regulations 1
classical_quality AS9100 Surveillance Audit - advice on drafting strong responses AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 11
B Procedures for Complaint Handling and Post Market Surveillance EU Medical Device Regulations 7
E Received a Major finding during IATF Surveillance audit for loss of BIQS Level 3 (more than 6 SPPS in 6 months)...how should we address SYSTEMIC CA? IATF 16949 - Automotive Quality Systems Standard 11
M Informational Creating a post market surveillance (PMS) system for medical devices – Part 1 Medical Device and FDA Regulations and Standards News 7
E Post Market Surveillance Standard Various Other Specifications, Standards, and related Requirements 4
M Informational Paper on open access – EU postmarket surveillance plans for medical devices Medical Device and FDA Regulations and Standards News 1
T Post-Market Surveillance Plan - Requirements outlined in Annex III (1.1b) EU Medical Device Regulations 2
Y Post Market Surveillance Indicators and Analysis method EU Medical Device Regulations 1
M Post Market Surveillance Plan Template EU Medical Device Regulations 6
F Vietnamese Post-Market Surveillance Requirements for a medical device in Japan Other Medical Device Regulations World-Wide 0
S Post Market Surveillance and Annual Product Review in ISO 13485 ISO 13485:2016 - Medical Device Quality Management Systems 2
M Informational EU Review and assessment of market surveillance activities 2014-2016 – Medical devices sector Medical Device and FDA Regulations and Standards News 0
F API Spec Q1 9th Edition Surveillance Audit - Questions about internal audits. Oil and Gas Industry Standards and Regulations 23
M Medical Device News Joint Action On Market Surveillance Of Medical Devices (JAMS) Releases Progress Update EU Medical Device Regulations 0
supadrai Auditing Organization dragging their heels on issuing our MDSAP Surveillance Audit Confirmation Letter - everyone is nervous ... are we the only ones? Canada Medical Device Regulations 7
M Medical Device News Health Canada Notice of intent: Strengthening the post-market surveillance and risk management Canada Medical Device Regulations 1
M Medical Device News EU - List of national market surveillance authorities by sector and country EU Medical Device Regulations 0
Y Time gap for First Surveillance Audit of AS9100D after initial certification AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 13
D IATF 16949 surveillance audit frequency IATF 16949 - Automotive Quality Systems Standard 16
SK13485 Do you have a Medical Device PostMarket Surveillance Plan? EU Medical Device Regulations 11
W Surveillance report along side an NCR program Nonconformance and Corrective Action 2
Q Surveillance Audit of 2008 before Transition Audit to ISO 9001:2015 ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 20
K EU MDR - PMS (Post Market Surveillance) SOP - definition of "register(s)" EU Medical Device Regulations 2
S An auditor asked for a Post Market Surveillance Report ISO 14971 - Medical Device Risk Management 4
T Proactive / Preventive Post Market Surveillance question ISO 13485:2016 - Medical Device Quality Management Systems 4
M ISO TR 20416 Medical Devices - Post-Market Surveillance for Manufacturers Other Medical Device Related Standards 6
S Merging Post Market Surveillance and Complaint Handling ISO 13485:2016 - Medical Device Quality Management Systems 3
shimonv FDA guidance on Postmarket Surveillance Other US Medical Device Regulations 1
C ISO 9001:2008 Surveillance Audit - No Internal Audits Internal Auditing 9
S Post Market Surveillance procedure/ SOP Medical devices Imported Legacy Blogs 0
J0anne Effects of Strengthened Surveillance of Notified Bodies in 2015 EU Medical Device Regulations 1
A Industry best practice about Post-Market Surveillance and Risk Analysis ISO 14971 - Medical Device Risk Management 6
S Korean Post Market Surveillance and Recall Regulations Other Medical Device Regulations World-Wide 3
M Presence of Authorized Representative during Surveillance Audit EU Medical Device Regulations 1
S Advanced Surveillance and Recertification Procedures - being discontinued by the IAF December 2019 update ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 5
S What are the implications of a major NC during a TS 16949 surveillance audit? IATF 16949 - Automotive Quality Systems Standard 3
D What is your Post-Market Surveillance Strategy 21 CFR Part 820 - US FDA Quality System Regulations (QSR) 1
S Understanding PMS (Post Market Surveillance) and PMCF (Vigilance and PMCF) Quality Manager and Management Related Issues 1
P Audit Design Process every Surveillance Audit - AS9104 Requirement? AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 9
Z When to stop Post Market Surveillance 21 CFR Part 820 - US FDA Quality System Regulations (QSR) 3
I CB Scheduling ISO9001 Surveillance Audit 15 Months past Re-Cert Audit ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 8
R External Audit Attendees - Surveillance Audit Quality Manager and Management Related Issues 27
T Quality Objective related Surveillance Audit Finding IATF 16949 - Automotive Quality Systems Standard 6
D Need to include Premise of Outsourced Call Center in ISMS Surveillance Audit? IEC 27001 - Information Security Management Systems (ISMS) 4

Similar threads

Top Bottom