Is there a standard for sample size during R&D phase

Stefanos Papadakis

Involved In Discussions
#1
Hello eveyrone,

I hope you are all doing well.

I would like to know if there exists a standard/paper/method for calcualing sample size during R&D phase.
I work at product testing and I would like to know how many samples during pilot phase need to be tested.

I am aware of the standards regarding production sample size but it does not work for me.

Thank you in advance
Stefanos
 
Elsmar Forum Sponsor

Jim Wynne

Staff member
Admin
#2
What standard are you working under (ISO 9001, e.g.)? What type of device? What has been your company's practice in the past? There are no standards, as such, that I know of.
 

Stefanos Papadakis

Involved In Discussions
#3
We are working under ISO 9001 and as product testing dpt. we are part of the R&D team. When we test pilot parts we might have from 30 to 300 samples. So what I am asking is, if there exists any good practices or any ASTM, ISO etc. standards referring to sampling.

The tests we are condacting are dimensional tests and properties of the part under various stresses.
 

Jim Wynne

Staff member
Admin
#4
We are working under ISO 9001 and as product testing dpt. we are part of the R&D team. When we test pilot parts we might have from 30 to 300 samples. So what I am asking is, if there exists any good practices or any ASTM, ISO etc. standards referring to sampling.

The tests we are condacting are dimensional tests and properties of the part under various stresses.
You can get an overview of statistical sampling plans here: What kinds of Lot Acceptance Sampling Plans (LASPs) are there? For more details and sampling tables, go here: ASQ/ANSI QUALITY STANDARDS Z1.4 & Z1.9. There is an old military standard, MIL-STD-105E, that I've attached here. While it's been withdrawn, the information and tables are still valid and you might find it useful.

As you might gather, acceptance sampling is a fairly deep subject. It's been discussed a lot here, and you can browse many of the threads here. Feel free to post back with questions.
 

Attachments

mmasiddiqui

Involved In Discussions
#5
Hello eveyrone,

I hope you are all doing well.

I would like to know if there exists a standard/paper/method for calcualing sample size during R&D phase.
I work at product testing and I would like to know how many samples during pilot phase need to be tested.

I am aware of the standards regarding production sample size but it does not work for me.

Thank you in advance
Stefanos
What is the AQL (acceptable quality limit) for your customer?
 

Stefanos Papadakis

Involved In Discussions
#7
You can get an overview of statistical sampling plans here: What kinds of Lot Acceptance Sampling Plans (LASPs) are there? For more details and sampling tables, go here: ASQ/ANSI QUALITY STANDARDS Z1.4 & Z1.9. There is an old military standard, MIL-STD-105E, that I've attached here. While it's been withdrawn, the information and tables are still valid and you might find it useful.

As you might gather, acceptance sampling is a fairly deep subject. It's been discussed a lot here, and you can browse many of the threads here. Feel free to post back with questions.
Thank you for the reply, I will check the threads and the standards you proposed.
Sadly MIL-STD-105 does not work for us.
 

Bev D

Heretical Statistician
Staff member
Super Moderator
#9
First – there are no simple ‘look it up in a table’ answer in the quality or statistical sciences. These are complex topics that require deep understanding and thought…



In design V&V and pilot lot testing acceptance sampling sample plans are not appropriate (most of the time). The reasons for this are:

  • Most of the time people think about the categorical data sample plans which are based on the number of defects or failures. Yet in development we are more interested and much better served to measure continuous data against requirements to ensure that our design has enough margin.
  • Acceptance sampling plans only tell you that you haven’t exceeded some max limit but they don’t tell you how close you are, which again in design the real point.
  • Since most designs require fairly low to non-existent failure or defect rates the sample sizes get really large.
So we are much better off using continuous data and the formulas for estimating averages and standard deviations rather than the acceptance sampling tables. These formulas were intended to estimate actual performance which is the intent of V&V and pilot testing.

Directed testing and testing at the extremes are much more effective and allow much lower sample sizes that are not comprehended at all in acceptance sampling tables…
 

mmasiddiqui

Involved In Discussions
#10
Thank you for your answer but at this phase (pilot phase) we do not have AQL nor customers. Lets say that we are our customers. :)
I agree with you, but I would still like to establish a AQL internally for pilot phase. The other way is to take the lowest AQL of the potential customer who will be using your product.
 
Thread starter Similar threads Forum Replies Date
V Acceptable maximum RSD (relative standard deviation) for an sample size Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 1
A How to calculate Mean and standard deviation without sample size in Minitab Using Minitab Software 5
C 95% CI vs Mean +/- sample standard deviation 21 CFR Part 820 - US FDA Quality System Regulations (QSR) 1
C One sample piece from standard production? AS9102 FAIR questions AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 6
M Sample ISO 27001 and 'PCI Security Standard' Gap Analysis Report Other ISO and International Standards and European Regulations 2
S Calculating Standard Error for a percentage (binary question) from a sample survey Statistical Analysis Tools, Techniques and SPC 1
G Bulk Material Sample Standard Retention APQP and PPAP 2
M FDA News FDA Releases Draft Guidance Clarifying Application of ISO 10993-1 Biocompatibility Standard Medical Device and FDA Regulations and Standards News 0
Y UL 1998 Standard: software classes Software Quality Assurance 0
G What to do with correction factors overlooked by an accredited standard (6.4.11)? ISO 17025 related Discussions 5
G Copy of withdrawn ISO 9001:1994 Quality Management Standard ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 2
Anonymous16-2 SOP (Standard Operating Procedure) Numbering Document Control Systems, Procedures, Forms and Templates 7
Ed Panek Compliance with Standards? When a standard is updated/revised CE Marking (Conformité Européene) / CB Scheme 3
Skooma Deburring and Tolerances - Is there a Standard for deburring or removing material? Manufacturing and Related Processes 3
B Purchasing AS9100D Standard in Japanese AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 2
O In addition to the standard, what other ISO 13485 sources do people recommend? ISO 13485:2016 - Medical Device Quality Management Systems 5
B ASTM E18-2020 - Rockwell testing standard changes? General Measurement Device and Calibration Topics 2
M Informational RoHS Standard - EN 63000:2018 to replace EN 50581:2012 Medical Device and FDA Regulations and Standards News 11
M IEC 60601-1 1988 - Device developed in 2012 with standard of 1988 IEC 60601 - Medical Electrical Equipment Safety Standards Series 2
D Recent changes to ISO 14971 - SOP required for managing standard revisions ISO 13485:2016 - Medical Device Quality Management Systems 1
P Cenelec updated standard information CE Marking (Conformité Européene) / CB Scheme 1
J Standard used to determine if check fixture gauge is acceptable Reliability Analysis - Predictions, Testing and Standards 2
N Program or application for standard time measurement in industry from video surveillance? Human Factors and Ergonomics in Engineering 1
I Where can I beg, steal (just kidding of course) or borrow good training material on the ISO 9001:2015 standard? ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 5
K Question on whether IEC 60601-2-62 standard is applied IEC 60601 - Medical Electrical Equipment Safety Standards Series 4
B Clause 5.1.12 of Technical Standard IEC 62304/A1 IEC 62304 - Medical Device Software Life Cycle Processes 5
M Viable count Measurement ISO Standard Other Medical Device Related Standards 1
I When exactly was "competence" added to the ISO-9001 standard? ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 9
S Managing specification changes on standard parts purchased through trading companies Document Control Systems, Procedures, Forms and Templates 2
MDD_QNA QR Code Standard ISO/IEC 15417:2007 - Does anyone use it? Other Medical Device Related Standards 3
S Average and standard deviation of Cumulative Data Statistical Analysis Tools, Techniques and SPC 5
R Standard Filter for Calibration Colorimeter ISO 17025 related Discussions 1
B Standard for Dielectric Strength Test IEC 60601 - Medical Electrical Equipment Safety Standards Series 3
M Specific Absorption Rate (SAR) Testing - What Standard to Use? Other ISO and International Standards and European Regulations 1
M Harmonised RED Standard ETSI EN 440 - Which Version? Other ISO and International Standards and European Regulations 0
R QMS Standard appilications on different Defense Sector Quality Management System (QMS) Manuals 1
A Supplier Quality Standard vs Senior Management Direction Supplier Quality Assurance and other Supplier Issues 2
B To detect the non standard variable IATF 16949 - Automotive Quality Systems Standard 5
J What is the minimum standard for automotive component traceability? Manufacturing and Related Processes 2
B Need For BIS Standard Mark? Imported OEM's Power supply,Li-Ion Battery Other Medical Device Regulations World-Wide 0
C On spontaneous but non-standard rankings FMEA and Control Plans 3
E Post Market Surveillance Standard Various Other Specifications, Standards, and related Requirements 4
A IEC 60601-2-2 - Defib-proof test amendment to base standard IEC 60601 - Medical Electrical Equipment Safety Standards Series 2
N Is there a standard / rules pertaining to eating in medical device manufacturing area? Manufacturing and Related Processes 5
M Performance Standard for Balloon Trocars Other Medical Device Related Standards 2
D Standard guide for shelf life determination of non sterile component with degradation materials Reliability Analysis - Predictions, Testing and Standards 1
D Using "Particle Size Standard" templates as gauges - How to avoid giving a gauge # while using for process control? General Measurement Device and Calibration Topics 2
S Where to get online AS standard audit certification classes? AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 5
P ISO 10993-1:2018 - When will the European equivalent become a Harmonized Standard? Other Medical Device Related Standards 13
M Informational From AAMI – FDA Recognizes AAMI Standard and TIR Medical Device and FDA Regulations and Standards News 0

Similar threads

Top Bottom