Validation Testing - How many unit should I test prior to launch?

A

Amouchicou

#1
Hi,
hope someone can help because we've been trying to solve that for a long time.

Problem: We are launching a new product. The question is: how many of those should we test to ensure that x% of the product will have no failure within the warranty period (5 years). Forecast are a 1000 unit per year will be sold. A 95% confidence level would be appropriate.

We've try to use statistical tool, but we don't know what test or hypothesis would be appropriate. Also, it's a new product with a new process involved and we don't have any historical data.

Usually, we're not testing any, because the process is always the same and our product development tools are good enough to ensure quality at launch.... but for this one, my confidence level is not good and I would like to rely on statistical tools not only on workers experience and actual tools.

Thanks!!!
 
Elsmar Forum Sponsor

Tim Folkerts

Super Moderator
#3
Re: How many unit should I test prior to launch?

This sounds like a classic reliability engineering question - and there are various standard methodologies.

You can test the parts on an accelerated schedule. For example, if a door will be opened on average 10 times a day for 300 days per year for 5 years, that is 15,000 openings. So you could get a test rig to open and close the door every other second for about 8 hr and get the same number of openings and closing. So in a couple days you could get some pretty good data on the reliability of the door's behavior for 5 years of actual use.

You can also test parts in extreme conditions. For example, suppose you have light bulbs designed for 120 V. If you run them at 200 V they will fail quickly - perhaps in a few minutes. Run them at 180 V and they will last longer - perhaps a few hours. At 160 V they might last a few days. With an appropriate model, you should be able to reasonably well predict how long they would last at 120 V.

Read up a bit on reliability engineering - that might give you some ideas. http://www.weibull.com/ is a pretty good site for an overview. Or it you have more specific questions ... fire away and hopefully you will get some more answers here.

Tim
 
A

Amouchicou

#4
Thanks Tim,
I've been reading on reliability for the next few days and the problem is always the same: I don't have any data because we are not producing enough prototype.

It's a money issue; prototype are expensive. In this particular case we will produce 4 prototype. If I test those 4 with accelerated method, how sure I am that product in the field will not fail? I would like to come up with a mathematical way to see if I have 98% or 30% of the chance that any will fail during the warranty? In fact, my goal is to prove that we need more prototype and more testing to be confident enough to launch the product, but right now I have nothing to negotiate with management.

We will sell about 1000 per year.

Thanks again!!
 
Thread starter Similar threads Forum Replies Date
S High voltage testing - ISO 17025 - 7.2.2 Validation of methods and 7.3 Sampling ISO 17025 related Discussions 3
M Production approval testing - Alternative ideas for Validation Reliability Analysis - Predictions, Testing and Standards 4
W ASTM F1929 dye penetration test - Validation for in-house testing ISO 13485:2016 - Medical Device Quality Management Systems 16
H EO Sterilization Validation - Sterility Testing and Load Configuration Other Medical Device Related Standards 1
S Is Human Factor Testing required as part of Design Control Validation? 21 CFR Part 820 - US FDA Quality System Regulations (QSR) 3
I Quality of Potable Water Testing Parameters during Purified Water Validation Qualification and Validation (including 21 CFR Part 11) 1
Sam Lazzara Lot Release Testing versus Process Validation Studies Qualification and Validation (including 21 CFR Part 11) 9
M Manufacturing Process Validation Destructive Testing Sampling Plan Advice Inspection, Prints (Drawings), Testing, Sampling and Related Topics 1
E Validation of Method(s) in Testing Laboratories General Measurement Device and Calibration Topics 9
optomist1 Typical Wire Harness Testing and Validation Testing for Automotive Applications Reliability Analysis - Predictions, Testing and Standards 8
T Is Testing Equipment Re-Validation required if the Test Equipment is Relocated? 21 CFR Part 820 - US FDA Quality System Regulations (QSR) 5
U Example: Difference between System Testing and Validation Design and Development of Products and Processes 8
M Application of Special Process - Validation and FAI in Wind Tunnel Testing AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 3
A Does the V&V (Verification and Validation) belong to Bench Testing for 510k? Qualification and Validation (including 21 CFR Part 11) 2
B Sample Sizes for In-Vivo Design Validation Testing Other Medical Device and Orthopedic Related Topics 1
T Where should Validation and/or Testing Report to? Engineering? Quality? Quality Manager and Management Related Issues 3
M V&V (Verification and Validation) Medical Device Unit Testing ISO 13485:2016 - Medical Device Quality Management Systems 4
Q Process Impact Validation Testing - Polishing process Capability, Accuracy and Stability - Processes, Machines, etc. 2
B Packaging Validation - Storage Distribution Testing Qualification and Validation (including 21 CFR Part 11) 4
D Sterility (bacteriostasis/fungistasis) Testing by Membrane Filtration validation Pharmaceuticals (21 CFR Part 210, 21 CFR Part 211 and related Regulations) 2
R Validation of Stability Testing for Sutures Capability, Accuracy and Stability - Processes, Machines, etc. 3
T What is required for APQP step 4.5 Production Validation Testing APQP and PPAP 2
A Calibration Software Validation - Are there any Testing Tools available? Calibration and Metrology Software and Hardware 8
Y SaMD Verification and Validation SOP and Plan IEC 62304 - Medical Device Software Life Cycle Processes 2
C Spreadsheet Validation and Release Qualification and Validation (including 21 CFR Part 11) 2
M Packing Validation & Accelerated Aging Test ISO 13485:2016 - Medical Device Quality Management Systems 2
M Sterile packing validation tests to be performed and protocol Other Medical Device and Orthopedic Related Topics 1
S OEM full range calibrations vs Validation special test points Medical Device and FDA Regulations and Standards News 0
H Software Validation for FFS Packaging Machine Qualification and Validation (including 21 CFR Part 11) 1
Q ISO 13485 7.5.6 Validation - Off the shelf Software ISO 13485:2016 - Medical Device Quality Management Systems 3
M ERP / QMS related software standards for Validation IEC 62304 - Medical Device Software Life Cycle Processes 6
C ISO 19227 Validation Cost Other Medical Device Related Standards 2
A CNC Mill and Lathe - Validation Manufacturing and Related Processes 2
N Example for design and development planning,input,output,review,verification,validation and transfer Misc. Quality Assurance and Business Systems Related Topics 4
N Sterilization Protocol Change in Validation Process and further impacts ISO 13485:2016 - Medical Device Quality Management Systems 1
B Oracle Cloud ERP Validation during Quarterly Patch ISO 13485:2016 - Medical Device Quality Management Systems 1
D Software validation team Misc. Quality Assurance and Business Systems Related Topics 3
W LTPD, AQL, Ppk and Cpk validation sampling plan table Inspection, Prints (Drawings), Testing, Sampling and Related Topics 0
J Validation Sample Size for Tray Seal Qualification and Validation (including 21 CFR Part 11) 2
F AS9100 - Validation, FAIR's, ITAR and Sub-Contracting AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 3
R PCBA process validation Qualification and Validation (including 21 CFR Part 11) 2
A ISO 17025 - Methods validation and clients ISO 17025 related Discussions 3
S Sterilization validation after changing sterilization process provider Qualification and Validation (including 21 CFR Part 11) 3
B Sterilization Validation Plan Other Medical Device Related Standards 3
D Difference between Test Method Validation and Gage R&R Qualification and Validation (including 21 CFR Part 11) 18
T Laboratory Verification after validation ISO 17025 related Discussions 3
silentmonkey Rationalising the level of effort and depth of software validation based on risk ISO 13485:2016 - Medical Device Quality Management Systems 10
D Questions regarding process validation ISO 13485:2016 - Medical Device Quality Management Systems 6
Y We found out we have been using a equipment without validation for past 4 years Quality Manager and Management Related Issues 6
Z Is IQ necessary for laser marking validation? EU Medical Device Regulations 3

Similar threads

Top Bottom