Sample Size justification for IEC 60601-1 Testing

Q

QualityVic

#1
My company sends one device for 60601 testing. Our "user need" is that the device must be safe and we use the 60601 testing results to validate this.

In terms of the FDA, all design verification and validation activities must include sample sizes that were determined using some statistical method (i.e. binomial sampling plan). In some guidance, we found that if a statistically significant sample size in not possible, one should provide a scientific rationale to support the number of samples tested in the test summary and protocol.

What I am asking is, how do other companies handle this? My experience is that usually one or two samples are sent for 60601 testing, which is not a statistically significant sample. Do we have to go clause by clause of the standard justifying with science why a sample size of more than one is not necessary?
 
Elsmar Forum Sponsor
Q

QualityVic

#2
Would another approach be to remove the 60601 requirement from design validation/verification and somehow validate safety through a subset of 60601 tests which can be done in-house (dielectric strength and ground continuity)? We'd still do the 60601 testing to be certified.

Or could we say to validate the safety, the device must be certified to be 60601 compliant, where the lab requires only one or two samples be provided?
 

Peter Selvey

Staff member
Super Moderator
#3
It's good question, and an interesting subject ...

Yes, it's not only FDA, but in Europe the directives refer to compliance with standard for both design and production, a point which is often overlooked.

Also, IEC 60601-1:2005 uses the following definition of a type test (bold is my emphasis):

3.135 TYPE TEST
test on a representative sample of the equipment with the objective of determining if the equipment, as designed and manufactured, can meet the requirements of this standard
From fundamentals, number of samples depends on variability of results and the margin to an applicable limit. That depends a lot on the specific design aspect being tested. So you cannot decide for the whole standard.

For example, for earth leakage current, if the manufacturer uses 1nF EMC capacitors, including capacitor tolerance (say 20% including temperature effects), and stray leakage (varies usually 20-40uA) we can expect the actual production results to be variable between 100-140uA. Since the limit is 500uA, a single test result of say 127uA proves that the design is implemented as expected, and "representative" of production given the huge margin to the limit. Additional samples are not going to increase confidence in a pass / fail result.

Many safety tests are like this, in practice there will be mild to moderate variability in the test results on each production sample, but the margin to the limits will be far higher than the variability.

But, sometimes there will be a close result, or large variability. In that case there may be a few options:
- redesign with a greater margin or reduced variability
- run several tests until you get enough data to be confident of pass/fail result
- determine that the test method/criteria is already conservative, so there is no significant risk due to production variations.

Standards are usually based on a series of worst case assumptions which are necessary for consistency but rarely occur in the real world. Also the allowable limits often include some margin to allow for production variations. In that case, worrying about whether a test result is representative of production might be overkill. For example, in the temperature rise test, we assume worst case supply voltage, cooling, operating mode, loading, operating conditions, length of loading, room ambient etc etc. If under all of those conditions a test result is marginally below the limit, production variations are unlikely to introduce any significant risk in the real world.

On the other hand, we may have a test result where a PCB track fused during a switching transformer short circuit test. Since it was an unintended part of the circuit that provided protection, it's reasonable to ask if the result is representative of production. In that case, running the test on 10 samples might be a reasonable approach.

So to summarize, it's a case by case, taking into account the test, the design, expected variability of the result, margin to the limit, and how critical the limit/test is in the real world.

Because it is built in to the standard (via the definition of a type test), this is something that the test laboratory should consider when each test is performed. They should inform the applicant if they feel a test result will not be representative of production.
 
#4
As 60601 is intended as a 'Type Test' it is expected that a single unit will be subject to all of the applicable tests and at the end still be safe and functional. You can see this in Annex B - Sequence of Testing where the final verification of the markings is the very last thing to be done after all rubbing/heating/poking/impacts/drops have been completed.

I usually find that the test piece is not in a condition where it could be sold. It may be scratched and dented. Remember also that the full dielectric test, held for 1 minute, can over-stress insulations without obvious damage.

If you are looking for a sub-set of the 60601 type tests to form production tests then have a look at IEC 62353 (recurrent test and test after repair). For instance, there the dielectric test voltage is the same but is only held for 5 secs. and there are alternative techniques described for the measurement of leakage currents.

The test equipment manufacturer Rigel do a handy little (free) guide to 62353.

www.rigelmedical.com

(No connections)
 
Q

QualityVic

#5
Thanks to both of you Peter and Pads. I believe Peter may have provided the rationale needed here. It sounds like I'm going to have to sift through the results and determine the margin to the limit, but this makes absolute sense!

Thank you very much both of you!
 
Thread starter Similar threads Forum Replies Date
N Sample Size Justification for Medical Device Shelf-Life Inspection, Prints (Drawings), Testing, Sampling and Related Topics 13
H Factory Dictated Sample Size Justification Statistical Analysis Tools, Techniques and SPC 9
G Sampling Plan - Sample Size Justification for a Bottling Cleaning Process Validation Qualification and Validation (including 21 CFR Part 11) 2
A Clinical assessment sample size - Medical device Class IIb implantable (93/42 directive) EU Medical Device Regulations 2
P Sample Size for Distribution Simulation Testing Inspection, Prints (Drawings), Testing, Sampling and Related Topics 11
C Stress / Challenge Conditions for Design Verification Testing to Reduce Sample Size 21 CFR Part 820 - US FDA Quality System Regulations (QSR) 11
K How can Acceptance Number and Reject Number be larger than Sample Size on Z1.4 Table? Inspection, Prints (Drawings), Testing, Sampling and Related Topics 8
J Validation Sample Size for Tray Seal Qualification and Validation (including 21 CFR Part 11) 3
D Design Verification Sample Size vs Repeats Statistical Analysis Tools, Techniques and SPC 9
M Minimum sample size - Guidance and statistical rationale Inspection, Prints (Drawings), Testing, Sampling and Related Topics 3
P Unrealistic Packaging Validation Sample Size 21 CFR Part 820 - US FDA Quality System Regulations (QSR) 39
J Control chart for huge sample size Statistical Analysis Tools, Techniques and SPC 9
S Is there a standard for sample size during R&D phase Other ISO and International Standards and European Regulations 18
J Sample size definition in an Automotive SMT pilot lot run Misc. Quality Assurance and Business Systems Related Topics 1
E Correct way to certify hydrostatic testing when it is not 100% (and Sample Size) Various Other Specifications, Standards, and related Requirements 6
B Determining sample size for device sterility Inspection, Prints (Drawings), Testing, Sampling and Related Topics 3
D Determining of sample size for 'Operational Qualification' AQL - Acceptable Quality Level 5
F Bayes Success run Theorem for sample size during OQ&PQ Qualification and Validation (including 21 CFR Part 11) 4
I Device modifications - Clinical sample size rationale EU Medical Device Regulations 5
J Sample size for creating a data base as a reference to a tested variable Other Medical Device and Orthopedic Related Topics 6
T Sample Size for Design Validation Design and Development of Products and Processes 4
C AS9138 Sample Size Determination AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 1
V Acceptable maximum RSD (relative standard deviation) for an sample size Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 1
E Sample size for design verification of variable in single use device Design and Development of Products and Processes 20
R Sample size for clinical validation/investigation EU Medical Device Regulations 4
R Process Validation sample size selection Statistical Analysis Tools, Techniques and SPC 0
J Interesting Discussion Sample Size Determination for Medical Device Other Medical Device and Orthopedic Related Topics 19
P Is it possible to make an educated decision using a very very small sample size? Inspection, Prints (Drawings), Testing, Sampling and Related Topics 3
F Sample Size for Biocompatibility Tests Other Medical Device Related Standards 4
V Firmware Verification Testing & Sample Size Software Quality Assurance 1
R Determining Sample Size for Medical Device Component Validation Inspection, Prints (Drawings), Testing, Sampling and Related Topics 0
S Surveillance Sampling Test - Determining Sample Size Inspection, Prints (Drawings), Testing, Sampling and Related Topics 5
H Sample Size Calculation (Confidence Interval and Reliability) - Medical Devices Reliability Analysis - Predictions, Testing and Standards 6
P Cleaning and Disinfection Validation Sample Size of 3? Other Medical Device Related Standards 2
V Sample Size Calculation for Image Analysis - Microscopy Inspection, Prints (Drawings), Testing, Sampling and Related Topics 2
G Sample Size, Significant Figures, Scale General Measurement Device and Calibration Topics 3
L Heated Sealed Packages - Sample Size for OQ (Operational Qualification) and PQ Inspection, Prints (Drawings), Testing, Sampling and Related Topics 11
P Frequency and Sample Size Requirements for an MSA Studies Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 4
V When and How to apply the Bayes Success Run approach for Sample Size Determination Inspection, Prints (Drawings), Testing, Sampling and Related Topics 4
C Process Qualification Sample size Document Control Systems, Procedures, Forms and Templates 6
G Sample size for IEC 60601-1-11 environmental tests IEC 60601 - Medical Electrical Equipment Safety Standards Series 1
G IEC 60601-1-2 Sample Size issue Other Medical Device Related Standards 1
A How to calculate Mean and standard deviation without sample size in Minitab Using Minitab Software 5
D What is the minimum Sample Size for Weibull Analysis Reliability Analysis - Predictions, Testing and Standards 12
C Sample Size for Stability Testing Other Medical Device and Orthopedic Related Topics 2
M Calculating Cpk when sample size equals to 1 Capability, Accuracy and Stability - Processes, Machines, etc. 12
F Power and sample size for factorial design Using Minitab Software 4
S Sample Subgroup Size for NP/P chart - nPbar>=5 Statistical Analysis Tools, Techniques and SPC 4
U Sample size to prove parts are good with 99.73% confidence Inspection, Prints (Drawings), Testing, Sampling and Related Topics 4
F Sample Size to get Statistically Valid Data Measurement Uncertainty (MU) 6

Similar threads

Top Bottom