The Elsmar Cove Business Systems and Standards Discussion Forums Sample Size Calculation (Confidence Interval and Reliability) - Medical Devices
 Forum User Name Keep Me Logged In Password
 Register Photo Albums Blogs FAQ Registered Visitors Social Groups Calendar Search Today's Posts Mark Forums Read

 Elsmar Cove Forum Visitor Notice(s)

# Sample Size Calculation (Confidence Interval and Reliability) - Medical Devices

 Elsmar XML RSS Feed Monitor the Elsmar Forum Sponsor Links Courtesy Quick Links Links Elsmar Cove visitors will find useful in the quest for knowledge and support: International Standards Bodies - World Wide Standards Bodies International Standards Organization - ISO Standards and Information Quality Digest

Post Number #1
8th July 2017, 10:53 AM
 Harini17 Total Posts: 3
Sample Size Calculation (Confidence Interval and Reliability) - Medical Devices

Dear Statisticians and regulatory experts,

Kindly help me to solve this problem for one of the medical device project. I asked many statisticians, but none were able to give convincing answer from the regulatory standpoint as you know FDA is very strict with the evidences and rationals. I found the similar problem on this forum but couldn't find the end answer.

Problem: The manufacturer of medical endoscope device equipment (pretty expensive prototypes) and they are trying to figure out justification for using 5, 7 or 10 samples with sufficient confidence level and reliability to proceed w/ manufacturing.
Testing such as bend cycling and environmental testing etc which they can do in house, for these tests sample sizes need to be determined (for each test). *These sample sizes can be calculated based on confidence and reliability levels, but a precedent should be set for the confidence/reliability that is needed for these devices and testing based on the risk level of the testing and the expense of running these tests.

At least with the examples of similar kind with formula and method!

I have very limited statistical knowledge. Kindly help me to solve this problem with the solutions from the regulatory standpoint.

Thank you!

Last edited by Harini17; 8th July 2017 at 01:33 PM.

Post Number #2
10th July 2017, 04:07 AM
 paulag Total Posts: 58
Re: Sample Size Calculation (Confidence Interval and Reliability) - Medical Devices

Attached Files: 1. Scan for viruses before using, 2. Please report any 'bad' files by Reporting this post, 3. Use at your Own Risk.
 Walfish-Choosing-the-Best-Device-Sample-Size-for-Verification-and-Validation.pdf (299.1 KB, 42 views)
 Thank You to paulag for your informative Post and/or Attachment!
Post Number #3
10th July 2017, 12:45 PM
 Harini17 Total Posts: 3
Re: Sample Size Calculation (Confidence Interval and Reliability) - Medical Devices

Thank you Paulag.
I would like to know the reliability and confidence interval percentages that we can to use for these tests, so that FDA accepts. I would like to know the FDA requirements for these tests.

Thank you!
Post Number #4
10th July 2017, 03:27 PM
 Bev D Total Posts: 3,505
Re: Sample Size Calculation (Confidence Interval and Reliability) - Medical Devices

I am afraid you are asking for something that cannot be answered to your satisfaction. Sample sizes that will 'satisfy the FDA' are not easy or straightforward. You cannot simply plug numbers into a formula. We can give you the formula (I believe that it is in the attachment in the above post) but YOU must come up with the numbers that go into the formula based on your organizations assessment of the risk (hazard) of each characteristic that you will be testing.

The formula that incorporates Reliability with a specified confidence level is:

n = LN(1-C)/LN(R)

n= sample size
LN is the natural log
1-C is 1- confidence level (traditionally this is 95% or 99%. a higher confidence level is selected if the hazard is high)
R is the 'Reliability'. This is 1-defect rate that you can tolerate. again a severe hazard would require a pretty low defect rate

This formula requires that NO DEFECTS be found in the sample in order to accept the validation results.

This formula is based on using only pass/fail categorical results. you can get smaller sample sizes if you have continuous data where you can make predictions regarding the distribution vs. specification limits. These typically require a statistician or at least someone who is well versed in these types of statistics.

Severe hazards require large sample sizes per this Reliability/Confidence formula - although this typically results in the lowest sample sizes possible. Often companies will balk at high sample sizes and so the FDA provides the ability to provide a rationale based on balancing cost of testing vs. cost of the hazard. you can plug various numbers into the formula and see the effect for yourself.

Beyond this you have the complication of understanding that sample size applies to both the number of instruments/products and the number of USES of the product. The reliability/confidence formula typically applies to the number of instruments and the number of uses is based on the either the specified number of maximum uses or the maximum expected number of uses.
 Thank You to Bev D for your informative Post and/or Attachment!
Post Number #5
10th July 2017, 05:15 PM
 Statistical Steven Total Posts: 1,083
Re: Sample Size Calculation (Confidence Interval and Reliability) - Medical Devices

Quote:
 In Reply to Parent Post by paulag http://www.fdanews.com/ext/resources...Validation.pdf
Thank you for sharing my presentation. I have updated it slightly, but the ideas are the same. There is no "Standard" confidence and reliability. You need to tie it back to your risk management program so that your sample sizes (confidence and reliability) are commensurate with the risk to the patient (reliability component).
 Thank You to Statistical Steven for your informative Post and/or Attachment!
Post Number #6
11th July 2017, 03:38 AM
 Harini17 Total Posts: 3
Re: Sample Size Calculation (Confidence Interval and Reliability) - Medical Devices

Thank you, Bev D and Statistical Steven...I have read all your threads addressing these questions thank so much. You both are doing good work in solving these regulatory obstacles. Special thanks to Bev D for such detailed explanation!

Last edited by Harini17; 11th July 2017 at 12:09 PM.
Post Number #7
11th July 2017, 01:31 PM
 v9991 Total Posts: 945
Re: Sample Size Calculation (Confidence Interval and Reliability) - Medical Devices

Quote:
 In Reply to Parent Post by Bev D Often companies will balk at high sample sizes and so the FDA provides the ability to provide a rationale based on balancing cost of testing vs. cost of the hazard. you can plug various numbers into the formula and see the effect for yourself.

while FDA is providing enough direction, there is not even an outline/framework or guidance from agency for same. got certain references on risk from PDA & ISPE ; but certainly not ones which reference cost of testvshazard.!

1. point is, agency has ultimate power (veto to say the system/practice is inadequate, non-compliant) but what it says is ...all theory, no reference/ example, guidance, framework; (I remember an section on risk benefit analysis on clinical trial data evaluation!., but no such thing on validations/sample size.)

2. is this one reason, why (especially) pharma is way behind in adopting these tools and techniques. (its only recently that 'statistical' rationale/analysis gaining releac env

 The Elsmar Cove Business Systems and Standards Discussion Forums Sample Size Calculation (Confidence Interval and Reliability) - Medical Devices

 Bookmarks

 Visitors Currently Viewing this Thread: 1 (0 Registered Visitors (Members) and 1 Unregistered Guest Visitors)

 Forum Posting Settings You may not post new threads You may not post replies You may not post attachments You may not edit your posts BB code is On Emoticons are On [IMG] code is On HTML code is Off Forum Rules

 Similar Discussion Threads Discussion Thread Title Thread Starter Forum Replies Last Post or Poll Vote kwalityguy Inspection, Prints (Drawings), Testing, Sampling and Related Topics 1 27th March 2013 01:00 PM Theriaux Statistical Analysis Tools, Techniques and SPC 2 9th February 2013 12:11 PM Lasermike Inspection, Prints (Drawings), Testing, Sampling and Related Topics 2 2nd February 2012 10:05 AM doops Reliability Analysis - Predictions, Testing and Standards 4 23rd December 2008 11:53 AM Benoit Quality Tools, Improvement and Analysis 5 21st January 2005 10:38 AM

The time now is 12:35 PM. All times are GMT -4.