Design Verification - Is testing required?

D

DamienL

Starting to get Involved
#1
#1
Hi all,
I've been in Medical Devices quite a while and am a bit embarassed to admit I still don't know what's actually required for a design verification. I have always worked with companies that would verify through extenstve testing that the design output meets a pre-determined design input specification. An example might be that a device "must be able to withstand pressure of up to 20atm". So in order to verify that the desigin output meets this specification, I would have a pre-approved protocol/plan which states the test methodology and equipment to be used, along with the sample size and acceptance criteria (both of which would be determined by the FMEA risk for the associated failuire mode).

However, I come across frequent situations where a product might have a design input specification that, in my opinion, doesn't warrant any testing whatsoever (but the companies I've worked for will still test for it). Some examples might be as follows:

EXAMPLE 1:
USER NEED: Device must be long enough to reach the target treatment area
DESIGN INPUT SPECIFICATION: Top-to-toe length must be at least 30cm
DESIGN OUTPUT: Assembly drawings with allowable top-to-toe length 35-40cm
For this one, would it make sense for Design Verification to simply be a documented verification that 35-40cm is specified on the assembly drawing? Therefore design output meets design input.

EXAMPLE 2:
USER NEED: Device must be visually appealing to the user
DESIGN INPUT SPECIFICATION: Handle on the finished Device must be white (this would just be a partial spec, it would take a lot more to define an appropraite design input for this user need)
DESIGN OUTPUT: Handle component drawings with white specified as the colour

This is probably a controversial example but if we pretend that the spec is based on a user 'need' (rather than a user 'want'), could Design Verification simply be a documented verification that all of the individual drawigns for the handle components specify they be made in white? Therefore the finished device has to end up white.

So my question is in two parts: Firstly, can Design Verification be done like I've suggested in these 2 examples - a paperwork check? Or is testing always needed?

Secondly, if testing is not always needed, then how would you go about satisfying 7.3.6 of ISO 13485 (planning for DV). Would you need to write a protocol/plan up front to state that you're going to take out the approved drawing and compare it to the design input spec?

I understand there are loads of holes in the examples I've picked, but I'm more interested in the concept of Design Verification without testing. Whether that is a common approach that I should be using instead of testing wherever possible? Thanks
 
Standard Work Instruction Software by Dozuki
Elsmar Forum Sponsor
Y

yodon

Staff member
Super Moderator
#2
#2
Design Verification can take multiple forms. Physical properties may be verified through means other than (functional type) testing. The focus is providing objective evidence that the requirement is met. Design verification should be very cut-and-dried as to what constitutes pass criteria.

Your second example would be part of design validation (does it meet the users' needs). Design validation can be a little more squishy than clear-cut pass/fail (e.g., your criteria might be 4 out of 5 users must agree that it is visually appealing). Such a requirement would necessitate that you involve intended users.
 
Ronen E

Ronen E

Problem Solver
Staff member
Moderator
#4
#4
DamienL said:
Hi all,
I've been in Medical Devices quite a while and am a bit embarassed to admit I still don't know what's actually required for a design verification. I have always worked with companies that would verify through extenstve testing that the design output meets a pre-determined design input specification. An example might be that a device "must be able to withstand pressure of up to 20atm". So in order to verify that the desigin output meets this specification, I would have a pre-approved protocol/plan which states the test methodology and equipment to be used, along with the sample size and acceptance criteria (both of which would be determined by the FMEA risk for the associated failuire mode).

However, I come across frequent situations where a product might have a design input specification that, in my opinion, doesn't warrant any testing whatsoever (but the companies I've worked for will still test for it). Some examples might be as follows:

EXAMPLE 1:
USER NEED: Device must be long enough to reach the target treatment area
DESIGN INPUT SPECIFICATION: Top-to-toe length must be at least 30cm
DESIGN OUTPUT: Assembly drawings with allowable top-to-toe length 35-40cm
For this one, would it make sense for Design Verification to simply be a documented verification that 35-40cm is specified on the assembly drawing? Therefore design output meets design input.

EXAMPLE 2:
USER NEED: Device must be visually appealing to the user
DESIGN INPUT SPECIFICATION: Handle on the finished Device must be white (this would just be a partial spec, it would take a lot more to define an appropraite design input for this user need)
DESIGN OUTPUT: Handle component drawings with white specified as the colour

This is probably a controversial example but if we pretend that the spec is based on a user 'need' (rather than a user 'want'), could Design Verification simply be a documented verification that all of the individual drawigns for the handle components specify they be made in white? Therefore the finished device has to end up white.

So my question is in two parts: Firstly, can Design Verification be done like I've suggested in these 2 examples - a paperwork check? Or is testing always needed?

Secondly, if testing is not always needed, then how would you go about satisfying 7.3.6 of ISO 13485 (planning for DV). Would you need to write a protocol/plan up front to state that you're going to take out the approved drawing and compare it to the design input spec?

I understand there are loads of holes in the examples I've picked, but I'm more interested in the concept of Design Verification without testing. Whether that is a common approach that I should be using instead of testing wherever possible? Thanks
Click to expand...
Hi Damien,

Don't be embarrassed at all, you are thinking perfectly straight! (IMO)
I also think that many, many professionals in this field haven't got their thoughts properly sorted about that matter. Sadly, a lot don't even care and just go about with their happy test-everything business.

Yes, I'd go for a protocol that details your verification method for all design input items, whether it involves testing (last resort) or not.

Please have a look at my article on design verification (I tried to address that issue in it).

Cheers,
Ronen.
 
Ronen E

Ronen E

Problem Solver
Staff member
Moderator
#5
#5
yodon said:
Your second example would be part of design validation (does it meet the users' needs). Design validation can be a little more squishy than clear-cut pass/fail (e.g., your criteria might be 4 out of 5 users must agree that it is visually appealing). Such a requirement would necessitate that you involve intended users.
Click to expand...
I partly agree.

I think that that particular example calls for a 2-tier approach.

1. User Needs level: The device needs to be appealing to the user blah blah blah. "Appealing to the user" is quite subjective and obviously involves the user, so that should be addressed in design validation as you've described.

2. Design Input level: As Damien described, the (subjective) User Need is "translated" to an (objective) engineering requirement - The <x> needs to be white (maybe even specifying Pantone, RAL or the like, etc.), and probably a bunch of other requirements at a similar specificity level. This kind of requirement can and should be verified in design verification as Damien has described.

So you are both right.
 
D

DamienL

Starting to get Involved
#6
#6
Thanks all for helping me see the light on this. You'd be surprised how many organisations out there, when they see a design specification, knee jerk into developing a test method to measure it, then find out they can't measure it reliably, then end up in a spiral of test method development!! That might be absolutely appropriate for a high risk design control, but I don't think testing should be a first resort for everything. Thanks all for your input, and an excellent article Ronen.
 
You must log in or register to reply here.
Thread starter Similar threads Forum Replies Date
D Testing to failure for design verification Reliability Analysis - Predictions, Testing and Standards 11
A Sample Size for Design Verification (Prototype Testing) for Medical Devices Qualification and Validation (including 21 CFR Part 11) 12
A Medical Device Design Verification Testing - Is ISO 62366:2008 what I'm looking for? IEC 62366 - Medical Device Usability Engineering 16
C Documentation for items used for Design Verification 21 CFR Part 820 - US FDA Quality System Regulations (QSR) 4
P Design verification driven by new equipment. How is this different than process validation? 21 CFR Part 820 - US FDA Quality System Regulations (QSR) 1
N Design Verification & Process Validation - Statistical sample sizes Design and Development of Products and Processes 2
R Design Verification Documentation ISO 13485:2016 - Medical Device Quality Management Systems 19
R Design verification for interim design outputs - sampling rationale ISO 13485:2016 - Medical Device Quality Management Systems 2
D Supplied item design verification Supplier Quality Assurance and other Supplier Issues 5
Ronen E A Rational Basis for Design Verification Design and Development of Products and Processes 5
V Which batches should or could be considered for design validation and design verification? 21 CFR Part 820 - US FDA Quality System Regulations (QSR) 0
R Medical Device Design verification sample prototype Other Medical Device and Orthopedic Related Topics 14
E Sample size for design verification of variable in single use device Design and Development of Products and Processes 19
S Source of QMS templates including templates for design verification/design validation Document Control Systems, Procedures, Forms and Templates 2
C Deviation in Design verification Other Medical Device Related Standards 6
V Using K-Factor(Tolerance Interval) Analysis for Design Verification Statistical Analysis Tools, Techniques and SPC 3
J Design Verification - Managing Changes Design and Development of Products and Processes 4
S CE Mark Approval Design Verification and Validation Questions CE Marking (Conformité Européene) / CB Scheme 8
V Template / format for Device History File & Design Verification of transdermal patch 21 CFR Part 820 - US FDA Quality System Regulations (QSR) 1
H Is design verification and validation required for samples accompanying the quotes ? ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 5
D Pre-Design Verification - Using Continuous / Variables Data Statistical Analysis Tools, Techniques and SPC 2
W Qualification of Design Verification Equipment 21 CFR Part 820 - US FDA Quality System Regulations (QSR) 1
P ISO9001 Scope Exclusion Verification in a Design Company ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 14
M Design Verification: "Difference" in Sample Size Calculations? Design and Development of Products and Processes 1
S Verification and Validation of Post Market Design Change Design and Development of Products and Processes 2
H Form that will satisfy Design Review and Design Verification Requirements (7.3) ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 2
J Design Inputs and Verification Activities CE Marking (Conformité Européene) / CB Scheme 5
R Need help on defining scope for Design Verification File for Class III IVD 21 CFR Part 820 - US FDA Quality System Regulations (QSR) 8
smryan Satisfying the ISO 9001:2008 7.3.5 Design & Development Verification requirement ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 11
P How to separate Product Design Review, Verification, and Validation Activities ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 26
Uriel Alejandro Trouble with a Mechanical Design Technical Verification Check List AS9100, IAQG 9100, Nadcap and related Aerospace Standards and Requirements 2
M Design and Development Outputs Approval, Verification and Validation IATF 16949 - Automotive Quality Systems Standard 4
A ?820.30(d) Design Output Release - Before or After Verification? Design and Development of Products and Processes 6
T DVP&R (Design Verification Plan and Report) for Vehicle Labels? APQP and PPAP 3
W Design History Verification Records Control and Approvals US Food and Drug Administration (FDA) 3
G Legacy Product - Do we need follow QSR 820? Design Verification and Validation 21 CFR Part 820 - US FDA Quality System Regulations (QSR) 12
S Design and Development - Review vs. Verification vs. Validation Design and Development of Products and Processes 15
S Acceptance Criteria at Design Verification Inspection, Prints (Drawings), Testing, Sampling and Related Topics 2
G Sample Size for Design Verification and Validation 21 CFR Part 820 - US FDA Quality System Regulations (QSR) 6
Chennaiite Is Design Verification Software required to be Calibrated IATF 16949 - Automotive Quality Systems Standard 7
B Is Ship Test considered Design Verification or Design Validation? 21 CFR Part 820 - US FDA Quality System Regulations (QSR) 2
D Design Input/Output and Design V&V (Verification and Validation) Interpretations 21 CFR Part 820 - US FDA Quality System Regulations (QSR) 14
D Medical Device Design Verification and Validation Differences 21 CFR Part 820 - US FDA Quality System Regulations (QSR) 16
S Medical Devices Design Verification Sampling Other Medical Device and Orthopedic Related Topics 3
S Checklist for RA and QA Review of DVT (design verification test) for Software Other US Medical Device Regulations 2
Chennaiite Prototype - Design Verification or Validation? APQP and PPAP 12
I Cumulative Confidence Levels - Design Verification and Validation Sampling Inspection, Prints (Drawings), Testing, Sampling and Related Topics 12
S Medical Device Design Verification and Validation - info Other Medical Device and Orthopedic Related Topics 1
D Special 510k - Data Results of the Design Verification and Validation Other US Medical Device Regulations 3
D Design Verification for special 510(k) - Size modification to an existing medical device 21 CFR Part 820 - US FDA Quality System Regulations (QSR) 7
Similar threads
Top Bottom