Validation before Verification. Why not?

S

SSchoepel

Involved In Discussions
#1
#1
I'm reading 21CFR820, ISO13485, and ISO14969 to clarify for the company the difference between verification and validation.

My question may apply to other medical devices but for a software-only (no hardware at all) medical device, it seems possible, plausible, and defensible to have validation prior to verification.

Alpha software could be tested against use cases and sent to customers to validate the flow/features. Then, the development could finish and all the internal requirements verified. If there were changes in the use cases between the alpha validation version and the final verified version, you could validate just the delta. If there were no changes, no validation.

Has anyone done this and had it pass certification/audit?
Or has everyone just fallen out of their chairs?

Thank you,
S. Schoepel
 
12 questions to ask before buying a QMS
Elsmar Forum Sponsor
John Broomfield

John Broomfield

Staff member
Super Moderator
#2
#2
SSchoepel said:
I'm reading 21CFR820, ISO13485, and ISO14969 to clarify for the company the difference between verification and validation.

My question may apply to other medical devices but for a software-only (no hardware at all) medical device, it seems possible, plausible, and defensible to have validation prior to verification.

Alpha software could be tested against use cases and sent to customers to validate the flow/features. Then, the development could finish and all the internal requirements verified. If there were changes in the use cases between the alpha validation version and the final verified version, you could validate just the delta. If there were no changes, no validation.

Has anyone done this and had it pass certification/audit?
Or has everyone just fallen out of their chairs?

Thank you,
S. Schoepel
Click to expand...
If you validate before you verify you do not know exactly what you validated.
 
G

Guillaume Prom

#3
#3
verification and validation are defined in ISO9000.

usually for medical device verification is done before validation, in order to verify that the device is safe before using it under real conditions.

"If there were no changes, no validation" it doesn't shock me.. but there is always changes ;-)
 
P

pldey42

#4
#4
In my experience of real time telecom software, verification involves inspections of designs and code against formal requirements, perhaps coupled with module and lab testing, while validation is large scale testing of complete systems, possibly under controlled conditions in the field.

So validation is more expensive; verification can discover defects earlier and more cheaply. Further, verification can discover defects that are hard to impossible to detect with tests - such as memory allocation-de-allocation mismatches - that can have catastrophic consequences for real time systems that must operate 24/7.

Also, validating just deltas could be risky because it can miss defects that have been introduced by the delta: for example, a new feature works but breaks something that previously worked, but, not being noted in the delta, isn't tested again but is in fact broken.
 
You must log in or register to reply here.
Thread starter Similar threads Forum Replies Date
C Design Transfer Review - Before or after PQ validation? 21 CFR Part 820 - US FDA Quality System Regulations (QSR) 5
Q Release of the first batch of a cleared product before process validation 21 CFR Part 820 - US FDA Quality System Regulations (QSR) 4
S Requirement for Sterilization Validation completion before issuance of ISO cert ISO 13485:2016 - Medical Device Quality Management Systems 0
Y FDA - Does anyone have conduct the validation on GR&R worksheet before? Qualification and Validation (including 21 CFR Part 11) 7
B Sterilization Validation Plan Other Medical Device Related Standards 2
D Test Method Validation Qualification and Validation (including 21 CFR Part 11) 4
T Laboratory Verification after validation ISO 17025 related Discussions 3
silentmonkey Rationalising the level of effort and depth of software validation based on risk ISO 13485:2016 - Medical Device Quality Management Systems 10
D Questions regarding process validation ISO 13485:2016 - Medical Device Quality Management Systems 6
Y We found out we have been using a equipment without validation for past 4 years Quality Manager and Management Related Issues 6
Z Is IQ necessary for laser marking validation? EU Medical Device Regulations 3
E 13485:2016, Sections 4.1.6, 7.5.6 and 7.6 - Validation of Software - Need some Advice please ISO 13485:2016 - Medical Device Quality Management Systems 2
A Validation of Forced Aeration Process ISO 13485:2016 - Medical Device Quality Management Systems 3
E Mentor for Test Method Validation (TMV) Design and Development of Products and Processes 2
M API 4F/7K/8C Design Package Validation Oil and Gas Industry Standards and Regulations 2
I ISO 2233:2000 Question - Medical Device Shipping/Transportation Validation Other ISO and International Standards and European Regulations 1
T Annual Validation as a detection mode on a PFMEA? FMEA and Control Plans 5
B TMV - Selection of TM's for Validation ISO 13485:2016 - Medical Device Quality Management Systems 5
S Forced ServiceNow validation - No change in our current user and functional requirements IT (Information Technology) Service Management 6
P Human Factors / Usability validation in the time of COVID Human Factors and Ergonomics in Engineering 9
C Template for Excel Validation Reliability Analysis - Predictions, Testing and Standards 6
M IT validation for a paper based MD repair company QMS ISO 13485:2016 - Medical Device Quality Management Systems 6
P Unrealistic Packaging Validation Sample Size 21 CFR Part 820 - US FDA Quality System Regulations (QSR) 13
D Test summary report example for design validation wanted - ISO 13485 ISO 13485:2016 - Medical Device Quality Management Systems 1
M Is Validation of Plating Processes required and who is responsible? Qualification and Validation (including 21 CFR Part 11) 11
T ISO 13485 - Process validation at critical suppliers ISO 13485:2016 - Medical Device Quality Management Systems 7
K Software Validation for Measurement Tools used in Process Validation ISO 13485:2016 - Medical Device Quality Management Systems 2
Stoic Manual soldering processes - 100% verifiable, or always requiring validation? 21 CFR Part 820 - US FDA Quality System Regulations (QSR) 15
P Design verification driven by new equipment. How is this different than process validation? 21 CFR Part 820 - US FDA Quality System Regulations (QSR) 1
S Rees System Validation Qualification and Validation (including 21 CFR Part 11) 1
K PQ validation qualification - Asked to write a PQ protocol ISO 13485:2016 - Medical Device Quality Management Systems 6
Stoic Are any medical device companies using the 2011 FDA process validation guidance instead of GHTF/SG3/N99-10:2004? 21 CFR Part 820 - US FDA Quality System Regulations (QSR) 1
K Old medical devices -> 7.3.7. Design and development validation ISO 13485:2016 - Medical Device Quality Management Systems 1
S SOP for ISO 13485:2016 Quality related Software validation ISO 13485:2016 - Medical Device Quality Management Systems 9
Y Retrospective Validation - Class I device 21 CFR Part 820 - US FDA Quality System Regulations (QSR) 10
S High voltage testing - ISO 17025 - 7.2.2 Validation of methods and 7.3 Sampling ISO 17025 related Discussions 3
M Production approval testing - Alternative ideas for Validation Reliability Analysis - Predictions, Testing and Standards 4
M Validation of two nearly identical products Other Medical Device Regulations World-Wide 5
J Requested Validation plan and reports Manufacturing and Related Processes 4
S Validation Records - Very young QMS Qualification and Validation (including 21 CFR Part 11) 2
M Test method validation - Is MSA (MSA1, MSA2, MSA3 and linearity) a good solution? Medical Device and FDA Regulations and Standards News 1
G Devices from IQ, OQ or PQ process to be used for verification, validation and summative? 21 CFR Part 820 - US FDA Quality System Regulations (QSR) 5
K ERP System Software Validation - ISO13485 2016 4.1.6 Design and Development of Products and Processes 8
W ASTM F1929 dye penetration test - Validation for in-house testing ISO 13485:2016 - Medical Device Quality Management Systems 13
Bev D Verification and Validation of Measurement Systems Misc. Quality Assurance and Business Systems Related Topics 0
Y Does Solidworks (2D/3D drafting modules) need validation? Other Medical Device and Orthopedic Related Topics 5
D Software validation in Medical Equipment Other Medical Device and Orthopedic Related Topics 20
K Validation of new machine (second machine of the same type) Pharmaceuticals (21 CFR Part 210, 21 CFR Part 211 and related Regulations) 2
A Literature review/HACCP validation of metal detection Food Safety - ISO 22000, HACCP (21 CFR 120) 0
Y Packaging validation for non-sterile Medical Equipment Other Medical Device Related Standards 1

Similar threads

Top Bottom