Regulatory requirement of SaMD with machine learning component

#1
Greetings everyone,

I am working on a software as medical device that has a machine learning component to it (eg. Tensorflow model). In short, it is an image processing application that evaluates the volume of anatomical structures from medical scans to assist diagnosis.

I'm currently following IEC62304 for the "model code" (model weights + inference code), however I'm having a hard time finding information on how I should treat the "training code" (dataset management, model fitting, model evaluation), since it is not part of the SaMD per say.

I've read in a Johner-Institute blog post on machine learning that the "training code" should satisfy ISO-13485:2016 requirements regarding "computerized system validation" (GAMP5-Category 5). I'm assuming that it refers to section 7.5.6 (Validation of processes for production and service provision), however that section also state that it applies to processes "where the resulting output cannot be verified by subsequent monitoring or measurement [...]". In my case, I can still evaluate the performances of the machine learning component independently of the "training code".

Do you have any thoughts on this ? Any experience/strategy regarding ML and SaMD?
 
Last edited:
Elsmar Forum Sponsor

Ed Panek

QA RA Small Med Dev Company
Staff member
Super Moderator
#3
As a person familiar with training networks to play chess, as you have stronger and stronger networks, it is possible to actually weaken the result with more training. The network with a low learning rate can fall into local minima and be stuck there and without lots of experimenting, it won't be known.
 
#4
I believe the blog you mentioned is titled as "Validation of Machine Learning Libraries"

In the blog, it said:” If the code for this data pre-processing and the training of the model is not part of the medical device (this is usually the case), IEC 62304 is not(!) applicable. This applies both for the development of this code as well as the use of existing machine learning libraries (SOUP).” That means the model libraries you created (CNNs, RNNs, or other models) can be treated as a common libraries like other libraries you call in your main program.

However, in the same blog it also stated “ The trained model now becomes part of a (medical) device together with the machine learning library (or part of it). This component is now responsible for making correct predictions, e.g., for correctly classify images.

……

IEC 62304 rightly calls this the verification of the SOUP/component, even if the term validation is used more often when talking about libraries.
This verification/validation step involves demonstrating that the component makes the correct prediction with respect to the trained model.”




If you want to evaluate the performances of the machine learning the volume of anatomical structures from medical scans, you still need to follow the process of IEC 62304 to validate your software.



Hope it might help you.
 
Thread starter Similar threads Forum Replies Date
P Regulatory or registration requirement for disinfectant in ASEAN Registrars and Notified Bodies 1
T Regulatory Standards & Certification Requirement - Headband to monitor mental health Other Medical Device Regulations World-Wide 4
chris1price Is there a regulatory (MDD, MDR, FDA, ISO, etc) requirement to perform a mock recall? CE Marking (Conformité Européene) / CB Scheme 4
R ISO 13485:2016 - Quality Objectives Regulatory Requirement Examples ISO 13485:2016 - Medical Device Quality Management Systems 1
Q Is there a regulatory requirement for clinician review for pFMEAs? ISO 14971 - Medical Device Risk Management 2
R Medical Device Smartphone App Regulatory Requirement and Labeling US Food and Drug Administration (FDA) 1
V FDA regulatory requirement on the lot number convention for medical devices US Food and Drug Administration (FDA) 2
E Is there a specific regulatory requirement for 100% inspection of IFUs? Inspection, Prints (Drawings), Testing, Sampling and Related Topics 4
J What to be reported on "New or Revised Regulatory Requirement" at Management Review? Management Review Meetings and related Processes 8
G US Risk Assessment OH&S Regulatory Requirement(s) Occupational Health & Safety Management Standards 5
C Regulatory Requirement Updates? Medical Device Contract Manufacturer ISO 13485:2016 - Medical Device Quality Management Systems 6
C What is the Minimum Regulatory Requirement for Record Retention of DHR by Suppliers Records and Data - Quality, Legal and Other Evidence 9
N Statutory and regulatory requirement examples in metal fabrication Various Other Specifications, Standards, and related Requirements 8
gdwaikle Regulatory requirement for Receiving Inspection reporting to Quality Org.? Inspection, Prints (Drawings), Testing, Sampling and Related Topics 10
A Keeping prototype devices - Is there a regulatory or compendial requirement? ISO 13485:2016 - Medical Device Quality Management Systems 3
L Are Fireproof Cabinets a Regulatory Requirement for record storage? FDA or EU Records and Data - Quality, Legal and Other Evidence 23
R Ethics: Ethical Question - Knowingly Violating a Regulatory Requirement Philosophy, Gurus, Innovation and Evolution 20
Watchcat REGULATORY WATCHCAT - The 510(k) Submissions Tracker Other US Medical Device Regulations 0
Watchcat REGULATORY WATCHCAT - De Novo Proposed Rule - Nonclinical Studies Other US Medical Device Regulations 0
Watchcat REGULATORY WATCHCAT - De Novo Proposed Rule - Benefits and Risks Other US Medical Device Regulations 0
Watchcat REGULATORY WATCHCAT - De Novo Proposed Rule - Special Controls and Standards Other US Medical Device Regulations 0
Watchcat REGULATORY WATCHCAT - De Novo Proposed Rule - Alternative Practices and Procedures Other US Medical Device Regulations 0
Watchcat REGULATORY WATCHCAT - De Novo Proposed Rule - Device Description Other US Medical Device Regulations 0
Watchcat REGULATORY WATCHCAT - De Novo Proposed Rule - Indications for Use Other US Medical Device Regulations 0
Watchcat REGULATORY WATCHCAT - De Novo Proposed Rule - General Comments Other US Medical Device Regulations 2
Ed Panek FDA Remote Regulatory Assessment (RRA) Overview 21 CFR Part 820 - US FDA Quality System Regulations (QSR) 9
P Quality and Regulatory organizational structure Consultants and Consulting 2
M Supplier approved list - Notified body, regulatory body Supply Chain Security Management Systems 4
B Regulatory Affairs Certification (RAC) Book - Fundamentals of Medical Device Regulations Medical Device and FDA Regulations and Standards News 0
Watchcat REGULATORY WATCHCAT - De novo info updated and consolidated Other US Medical Device Regulations 0
ebrahim QMS as per ISO 13485, Clause 4.2 Requirements for regulatory purposes for Medical Devices Authorized Representatives. ISO 13485:2016 - Medical Device Quality Management Systems 3
A Reliable sources for following EU medical device regulatory EU Medical Device Regulations 0
A GPS Regulatory requirements? Manufacturing and Related Processes 6
C RA (Regulatory Assurance) Training (FDA) looking for resources Training - Internal, External, Online and Distance Learning 5
H SOP Template for seeking regulatory clearance - MDSAP Document Control Systems, Procedures, Forms and Templates 6
J Strategy for MDR Regulatory Compliance Procedure ISO 13485:2016 - Medical Device Quality Management Systems 4
optomist1 Informational Training IMDS - Management of Product Chemical Regulatory Compliance RoHS, REACH, ELV, IMDS and Restricted Substances 2
D Worldwide Regulatory Knowledge Other Medical Device Regulations World-Wide 3
JoCam Rental, service & installation - regulatory requirements EU Medical Device Regulations 2
R Regulatory Affairs Certification (RAC) prep - Practice test versus actual exam Professional Certifications and Degrees 1
K Regulatory Affairs Certification (RAC) Exam - November 2020 preparation Professional Certifications and Degrees 0
dgrainger Clue to UK's new regulatory requirements - approval of all devices placed on the market? Other Medical Device Regulations World-Wide 1
A Regulatory requirements for electrical cosmetic appliances US Food and Drug Administration (FDA) 5
Watchcat Best Regulatory Oversight for Off-Shore Device Manufacturing? Other Medical Device Regulations World-Wide 1
S RA (Regulatory Affairs) certification & Online Internship Professional Certifications and Degrees 11
S ISO 13485 Lead Auditor - Debate between our Quality Team and Regulatory Auditor - Internal Auditor Training ISO 13485:2016 - Medical Device Quality Management Systems 42
J Management Representative and PRRC (Person Responsible for Regulatory Compliance) ISO 13485:2016 - Medical Device Quality Management Systems 11
S Regulatory job in pharma vs. medical device US Food and Drug Administration (FDA) 16
S Regulatory job in pharma vs. medical device CE Marking (Conformité Européene) / CB Scheme 0
M Regulatory clearance pathways for surgical masks/N95 respirators Other US Medical Device Regulations 3

Similar threads

Top Bottom