Regulatory requirement of SaMD with machine learning component

K

Kynetyk

Registered
#1
#1
Greetings everyone,

I am working on a software as medical device that has a machine learning component to it (eg. Tensorflow model). In short, it is an image processing application that evaluates the volume of anatomical structures from medical scans to assist diagnosis.

I'm currently following IEC62304 for the "model code" (model weights + inference code), however I'm having a hard time finding information on how I should treat the "training code" (dataset management, model fitting, model evaluation), since it is not part of the SaMD per say.

I've read in a Johner-Institute blog post on machine learning that the "training code" should satisfy ISO-13485:2016 requirements regarding "computerized system validation" (GAMP5-Category 5). I'm assuming that it refers to section 7.5.6 (Validation of processes for production and service provision), however that section also state that it applies to processes "where the resulting output cannot be verified by subsequent monitoring or measurement [...]". In my case, I can still evaluate the performances of the machine learning component independently of the "training code".

Do you have any thoughts on this ? Any experience/strategy regarding ML and SaMD?
 
Last edited:
Download Free White Paper
Elsmar Forum Sponsor
Ed Panek

Ed Panek

QA RA Small Med Dev Company
Leader
Super Moderator
#3
#3
As a person familiar with training networks to play chess, as you have stronger and stronger networks, it is possible to actually weaken the result with more training. The network with a low learning rate can fall into local minima and be stuck there and without lots of experimenting, it won't be known.
 
J

jerjunnluh

Registered
#4
#4
I believe the blog you mentioned is titled as "Validation of Machine Learning Libraries"

In the blog, it said:” If the code for this data pre-processing and the training of the model is not part of the medical device (this is usually the case), IEC 62304 is not(!) applicable. This applies both for the development of this code as well as the use of existing machine learning libraries (SOUP).” That means the model libraries you created (CNNs, RNNs, or other models) can be treated as a common libraries like other libraries you call in your main program.

However, in the same blog it also stated “ The trained model now becomes part of a (medical) device together with the machine learning library (or part of it). This component is now responsible for making correct predictions, e.g., for correctly classify images.

……

IEC 62304 rightly calls this the verification of the SOUP/component, even if the term validation is used more often when talking about libraries.
This verification/validation step involves demonstrating that the component makes the correct prediction with respect to the trained model.”



If you want to evaluate the performances of the machine learning the volume of anatomical structures from medical scans, you still need to follow the process of IEC 62304 to validate your software.



Hope it might help you.
 
You must log in or register to reply here.
Thread starter Similar threads Forum Replies Date
P Regulatory or registration requirement for disinfectant in ASEAN Registrars and Notified Bodies 1
T Regulatory Standards & Certification Requirement - Headband to monitor mental health Other Medical Device Regulations World-Wide 4
chris1price Is there a regulatory (MDD, MDR, FDA, ISO, etc) requirement to perform a mock recall? CE Marking (Conformité Européene) / CB Scheme 5
R ISO 13485:2016 - Quality Objectives Regulatory Requirement Examples ISO 13485:2016 - Medical Device Quality Management Systems 1
Q Is there a regulatory requirement for clinician review for pFMEAs? ISO 14971 - Medical Device Risk Management 2
R Medical Device Smartphone App Regulatory Requirement and Labeling US Food and Drug Administration (FDA) 1
V FDA regulatory requirement on the lot number convention for medical devices US Food and Drug Administration (FDA) 2
E Is there a specific regulatory requirement for 100% inspection of IFUs? Inspection, Prints (Drawings), Testing, Sampling and Related Topics 4
J What to be reported on "New or Revised Regulatory Requirement" at Management Review? Management Review Meetings and related Processes 8
G US Risk Assessment OH&S Regulatory Requirement(s) Occupational Health & Safety Management Standards 5
C Regulatory Requirement Updates? Medical Device Contract Manufacturer ISO 13485:2016 - Medical Device Quality Management Systems 6
C What is the Minimum Regulatory Requirement for Record Retention of DHR by Suppliers Records and Data - Quality, Legal and Other Evidence 9
N Statutory and regulatory requirement examples in metal fabrication Various Other Specifications, Standards, and related Requirements 8
gdwaikle Regulatory requirement for Receiving Inspection reporting to Quality Org.? Inspection, Prints (Drawings), Testing, Sampling and Related Topics 10
A Keeping prototype devices - Is there a regulatory or compendial requirement? ISO 13485:2016 - Medical Device Quality Management Systems 3
L Are Fireproof Cabinets a Regulatory Requirement for record storage? FDA or EU Records and Data - Quality, Legal and Other Evidence 23
R Ethics: Ethical Question - Knowingly Violating a Regulatory Requirement Philosophy, Gurus, Innovation and Evolution 20
P Exclusion of clause 8.2.3 Reporting to regulatory authorities ISO 13485:2016 - Medical Device Quality Management Systems 7
A Readiness for consultancy in Regulatory Affairs Consultants and Consulting 1
A A good Regulatory Affairs Manager EU Medical Device Regulations 15
M Regulatory compliance ISO 14001 ISO 14001:2015 Specific Discussions 2
E Which regulatory framework for an app-based study for research purposes? EU Medical Device Regulations 1
JoCam FSN for regulatory breach EU Medical Device Regulations 4
M Regulatory Change assessment US Food and Drug Administration (FDA) 3
P Transferring medical data from a device (Sec 201(h)): regulatory implications US Medical Device Regulations 3
D Regulatory Affairs Certification (RAC) Devices Exam - Autumn 2022 study Professional Certifications and Degrees 2
Watchcat REGULATORY WATCHCAT De Novo Post-Mortem 6 – How Does This Even Happen? Other US Medical Device Regulations 0
Watchcat REGULATORY WATCHCAT De Novo Post-Mortem 5 – What's the Rush? Other US Medical Device Regulations 0
K Regulatory Aspect of Embedding 4G/5G communication technologies into medical device IEC 60601 - Medical Electrical Equipment Safety Standards Series 2
Watchcat REGULATORY WATCHCAT - New RA Cartoon Other US Medical Device Regulations 4
Watchcat REGULATORY WATCHCAT De Novo Post-Mortem 4 – Design Controls Other US Medical Device Regulations 0
Watchcat REGULATORY WATCHCAT De Novo Post-Mortem 3 - Rearranging the Regs Other US Medical Device Regulations 0
Watchcat Does Regulatory Affairs put the "no" in innovation? Other US Medical Device Regulations 14
Watchcat REGULATORY WATCHCAT De novo Post Mortem 2 - Disclosure and Accountability Other US Medical Device Regulations 11
Watchcat REGULATORY WATCHCAT De novo Post Mortem 1 - Regulatory Religion Other US Medical Device Regulations 0
Watchcat REGULATORY WATCHCAT De novo Post Mortem Other US Medical Device Regulations 0
Watchcat REGULATORY WATCHCAT - RIP "Mini-PMA" Other US Medical Device Regulations 0
Q ISO 20417:2021- Regulatory Identification Other ISO and International Standards and European Regulations 3
Watchcat REGULATORY WATCHCAT - His Grandmother's Technology Other US Medical Device Regulations 0
Watchcat REGULATORY WATCHCAT - De Novo Proposed Rule - Samples & Labeling Other US Medical Device Regulations 0
Watchcat REGULATORY WATCHCAT - De Novo Proposed Rule - Clinical Investigations Other US Medical Device Regulations 0
Watchcat REGULATORY WATCHCAT - The 510(k) Submissions Tracker Other US Medical Device Regulations 0
Watchcat REGULATORY WATCHCAT - De Novo Proposed Rule - Nonclinical Studies Other US Medical Device Regulations 0
Watchcat REGULATORY WATCHCAT - De Novo Proposed Rule - Benefits and Risks Other US Medical Device Regulations 0
Watchcat REGULATORY WATCHCAT - De Novo Proposed Rule - Special Controls and Standards Other US Medical Device Regulations 0
Watchcat REGULATORY WATCHCAT - De Novo Proposed Rule - Alternative Practices and Procedures Other US Medical Device Regulations 0
Watchcat REGULATORY WATCHCAT - De Novo Proposed Rule - Device Description Other US Medical Device Regulations 0
Watchcat REGULATORY WATCHCAT - De Novo Proposed Rule - Indications for Use Other US Medical Device Regulations 0
Watchcat REGULATORY WATCHCAT - De Novo Proposed Rule - General Comments Other US Medical Device Regulations 2
Ed Panek FDA Remote Regulatory Assessment (RRA) Overview 21 CFR Part 820 - US FDA Quality System Regulations (QSR) 10

Similar threads

Top Bottom