Regulatory requirement of SaMD with machine learning component

K

Kynetyk

Registered
#1
#1
Greetings everyone,

I am working on a software as medical device that has a machine learning component to it (eg. Tensorflow model). In short, it is an image processing application that evaluates the volume of anatomical structures from medical scans to assist diagnosis.

I'm currently following IEC62304 for the "model code" (model weights + inference code), however I'm having a hard time finding information on how I should treat the "training code" (dataset management, model fitting, model evaluation), since it is not part of the SaMD per say.

I've read in a Johner-Institute blog post on machine learning that the "training code" should satisfy ISO-13485:2016 requirements regarding "computerized system validation" (GAMP5-Category 5). I'm assuming that it refers to section 7.5.6 (Validation of processes for production and service provision), however that section also state that it applies to processes "where the resulting output cannot be verified by subsequent monitoring or measurement [...]". In my case, I can still evaluate the performances of the machine learning component independently of the "training code".

Do you have any thoughts on this ? Any experience/strategy regarding ML and SaMD?
 
Last edited:
Paper to QMS ad
Elsmar Forum Sponsor
Ed Panek

Ed Panek

QA RA Small Med Dev Company
Trusted Information Resource
#3
#3
As a person familiar with training networks to play chess, as you have stronger and stronger networks, it is possible to actually weaken the result with more training. The network with a low learning rate can fall into local minima and be stuck there and without lots of experimenting, it won't be known.
 
J

jerjunnluh

Registered
#4
#4
I believe the blog you mentioned is titled as "Validation of Machine Learning Libraries"

In the blog, it said:” If the code for this data pre-processing and the training of the model is not part of the medical device (this is usually the case), IEC 62304 is not(!) applicable. This applies both for the development of this code as well as the use of existing machine learning libraries (SOUP).” That means the model libraries you created (CNNs, RNNs, or other models) can be treated as a common libraries like other libraries you call in your main program.

However, in the same blog it also stated “ The trained model now becomes part of a (medical) device together with the machine learning library (or part of it). This component is now responsible for making correct predictions, e.g., for correctly classify images.

……

IEC 62304 rightly calls this the verification of the SOUP/component, even if the term validation is used more often when talking about libraries.
This verification/validation step involves demonstrating that the component makes the correct prediction with respect to the trained model.”



If you want to evaluate the performances of the machine learning the volume of anatomical structures from medical scans, you still need to follow the process of IEC 62304 to validate your software.



Hope it might help you.
 
You must log in or register to reply here.
Thread starter Similar threads Forum Replies Date
P Regulatory or registration requirement for disinfectant in ASEAN Registrars and Notified Bodies 1
T Regulatory Standards & Certification Requirement - Headband to monitor mental health Other Medical Device Regulations World-Wide 4
chris1price Is there a regulatory (MDD, MDR, FDA, ISO, etc) requirement to perform a mock recall? CE Marking (Conformité Européene) / CB Scheme 4
R ISO 13485:2016 - Quality Objectives Regulatory Requirement Examples ISO 13485:2016 - Medical Device Quality Management Systems 1
Q Is there a regulatory requirement for clinician review for pFMEAs? ISO 14971 - Medical Device Risk Management 2
R Medical Device Smartphone App Regulatory Requirement and Labeling US Food and Drug Administration (FDA) 1
V FDA regulatory requirement on the lot number convention for medical devices US Food and Drug Administration (FDA) 2
E Is there a specific regulatory requirement for 100% inspection of IFUs? Inspection, Prints (Drawings), Testing, Sampling and Related Topics 4
J What to be reported on "New or Revised Regulatory Requirement" at Management Review? Management Review Meetings and related Processes 8
G US Risk Assessment OH&S Regulatory Requirement(s) Occupational Health & Safety Management Standards 5
C Regulatory Requirement Updates? Medical Device Contract Manufacturer ISO 13485:2016 - Medical Device Quality Management Systems 6
C What is the Minimum Regulatory Requirement for Record Retention of DHR by Suppliers Records and Data - Quality, Legal and Other Evidence 9
N Statutory and regulatory requirement examples in metal fabrication Various Other Specifications, Standards, and related Requirements 8
G Regulatory requirement for Receiving Inspection reporting to Quality Org.? Inspection, Prints (Drawings), Testing, Sampling and Related Topics 10
A Keeping prototype devices - Is there a regulatory or compendial requirement? ISO 13485:2016 - Medical Device Quality Management Systems 3
L Are Fireproof Cabinets a Regulatory Requirement for record storage? FDA or EU Records and Data - Quality, Legal and Other Evidence 23
R Ethics: Ethical Question - Knowingly Violating a Regulatory Requirement Philosophy, Gurus, Innovation and Evolution 20
optomist1 Informational Training IMDS - Management of Product Chemical Regulatory Compliance RoHS, REACH, ELV, IMDS and Restricted Substances 2
D Worldwide Regulatory Knowledge Other Medical Device Regulations World-Wide 3
JoCam Rental, service & installation - regulatory requirements EU Medical Device Regulations 2
R Regulatory Affairs Certification (RAC) prep - Practice test versus actual exam Professional Certifications and Degrees 1
K Regulatory Affairs Certification (RAC) Exam - November 2020 preparation Professional Certifications and Degrees 0
dgrainger Clue to UK's new regulatory requirements - approval of all devices placed on the market? Other Medical Device Regulations World-Wide 1
A Regulatory requirements for electrical cosmetic appliances US Food and Drug Administration (FDA) 5
Watchcat Best Regulatory Oversight for Off-Shore Device Manufacturing? Other Medical Device Regulations World-Wide 1
S RA (Regulatory Affairs) certification & Online Internship Professional Certifications and Degrees 11
S ISO 13485 Lead Auditor - Debate between our Quality Team and Regulatory Auditor - Internal Auditor Training ISO 13485:2016 - Medical Device Quality Management Systems 17
J Management Representative and PRRC (Person Responsible for Regulatory Compliance) ISO 13485:2016 - Medical Device Quality Management Systems 4
S Regulatory job in pharma vs. medical device US Food and Drug Administration (FDA) 16
S Regulatory job in pharma vs. medical device CE Marking (Conformité Européene) / CB Scheme 0
M Regulatory clearance pathways for surgical masks/N95 respirators Other US Medical Device Regulations 3
N "Placing on the market" & "putting into service"- one time regulatory event or Continual supply event? EU Medical Device Regulations 2
P MDR PRRC (person responsible for regulatory compliance) and personal liability EU Medical Device Regulations 2
Watchcat Year of the Regulatory Watchcat Other US Medical Device Regulations 6
W Updated EU MDR regulatory matrix wanted ISO 13485:2016 - Medical Device Quality Management Systems 43
S SOPs applicable for Regulatory Affairs department Other ISO and International Standards and European Regulations 1
F ISO 13485 8.2.3 Reporting to regulatory authorities: Question regarding a procedure for this clause. ISO 13485:2016 - Medical Device Quality Management Systems 4
Ronen E Legal counselling and Medical Devices Regulatory Affairs Other Medical Device Regulations World-Wide 2
A Help establishing regulatory requirements - Plastic dental cartridge syringe US Food and Drug Administration (FDA) 0
S Regulatory strategy for Third party plugin in a PACS EU Medical Device Regulations 1
S Regulatory Medical Device PMA Plans US Food and Drug Administration (FDA) 2
M Informational TGA – Australian regulatory action on breast implants and breast tissue expanders Medical Device and FDA Regulations and Standards News 0
M Informational US FDA Draft Guidance – Providing Regulatory Submissions for Medical Devices in Electronic Format – Submissions Under Section 745A(b) of the Federal F Medical Device and FDA Regulations and Standards News 0
M Informational TGA Consultation: Proposed clarification of the regulatory requirements for medical device systems and procedure packs Medical Device and FDA Regulations and Standards News 2
M Informational CDRH’s Regulatory Science Priorities Medical Device and FDA Regulations and Standards News 3
M Informational IMDRF draft document – Requirements for Regulatory Authority Recognition of Conformity Assessment Bodies Conducting Medical Device Regulatory Reviews Medical Device and FDA Regulations and Standards News 0
D What foreign language proficiency would give the biggest edge to medical device regulatory affairs professionals in the world today or in future? Career and Occupation Discussions 6
M Informational Medicines and Healthcare Products Regulatory Agency Annual Report and Accounts 2018 to 2019 Medical Device and FDA Regulations and Standards News 0
M Informational IMDRF Consultation – Personalized Medical Devices – Regulatory Pathways Medical Device and FDA Regulations and Standards News 0
M Informational EU – MANUAL ON BORDERLINE AND CLASSIFICATION IN THE COMMUNITY REGULATORY FRAMEWORK FOR MEDICAL DEVICES Version 1.22 (05-2019) Medical Device and FDA Regulations and Standards News 2

Similar threads

Top Bottom