How do you define Risk (Medical Device)?

My company defines risk level according to the...


  • Total voters
    7

Marcelo

Inactive Registered Visitor
#21
An embolism can develop on the device itself and then travel through the patient bloodstream to the brain.
The hazardous situation in this case would be the embolism reaching the brain, and the hazard. Not sure why the embolism would develop in the device, but the hazard may be something like incorrect output or loss of function.

Also, the act of implanting the device means the interior walls of the vasculature may be damaged or there may be plaque in the vasculature that breaks loose from the vascular wall and is large enough to block an artery in the brain.
Does this only occur with implanting the device or is this a general possible problem with implantation?

With all of these hypothetical situations, there is no way to know exactly what happened to a particular patient.
If you don't know what happened, you cannot manage risk.
 
Elsmar Forum Sponsor

Ronen E

Problem Solver
Staff member
Moderator
#22
Hi,

You guys have been very productive while I was away... :)

Some general comments:

1. It's important not to confuse what a published standard requires (mandatory) with guidance it provides (optional) and what people - other than official auditors - think/say about it. In general, ISO 14971:2007 doesn't require any specific technique, eg FTA. I was really taken by the statement that that standard doesn't require an overwhelming amount of tedious work, because according to most of my clients that's exactly what it does, and I have to admit that except in trivial cases I agree...

2. Implants are somewhat different from other types of devices in that the implantation procedure can usually be seen as part of the device. Novel implant devices involve developing the procedure and educating the surgeons, and typically the manufacturer/developer will undertake that endeavour. The procedure then becomes an integral part of the IFU (user manual) issued by the manufacturer. In some (maybe most) cases implantation requires special tools that the manufacturer will develop, manufacturer and supply with the implant itself. So I guess that an ISO 14971 implementation considering an implant does need to consider the implantation procedure and the integral tools used, as sources of hazards, hazardous situations and resulting harms.

Now, specifically - I understand that the implant is already on the market / in clinical trials and we are discussing a retrospective risk analysis or an update. Correct? The way you describe the situation, a very significant increase in risk seems to be associated with the use of the implant, overall. This is under the assumption that the data is randomized - if only patients already at higher risk are elected to receive the implant, that can account for some of or all the difference. It is very important to establish causality and not just correlation. Any way, if the risk increase is fully / mostly attributable to the device use (including implantation) then yes, all aspects of it should concern the manufacturer. The key word in my previous comment was independent.
 

Ronen E

Problem Solver
Staff member
Moderator
#23
If you don't know what happened, you cannot manage risk.
Marcelo,

My initial response to that statement is disagreement (respectful :)), and honestly I'm a little surprised that you made it because you've already brought to our attention the issue of uncertainty in risk management.

In my understanding we should be able to manage risk in uncertain conditions, ie even if we're not fully informed about each and every step in the chain of events. That's the whole point of risk management. I also think that ISO 14971 doesn't do a bad job in providing a workable framework for handling such uncertainty.

I'd say the solution would be to go one level up. If we don't know what particular type of embolism has caused the stroke, we should treat them all together. Of course it might push us towards more crude mitigation means, but that doesn't mean we can't analyse the risk and reduce it if required. Ideally we would pin-point the problem and try to tailor a perfect, elegant solution, but unfortunately that's not always possible.

More generally, I see formal risk management as a rational, methodical examination of the state of things, then making decisions and taking action to change that state of things from overall unacceptable to acceptable risk. I think that this can be done whether we have a full knowledge / understanding of every little detail, or not. The difference would be mostly in the efficiency / elegance of our action.
 

Marcelo

Inactive Registered Visitor
#24
My comment was in a more general way, trying to mean that, if you have no idea of the situation, you cannot manage risk.

ISO 14971 is mostly a scenario-based risk management system. You do have to model a scenario. If you do not know the scenario, you cannot manage risk per ISO 14971.

You do not have to know in detail everything within the model of a scenario (and the less you know, the more uncertain are the estimates), but you do have to have a scenario model.

If you lack thing likes the link between the device and how it is part of the scenario, you cannot manage device risk.

More generally, I see formal risk management as a rational, methodical examination of the state of things, then making decisions and taking action to change that state of things from overall unacceptable to acceptable risk. I think that this can be done whether we have a full knowledge / understanding of every little detail, or not. The difference would be mostly in the efficiency / elegance of our action.
Sure (although I disagree a little with part of the statement), but the risk of what? If that's the risk to patient harm in which the device is/might be involved, unless your scenario includes the device, it does not make sense to do device risk management per ISO 14971. That's my problem with the comment on noncompliance to medication, for example.

Also, take the comment for implantation. Implantation itself is not the problem (unless there's a problem 'during"the implantation), but what happens next after the device is implanted. Sure, in a cardiovascular device, stroke is a risk and may be related to the device (in this particular case you would need a clinical trial to verify those adverse events and the link to the device, before that, there's no way you can finish you risk management related to this aspect), but in other implanted devices, a stroke might not be a risk. Again, it all goes back to the scenario.
 

Ronen E

Problem Solver
Staff member
Moderator
#25
Of course you have to hypothesise a scenario and the device has to be a part of it. What I meant is that you don't necessarily have to have all the information about the scenario (we seem to agree about that). You can overcome some missing knowledge by using a more crude description of the scenario.

If we continue the cardiovascular stent example, an embolism may be associated with the device implantation through damage to blood vessel walls during implantation (scenario 1a), through release of preexisting plaque during implantation (scenario 1b), through facilitating accelerated plaque growth on it (scenario 1c) or through some other scenarios. As stated by the OP, when a stroke occurs in a patient post implantation, it's sometimes (usually?) impossible to determine the exact nature of the embolism and/or how it came into being. This is what I referred to by incomplete knowledge. Either way, we could instead address "scenario 1" which would be the sum, or higher level description, of scenarios 1a, 1b, 1c and so on. This is a compromise in the ISO-14971-style risk management process, but in my opinion not an overwhelming one. The process might still conclude effectively (though maybe less efficiently) with the risk brought down to an acceptable level.
 
Last edited:

Marcelo

Inactive Registered Visitor
#26
But then scenario 1 would be what? Implantation? If so, this could happen with any implantation, not of the device only. And this would go back to what I mentioned, how would you link the device?

Anyway, maybe the problem has a different origin. The ISO 14971 scenario-based model (which is depicted in Figure E.1), although it can include any risk in principle, is obviously more related to technological risk (and in fact it's even lacking some specificities, see attached for the inclusion of "hazardous event", which is what other IEC standards do).

With this in mind, the "clinical risks"which we are discussing may not easily fit the model. This is clear when we go back to the discussion of probabilities the OP mentioned. Is it worth, or is it even possible, to define specific probabilities for each event in the sequence of events, even if know the events? The problem with this is that there might be too much factors that may influence the probabilities that cannot or a much difficult to take into account (for example, the influence os different drugs).

From my experience, generally what is done is that the risk in those cases is viewed in a more general way (and this fit into the idea of a higher level description) BUT the probabilities can only be verified thru clinical trials, and even then, they might not in the end be clearly related to the device (but the manufacturer would use the clinical trial information to give information for the user/patient to enable them to perform a informed clinical risk-based decision).

This is not prevented by ISO 14971, but clearly does not fit scenario-based model of Figure E.1.
 

Attachments

Last edited:

Marcelo

Inactive Registered Visitor
#27
This I also the same reason that techniques such as FMEA, FTA and the like don't fit too well with clinical risks. These techniques are failure analysis techniques created for mechanical/electrical systems.
 

indubioush

Quite Involved in Discussions
#28
Hi,
Now, specifically - I understand that the implant is already on the market / in clinical trials and we are discussing a retrospective risk analysis or an update. Correct? The way you describe the situation, a very significant increase in risk seems to be associated with the use of the implant, overall. This is under the assumption that the data is randomized - if only patients already at higher risk are elected to receive the implant, that can account for some of or all the difference. It is very important to establish causality and not just correlation. Any way, if the risk increase is fully / mostly attributable to the device use (including implantation) then yes, all aspects of it should concern the manufacturer. The key word in my previous comment was independent.
To answer your questions, yet, this is regarding a device that has already gone through a clinical trial; however, the hazardous situations I mention are only loosely based on the actual clinical risks. This is a device in which there is a lot of clinical data and information available from similar devices, standards, journal articles, etc. The rate of certain clinical events is known. It is a life saving device that is considered high risk because of adverse events associated with its use (in both fault and non-fault conditions). As the manufacturer, we are required to always consider these clinical adverse events when doing a risk/benefit analysis. There are some clinical events in which there is no way to reduce risk, but we still must justify them compared to the life-saving benefit and also compared to other similar devices.

These clinical events that occur under normal use would not be listed in any FMEA. They would be listed in other risk analysis documentation though, and there are ways that some of the risks could be reduced. For example, if we discover that a certain set of the patient population has a much greater chance of developing a stroke. We may specifically exclude those patients from the target patient population. If a physician then decides to go ahead and implant the device in one of those patients, this would be considered off-label use.

I agree with Ronan in that for many of these clinical events we do the best we can when writing down the hazardous situations and estimating the probability of harm.
 

Ronen E

Problem Solver
Staff member
Moderator
#29
But then scenario 1 would be what? Implantation? If so, this could happen with any implantation, not of the device only. And this would go back to what I mentioned, how would you link the device?
(The following are just initial thoughts for discussion sake. For clinical validity - which is not the focus here - subject-matter expertise would be required, so it must be sought and engaged in real life risk management).

Scenario 1 would be the release of an embolism into the blood stream as a result of implanting the stent, then travelling to the brain and causing a stroke. The hazardous situation probability would be the aggregate probability of all the sub-hazardous-situations ( as in 1a, 1b, 1c...) and the harm realisation probability (what you refer to as the hazardous event probability) could be estimated based on emboli size distributions and the likelihood of any such embolism traveling from the implantation site to the brain (or any other anatomical site of interest). True, it's a more crude analysis (as I already stated more than once), but it's a way of addressing uncertainty. In my opinion it's much better than stating "we can't manage the risk at all because of uncertainty".
 

Ronen E

Problem Solver
Staff member
Moderator
#30
To answer your questions, yet, this is regarding a device that has already gone through a clinical trial; however, the hazardous situations I mention are only loosely based on the actual clinical risks. This is a device in which there is a lot of clinical data and information available from similar devices, standards, journal articles, etc. The rate of certain clinical events is known. It is a life saving device that is considered high risk because of adverse events associated with its use (in both fault and non-fault conditions). As the manufacturer, we are required to always consider these clinical adverse events when doing a risk/benefit analysis. There are some clinical events in which there is no way to reduce risk, but we still must justify them compared to the life-saving benefit and also compared to other similar devices.

These clinical events that occur under normal use would not be listed in any FMEA. They would be listed in other risk analysis documentation though, and there are ways that some of the risks could be reduced. For example, if we discover that a certain set of the patient population has a much greater chance of developing a stroke. We may specifically exclude those patients from the target patient population. If a physician then decides to go ahead and implant the device in one of those patients, this would be considered off-label use.

I agree with Ronan in that for many of these clinical events we do the best we can when writing down the hazardous situations and estimating the probability of harm.
To me you seem to be on track on most of the issues :agree1:

Are there still any unanswered questions? :confused:
 
Thread starter Similar threads Forum Replies Date
T How do you define your Hazards? <a Risk Management discussion> ISO 14971 - Medical Device Risk Management 16
alonFAI How to define a Risk Based Approach for Supplier Management per ISO 13485:2016 ISO 13485:2016 - Medical Device Quality Management Systems 1
V How to define Risk Acceptance Criteria? ISO 13485:2016 - Medical Device Quality Management Systems 3
B Define Fault, Double Fault and Normal Conditions - Preparing a Risk Management File FMEA and Control Plans 1
R How to define risk levels in an audit - Is a Major critical? General Auditing Discussions 7
A Define timeline for Major and Miner Audit finding General Auditing Discussions 4
M Define voltage and frequency to perform tests 61010-1 and 61326-1 for CE certification CE Marking (Conformité Européene) / CB Scheme 4
I Sampling processes - Who must define the AQL level? AQL - Acceptable Quality Level 9
V Who should define and own the Design and Development Plan and how to maintain the updates and revisions. ISO 13485:2016 - Medical Device Quality Management Systems 2
S API Spec Q1 - How to define Management Representative competency for QMS Oil and Gas Industry Standards and Regulations 12
M How To Define ISMS (information Security Management System) Scope IEC 27001 - Information Security Management Systems (ISMS) 18
K How to define Expected life service life of medical device Other Medical Device Related Standards 4
S How to Define Importers under EU MDR / Brexit EU Medical Device Regulations 3
M Should Potential Customer Complaint Outcome Define Registrar NC Rating? ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 8
K ISO 9001:2015 clause 9.2.2 a. - Define the audit criteria and scope Internal Auditing 2
Q QI Macro Histogram - Can someone define *sorted data*? Capability, Accuracy and Stability - Processes, Machines, etc. 7
H How to define Root Cause when some points are out of control chart Statistical Analysis Tools, Techniques and SPC 6
M SOP or template for a study to Define Storage Conditions of Orthopaedic Implants EU Medical Device Regulations 3
D Definition Client - How does the government define their clients? Definitions, Acronyms, Abbreviations and Interpretations Listed Alphabetically 1
G How to define the scope of QMS as per ISO 9001:2015 ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 21
R How to define QMS certification scope statement? ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 11
R Review of "Key Data" for contract labs, but SOP doesn't define "key data". Problem? Pharmaceuticals (21 CFR Part 210, 21 CFR Part 211 and related Regulations) 2
G Procedure to define Signing Authority for Procurement Limits ISO 13485:2016 - Medical Device Quality Management Systems 2
P Can a company define new quality standards for special industry ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 2
L Are there any requirements to define barcode requirements ? Misc. Quality Assurance and Business Systems Related Topics 2
X How to define Calibration Acceptance Criteria General Measurement Device and Calibration Topics 3
H ISO 17025 - How to define a "Test Equipment" ? ISO 17025 related Discussions 2
J Where do you define Internal Auditor qualifications? Internal Auditing 9
V Is there an approach to define the "must 'or' should" in supplier audits? US Food and Drug Administration (FDA) 2
T Internal Audit - How to define the Importance of Departments and Processes Internal Auditing 8
T Help me understand how to define Processes ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 40
L How to define R & D Receiving (Incoming) Inspection Plan Design and Development of Products and Processes 18
B How to define and implement Configuration Management Document Control Systems, Procedures, Forms and Templates 5
C How to Define and Document Controls of Outsourced Processes Food Safety - ISO 22000, HACCP (21 CFR 120) 5
S Please help me define training requirements for a Career in Regulatory Affairs 21 CFR Part 820 - US FDA Quality System Regulations (QSR) 2
K How to define the Acceptances Criteria for all equipment? Manufacturing and Related Processes 7
L Definition Program - How do you define Program with regard to ISO 9001? Definitions, Acronyms, Abbreviations and Interpretations Listed Alphabetically 3
A Supplier Evaluation SOP - How do I Define Major and Minor Suppliers? Supplier Quality Assurance and other Supplier Issues 14
Q Where to define Authorities and Responsibilities in Documentation? ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 1
J Define Energy Used/Delivered - Applicable to Electrical or Mechanical Power or both? 21 CFR Part 820 - US FDA Quality System Regulations (QSR) 1
R 820.50 (A) (2)Define the Type and Extent of Control to be exercised over Vendor Misc. Quality Assurance and Business Systems Related Topics 5
A Where to define Process Tailoring Form used in CMMI in the ISO 9001 Quality Manual? ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 5
Q Criteria to define QMS processes in ISO/TS 16949:2009 IATF 16949 - Automotive Quality Systems Standard 23
S How to define New Equipment? Device is Returned, Refurbished or Repaired Misc. Quality Assurance and Business Systems Related Topics 3
C Controlling Documents: Beyond the standard, how do we truly define what to control ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 9
C How to define Process Special Characteristics (SC) FMEA and Control Plans 4
kedarg6500 What is the meaning of "define/defined" in ISO 9001? ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 19
Crusader Local Control Document procedure....define it or not? Document Control Systems, Procedures, Forms and Templates 24
M Excel Templates for Plan & Define Phase in NPI Process for Tire Manufacturer Excel .xls Spreadsheet Templates and Tools 1
R Define Data from Taguchi to Response Surface Methodology in Minitab Using Minitab Software 2

Similar threads

Top Bottom