IEC 60601 - Limits of agreement as Essential Performance

MedicalResp

Starting to get Involved
#1
Hi All,

Supposedly I have a medical device that measures and logs respiratory rate (it is not defined as an Alarm Monitor).

The efficacy of the device in clinical testing is determined with respect to a gold standard measurement (i.e by comparing the respiratory rate measured by the test device an a gold standard method). This is commonly done using a statistical method called BLAND ALTMAN which, in short, provides one with the "mean bias" between the two methods and the limits of agreement (i.e. the limits where 95% of the data will fall with 95% confidence)

For IEC 60601 one must define the Essential Performance which is the clinical function where loss or degradation beyond the limits results in an unacceptable risk.
During the safety and EMC testing we use a simulator that simulates respiration in a constant rate and we measure the respiration rate.

My question is if it is logical to use the same parameter used in the clinical testing - "limits of agreement = +/-X" as the essential performance, thus preforming a statistical post-analysis of the data collected during the safety&EMC tests making sure it does not exceed the pre-defined limits +/-X.

Thanks in advance.
 
Elsmar Forum Sponsor

yodon

Staff member
Super Moderator
#2
Not to sidetrack the question but if the device did fail, what is the unacceptable risk that would be realized? (The main point being that some devices do not have Essential Performance.)
 

MedicalResp

Starting to get Involved
#3
That is actually a good question.
Since respiratory rate is a vital sign and the device is intended for hospitals , it must be defined as a medical device.
The risk here is that in a case of performance degradation, the medical staff would receive an unreliable clinical information. Although, in the current scenario it would be used in conjunction with other type of clinical information, it still might result in an unsuitable medical care.

The issue I have raised is due to the fact that we must define limits of "accuracy" for the EP of measuring respiratory rate.
Since for our device there is no guiding standard as opposed pulse-oximeter ( IEC 80601) which defines the accuracy, the question is what type of "accuracy" estimate would be most reasonable/accceptable to use.

If, for example, we say that the respiratory rate accuracy is +/- 10% then the immediate question would be how to calculate this, as we might get up to 60 respiratory rate value per minute. Does each value must be +/-10% with respect to the reference or would it be more logical to use a statistical analysis (like i suggested or other) over the duration of the test (e.g. EMC )
 

Peter Selvey

Staff member
Super Moderator
#4
While there is a lot about "essential performance" which is nonsensical, there's actually a common sense bit at the end of the clause that says:

"Where this standard requires that ESSENTIAL PERFORMANCE is to be maintained following a particular test, compliance is checked by inspection and, if necessary, by functional test(s) that demonstrate the MANUFACTURER'S specified limits are maintained or the ME EQUIPMENT or ME SYSTEM transitions to a safe state as defined by the MANUFACTURER."

So, for example a water proof test shows that no water got anywhere near the electronics involved with measurement of respiration, then no need to test essential performance.

On the other hand another test might feasibly affect the electronics (say low or high temperatures?) you could devise a simulator test that gives reliable results that would allow you to detect if the electronics has been affected.

In other words, you can tailor the "functional tests" to suit. It does not need to be the full evaluation (e.g. multiple samples, statistical analysis) every time the standard calls out essential performance.

This does though highlight one huge oversight in the standard in that there is no baseline test to establish essential performance in a set of reference conditions. In practice, a manufacturer would do the more detailed baseline test first and then start to throw various "stress tests" such as EMC, water ingress, normal temperatures, storage, vibration, ageing, thermal shock, defib etc, and verify that nothing changed, usually by inspection or simplified tests based on the nature of "stress" being applied.

Also, in the case of a simplified test, it is normal to run the that test first to set a baseline, and possibly apply stricter limits than are defined in the essential performance, in order to detect whether the "stress" caused any variations. A fail result for this stricter limit should either trigger more detailed tests or investigate/eliminate the cause of the variation.

Anyway, without establishing a baseline the whole logic of tailoring the test to suit falls down. Even the above example of the waterproof test falls down logically if essential performance was never established in the first place.
 
Thread starter Similar threads Forum Replies Date
D IEC 60601-1 - Performance limits for essential performance IEC 60601 - Medical Electrical Equipment Safety Standards Series 4
JoCam IEC 60601-1 and 60601-1-2 retest after PCBA change IEC 60601 - Medical Electrical Equipment Safety Standards Series 3
K IEC 60601-1:2005/AMD2:2020, Why this standard version is 3.0? IEC 60601 - Medical Electrical Equipment Safety Standards Series 2
C IEC 60601 - 8.8.3 Dielectric Strength test. 4kv being applied to the ground conductor?! IEC 60601 - Medical Electrical Equipment Safety Standards Series 2
R IEC 60601-1 Clause 15.3.2, Push test IEC 60601 - Medical Electrical Equipment Safety Standards Series 0
A Defining a lower ESD test level in IEC 60601 safety test IEC 60601 - Medical Electrical Equipment Safety Standards Series 5
J IEC 60601-1-11 Home Class II With Ballasts IEC 60601 - Medical Electrical Equipment Safety Standards Series 3
A Coverage and differences: EN 60601-1:2006+A12:2014 Vs AAMI/IEC 60601-1:2005+AMD1:2012 IEC 60601 - Medical Electrical Equipment Safety Standards Series 2
T IEC 60601-1-8:2020 Is it necessary to change the alarm melody? IEC 60601 - Medical Electrical Equipment Safety Standards Series 1
M Is it normal / sufficient to have only the IEC 60601-1-2 test report without indicating IEC 60601-1? IEC 60601 - Medical Electrical Equipment Safety Standards Series 2
S IEC 60601-2-30 - Is it mandatory to claim alarms? IEC 60601 - Medical Electrical Equipment Safety Standards Series 1
Y Auditory alarm standard IEC 60601-1-8 Reliability Analysis - Predictions, Testing and Standards 0
R IEC 60601-1 - Power Supply Cords (Section 8.11.3.1) IEC 60601 - Medical Electrical Equipment Safety Standards Series 2
A Outsourcing IEC 60601-1 Ed 3.2 Testing IEC 60601 - Medical Electrical Equipment Safety Standards Series 0
R Complex IEC 60601-1 gap assessment IEC 60601 - Medical Electrical Equipment Safety Standards Series 0
D SINGLE FAULT CONDITION, short circuit and open circuit of any component (IEC 60601-1 3.1) IEC 60601 - Medical Electrical Equipment Safety Standards Series 9
H IEC 60601-1 ME equipment or ME system IEC 60601 - Medical Electrical Equipment Safety Standards Series 2
M How does IEC-60601-1 apply to a non-medical device in the patient vicinity? IEC 60601 - Medical Electrical Equipment Safety Standards Series 1
R IEC 60601-1 - 11.1.3 e) Test criteria - Temperature Measurements IEC 60601 - Medical Electrical Equipment Safety Standards Series 2
R IEC 60601-1 - Magnesium oxide used for the electrical insulation of heating elements IEC 60601 - Medical Electrical Equipment Safety Standards Series 3
M Is IEC 60601-1-2 required by FDA for all electronic medical devices? IEC 60601 - Medical Electrical Equipment Safety Standards Series 1
Z IEC 60601-2-25; Frequency response test Medical Device and FDA Regulations and Standards News 1
N IEC 60601-1-1 - Stress test, reference voltage IEC 60601 - Medical Electrical Equipment Safety Standards Series 2
R IEC 60601-1:2005+AMD1:2012+AMD2:2020 CSV IEC 60601 - Medical Electrical Equipment Safety Standards Series 1
B IEC 60601 - Creepage Distance - Relay that acts as a means of physical mechanical protection Process Maps, Process Mapping and Turtle Diagrams 0
T Single Fault Condition IEC 60601 Clause 8.7.1 shorting Cr/Cl in Patient Applied Part IEC 60601 - Medical Electrical Equipment Safety Standards Series 7
M What to Expect from Next IEC 60601-1 and IEC 60601-1-2 Amendments? IEC 60601 - Medical Electrical Equipment Safety Standards Series 7
D IEC 60601-1 - Service life testing IEC 60601 - Medical Electrical Equipment Safety Standards Series 8
R Hand transmitted vibration 9.6.3 of IEC 60601-1 IEC 60601 - Medical Electrical Equipment Safety Standards Series 4
A IEC 60601 11.2.2.1 Risk of Fire in an Oxygen Rich Environment, Source of Ignition IEC 60601 - Medical Electrical Equipment Safety Standards Series 0
E PEMS Hazards - IEC 60601 Clause 14.6 - Internal data use - Pressure sensor IEC 60601 - Medical Electrical Equipment Safety Standards Series 3
W IEC 60601 - Essential performance c.2.34 IEC 60601 - Medical Electrical Equipment Safety Standards Series 2
B IEC 60601-2-43 - Clause 203.6.103 - Physical button? IEC 60601 - Medical Electrical Equipment Safety Standards Series 1
M IEC 60601-1 1988 - Device developed in 2012 with standard of 1988 IEC 60601 - Medical Electrical Equipment Safety Standards Series 2
A IEC 60601-1 Dielectric Strength test for battery operated devices IEC 60601 - Medical Electrical Equipment Safety Standards Series 3
E IEC 60601-1 - Unearthed Medical Device Metal Parts IEC 60601 - Medical Electrical Equipment Safety Standards Series 1
JoCam Failure to test Class I medical device to IEC 60601-1-11 IEC 60601 - Medical Electrical Equipment Safety Standards Series 2
R IEC 60601-1 - Different methods of achievement of the isolation IEC 60601 - Medical Electrical Equipment Safety Standards Series 1
K What is mean by Oxygen Rich Environment as per the IEC 60601-1 clause no 11.2.2 IEC 60601 - Medical Electrical Equipment Safety Standards Series 5
K Dielectric strength test as per IEC 60601-1 -Infant incubator IEC 60601 - Medical Electrical Equipment Safety Standards Series 2
A Unused SIP/SOPs - IEC 60601-1 and IEC 60601-1-2 IEC 60601 - Medical Electrical Equipment Safety Standards Series 1
K Proper document of SMPS used in infant warmer for IEC 60601-1 testing IEC 60601 - Medical Electrical Equipment Safety Standards Series 1
K Sequence of testing in IEC 60601-1 IEC 60601 - Medical Electrical Equipment Safety Standards Series 2
B IEC 60601-2-10 - Accuracy of Pulse Parameters - Required Measurement Uncertainty IEC 60601 - Medical Electrical Equipment Safety Standards Series 3
B Has anyone done an IEC 60601-1 gap analysis to IEC 60335? Medical Device and FDA Regulations and Standards News 4
K Question on whether IEC 60601-2-62 standard is applied IEC 60601 - Medical Electrical Equipment Safety Standards Series 4
DitchDigger IEC 60601-1 subclause 5.1 - Adequate evaluation in lieu of testing IEC 60601 - Medical Electrical Equipment Safety Standards Series 2
B IEC 60601 Cl. 8.4.3 - ME EQUIPMENT intended to be connected to a power source by a plug / Plug discharge IEC 60601 - Medical Electrical Equipment Safety Standards Series 3
B Transformer Requirements - IEC 60601-1 vs. IEC 61558-2-15 IEC 60601 - Medical Electrical Equipment Safety Standards Series 0
T Clearance and Creepage according to Subclause 8.9.1 for MOPP IEC 60601-1 IEC 60601 - Medical Electrical Equipment Safety Standards Series 4

Similar threads

Top Bottom