The GUM (Guide of Expression of the Uncertainty) against the logic (?) - Acoustical

G

garcas

#1
Hi,

I am currently developing some models for evaluating the uncertainty of measurement in the calibration of acoustical instruments (sound level meters, SLM) conforming to the Guide of Expression of the Uncertainty (GUM).

Although we are talking about acoustical instruments, it is actually an electrical calibration. The calibration is made of several tests, some more complicated than others. In the simplest ones, we apply a stimulus (eg. a sinusoidal signal of certain amplitude and frequency) with a function generator to the SLM and then we check the instrument’s (SLM) response. From an uncertainty point of view, this kind of test does not present any inconvenient to me: I have identified all sources of uncertainty (signal generator’s accuracy, resolution and calibration information; SLM’s resolution; etc) and combined them to find the expanded uncertainty.

The problem arises with the “other” type of tests. In many cases, the tests are what we could call “differential” tests, which means that in those tests we don’t check for the instrument response to a single stimulus, but we check for the difference in the indication of the instrument to two consecutive (and possibly different) stimulus.

One clear example of this kind of test is the “differential linearity level test”. In this test we apply an stimulus S1 and register the SLM response R1. Then we apply a second stimulus S2 whose amplitude is 1 dB higher, and we register the SLM response R2. Then we have to check that the indication of the SLM has incremented in 1 dB (R2-R1=1 dB).

From a logical point of view, I would expect that in this kind of test the uncertainty should be lower than in the “simple tests”, because the systematic errors should be cancelled. But from a GUM point of view, it doesn’t seem to be true: I would have to combine the same sources of uncertainty twice (signal generator’s accuracy, resolution and calibration information; SLM’s resolution; etc), for the first measurement and for the second one. And this combination will be done in squares, so there will be no cancellation. What am I missing? Should I suppose that the two readings are completely correlated (in this case a subtraction term will appear)?

The thing is that in the documentation of a Bruel and Kjaer calibration system similar to mine, I read that the signal generator didn’t have to be calibrated because all measurements where “differential” (this is not 100% true, but almost). Does this mean, as I suspected, that systematic errors should cancel and thus errors from the generator would not contribute to the total measurement uncertainty?

Thanks for any help. I am quite desperate with this stuff.
 
Elsmar Forum Sponsor
R

Ryan Wilde

#2
Garcas,

Technically, the GUM is correct, except there are a few things that you can do to lower your uncertainty.

1. A 1 dB step from a modern function generator does not generally alter the attenuator setting (a major source for level uncertainty), unless it requires a range switch, and usually it only involves the leveling circuit.

2. The B&K procedure sounds as if it was monitoring the signal generator output with something along the lines of a AC Voltmeter, hence source accuracy is moot. That is actually the way that I would go. If you can get your hands on something with 6-1/2 digits or more with a good frequency range, you're golden. Since you will once again be in the same Voltmeter range, the baseline uncertainty cancels, and only the "PPM of Reading" would be correlated. Several voltmeters are actually specified separately for ratio - which is two measurements in a single range.

Hope this helps a bit,

Ryan
 
G

garcas

#3
Hi Ryan,

First of all, thanks for your help. It's the first time in weeks that I get some.

I agree with you that a 1 dB step usually does not alter the attenuator settings, so I guess in those cases linearity is the most important source of uncertainty in the generator. But the problem is that manufacturers usually give a single accuracy figure in their specifications, so when computing the uncertainty due to the generator I can not distinguish between the “attenuator uncertainty” and the “uncertainty due to linearity”.

I think it would be easier to work with an example. Let’s say my calibration consists of the following steps:
0. Connect the signal generator’s output to the sound level meter (SLM) electrical input.
1. Apply a sinusoidal signal of 94 dB to the SLM. The microphone sensitivity is 50 mV/Pa, so the generator should be configured to produce a sinusoidal signal of 50 mV.
2. Annotate the SLM’s indication (let’s say the indication is 94.1).
3. Apply a sinusoidal signal 10 dB higher: which means configuring the generator with a 158.5 mV signal.
4. Annotate the SLM’s indication (let’s say the indication is 104.5).
5. Check that the SLM’s response has incremented in 10 dB, with a tolerance of +/- 0.4 dB.

Thus, my variable is the difference in indication (104.5-94.1=10.4). So I would have to check that 10.4 +/- U lies within +/-0.4dB of the expected difference (10 dB). Then I have to calculate the uncertainty of measurement U. Here is my doubt and this is what I was trying to ask in my last post: do I have to take into account the accuracy specifications of the generator when calculating the uncertainty of this measurement?

My logic says no, or more accurate “not completely”. What I mean is that: the offset error of the signal generator would be cancelled between the two readings; but linearity and gain errors would not. The problem is that I only have a single accuracy specification figure for the signal generator: its accuracy. So what do I do? Do I use it or not? I think that if I apply the GUM I have to add the generator accuracy in squares, so there would be no cancellation. I only see a GUM case where there would be some short of cancellation: if we say that both measurements are correlated with a positive correlation coefficient.
 
R

Ryan Wilde

#4
Yes, you most definitely have to take your generator level accuracy into account. Actually, if you change the generator the 10 dB you cited in your example, the only amount of change that I can guarantee that you didn't have is exactly 10 dB. You will have to determine what the actual change is, or take the level uncertainty at face value, which is generally going to be an unreasonably large figure for your application.

You are correct that the positive correlation coefficient would be appropriate. The problem is that the coefficient is an unknown, because the function generator isn't spec'd for it. The only way to know would be to monitor it with a ac voltmeter to find out, in which case, you are probably better off using the uncertainty of the ac voltmeter (minus the noise floor spec, which DOES cancel out directly). If you monitor, you don't need to uncertainty of the generator, because you are monitoring it.

In short, unless you are monitoring the generator (HP 3458A, 34401A, or 3478A; Fluke/Wavetek/Datron 1281, etc. all have fairly low uncertainties with good frequency range) you have to either use the level uncertainty twice, perform tests on your generator to prove its gain and linearity error, or make an educated "guess" - which I wouldn't suggest.

Ryan
 
G

garcas

#5
Hi again,

That was really good, thank you. I think you are helping me a lot to find my way :D

The only way I think I could evaluate the correlation coefficient, would be by repeating several times this measurement and estimating it from the experimental results. Because the coefficient would depend on both the generator and the sound level meter (SLM) under test, isn’t it?

This would lower my uncertainty, but I would have to repeat each measurement several times, which means more calibration time (and I cannot afford that) :( .

So what about estimating the correlation coefficient from previous calibration data? Does it make sense? I have an historical of all calibrations I have perform until now, so maybe I could do an “off-line” estimation of the correlation coefficient for each generator-SLM pair and then use this to calculate the uncertainty.

This way I wouldn’t have to repeat each measurement several times, unless I would I have to calibrate a SLM that I haven’t calibrate yet. What do you think about this approach?

Thanks again Ryan… (and anyone else on this?)
Guillermo :bonk:
 
R

Ryan Wilde

#6
Guillermo,

Using past history will give you reproduceability (lack of variation over time), but will not show bias (is 10 dB actually 10 dB?).

For example, if my generator is actually supplying an 11 dB change, and my SLM is reading this as 10 dB, I might unwittingly call it in-tolerance. Next year, if my generator supplies 11.02 dB change, and my SLM reads 10.02 dB, I have fantastic reproduceability, but I am reproducing a false number.

Without knowing exactly what the generator is supplying, my data means very little, since the generator is not specified for that type of measurement. Hence, I monitor it with a piece of equipment that IS specified for that type of measurement, and transfer the accuracy to my supply, and therefore to my SLM.

Does that make sense?

Ryan
 
G

garcas

#7
Hi Brian,

I agree with you, but I think I am already having this in mind as I calibrate my generator once a year and this information is also included in my uncertainty budget.

The problem is about the correlation coefficient between 2 successive measurements. I wonder if I could estimate it from previous data or should I estimate it from repeated measurements.

Another problem I have is about how to include the systematic effect’s correction uncertainties according to GUM clause 4.1.4 when I have a non linear uncertainty model. I have already defined a model for evaluating the uncertainty of measurement in a simple test where I measure a certain quantity X. Then, I have to develop an uncertainty model for a second test where we measure a quantity Y = X1/X2, where X1 and X2 are the result of two measurements of the quantity X. According to the GUM (4.1.4 and H2 example) there are two approximations for this case (determination of the Y=X1/X2). I think I should use the second approximation in example H2, but I do not know how to include the systematic effect’s correction uncertainties in this approximation (the GUM says it should be included, but it does not say how to do it).

Guillermo
 
Thread starter Similar threads Forum Replies Date
B How to perform a MSA - GRR (Gage R&R) A&R/ANOVA Vs GUM/VDA Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 1
C Can anybody explain h.2 equation of GUM? Measurement Uncertainty (MU) 3
I How GUM Uncertainty is calculated and where I locate the multiplication factor b Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 1
G What is your favorite flavor of GUM? General Measurement Device and Calibration Topics 8
G How many Uncertainty Divisors are there for the GUM Application? Measurement Uncertainty (MU) 3
S Final draft Supplement 1 to the GUM Measurement Uncertainty (MU) 3
C GPS Gum Balls - High Speed Police Chases World News 4
S Requirements for "Claims Guide" for medical devices Medical Device and FDA Regulations and Standards News 6
H Can a calibration lab still use ISO 6789:2003 as guide for torque calibrations Other ISO and International Standards and European Regulations 1
D MDR 2017/745 Classification Guide EU Medical Device Regulations 8
M Informational MDCG 2019-9 Summary of safety and clinical performance A guide for manufacturers and notified bodies – August 2019 Medical Device and FDA Regulations and Standards News 0
D Standard guide for shelf life determination of non sterile component with degradation materials Reliability Analysis - Predictions, Testing and Standards 1
M Informational TGA – Medical device incident reporting (MDIR) guide Medical Device and FDA Regulations and Standards News 0
F EUDAMED UDI Medical Devices User's Guide Medical Device and FDA Regulations and Standards News 6
L I'm looking for Translation Procedure Guide MEDDEV 2.5/5 Rev.2 (NOT Rev.3) CE Marking (Conformité Européene) / CB Scheme 0
M Informational IMDRF final document – Assembly and Technical Guide for IMDRF Table of Contents Submissions Medical Device and FDA Regulations and Standards News 4
M Informational EC – Guide for referencing standards in public procurement in Europe (JIS Action 11) Medical Device and FDA Regulations and Standards News 0
O Guide on EMC for Functional Safety CE Marking (Conformité Européene) / CB Scheme 3
Q Practical guide to scan for Risks in all QMS systems without missing any ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 16
R Non-Conformity Report from Notified Body - MEDDEV Guide is not Legally Binding EU Medical Device Regulations 16
J ISO 17025 Guide and Ideas for a New Calibration Business ISO 17025 related Discussions 18
A Plastic Injection Molding Process Troubleshooting Guide Manufacturing and Related Processes 1
F Distributors Audit guide Supplier Quality Assurance and other Supplier Issues 4
Sean Kelley Seeking Feedback on ASQ Guide to Failure Mode and Effect Analysis FMEA and Control Plans 2
D Looking for the FDA's Small Entity Compliance Guide 21 CFR Part 820 - US FDA Quality System Regulations (QSR) 6
N ISO 20000 Implementation Guide and Compliance Checklist wanted IT (Information Technology) Service Management 2
E Where to get a GagePack 2000 User Guide Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 3
A A Guide to Effective Internal Management System Audits Book, Video, Blog and Web Site Reviews and Recommendations 2
CharlieUK New EU Commission "Blue Guide" to CE Marking - 2014 CE Marking (Conformité Européene) / CB Scheme 2
automoto International Problem Solving Guide Problem Solving, Root Cause Fault and Failure Analysis 2
M A Guide or Standard for Calibration Interval (Frequency) Calibration Frequency (Interval) 2
AnaMariaVR2 The Essential Guide to Combination Products cGMPs Pharmaceuticals (21 CFR Part 210, 21 CFR Part 211 and related Regulations) 0
J Free Improvement Guide provided by USCG Book, Video, Blog and Web Site Reviews and Recommendations 9
A Exploding the Myths Surrounding ISO 9000: A Practical Implementation Guide Book, Video, Blog and Web Site Reviews and Recommendations 28
T The Consultants Guide to Successfully Implementing 5S review Book, Video, Blog and Web Site Reviews and Recommendations 1
J What Standard/s can a tourist guide be certified to? Service Industry Specific Topics 4
Marc Guide To Inspections Of Medical Device Manufacturers - 1997 (06/08/2010) US Food and Drug Administration (FDA) 3
A CATERPILLAR BGPP (Benchmarking Guide for Painting Process) Questionnaire Customer and Company Specific Requirements 4
AnaMariaVR2 Guide to Microsoft Excel for Calculations, Statistics, and Plotting Data Excel .xls Spreadsheet Templates and Tools 11
M Need practical guide on TS 16949 Clause 7.6 Requirement IATF 16949 - Automotive Quality Systems Standard 1
M Shingo Prize Model as an Assessment Guide for Lean Implementation Lean in Manufacturing and Service Industries 1
Q Quick Guide - Processes vs. ISO 9001 Clauses? ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 9
J 3-Legged 5 Whys - Help guide for Internal Corrective Action System Nonconformance and Corrective Action 2
Sidney Vianna ISO/IEC Guide 63:2012 - Medical Device Safety Aspects Other Medical Device Related Standards 1
automoto How ISO 9001 could look in the future - ISO 9001 revision (Guide 83) ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 4
Sidney Vianna ISO/IEC Guide 63:2012 - Safety Aspects in International Standards for Medical Devices Other Medical Device Related Standards 1
T ASQ Certification Testing Book and Study Guide recommendations wanted Book, Video, Blog and Web Site Reviews and Recommendations 7
Stijloor Simple Navigation Guide for the MSA 4th Edition Manual Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 0
B FORD CPA (Capacity Planning Analysis) User Guide for Suppliers Customer and Company Specific Requirements 13
S ISO/IEC Guide 51: 1999, Safety Aspects - Guidelines for their inclusion in standards Food Safety - ISO 22000, HACCP (21 CFR 120) 4

Similar threads

Top Bottom