Rounding the Numerical Value of the Measurement Uncertainty

N

neoth

#1
Hi all,

eg. 0.4/1.732=0.231

base on the statement "if the rounding brings the numerical value of the uncertainty of measurement down by more than 5%, the ROUNDING UP value should be used."

if i want to round to 1 decimal place, what should be the value? please let me know how do you work it out.

thanks in advance



 
Elsmar Forum Sponsor

Stijloor

Staff member
Super Moderator
#2
Hi all,

eg. 0.4/1.732=0.231

Based on the statement "if the rounding brings the numerical value of the uncertainty of measurement down by more than 5%, the ROUNDING UP value should be used."

if i want to round to 1 decimal place, what should be the value? please let me know how do you work it out.

thanks in advance
Can someone help?

Thank you very much!!

Stijloor.
 
D

dv8shane

#3
Hi all,

eg. 0.4/1.732=0.231

base on the statement "if the rounding brings the numerical value of the uncertainty of measurement down by more than 5%, the ROUNDING UP value should be used."

if i want to round to 1 decimal place, what should be the value? please let me know how do you work it out.

thanks in advance



Hi Neoth,

5% of this measurement uncertainty contributor of 0.231 is 0.012 therefore the answer is 0.3. In truth you should not be rounding until the all the contributors have been accounted for and then express the result with the correct amount of significant digits see this http://en.wikipedia.org/wiki/Significant_figures.
 
Thread starter Similar threads Forum Replies Date
B Rounding Numerical Values Up or Down with respect to the number of Significant Digits Measurement Uncertainty (MU) 9
M Measurement Unit Rounding Nonconformity - Notified Body Audit Registrars and Notified Bodies 6
R Standard for Rounding Measurements for Labels Other Medical Device Related Standards 9
A Significant Figures and Rounding SOP Document Control Systems, Procedures, Forms and Templates 4
J Rounding at the Gas Pumps Coffee Break and Water Cooler Discussions 27
B Conversion and Rounding Standard for converting metric to english and vice versa Other ISO and International Standards and European Regulations 4
P Rounding Uncertainty to Zero on a Calibration Certificate Measurement Uncertainty (MU) 7
D Rounding Numbers - Adding numbers in Excel - I want the average Excel .xls Spreadsheet Templates and Tools 3
H Rounding up Measurement results - Is it still within specification limits? Inspection, Prints (Drawings), Testing, Sampling and Related Topics 26
D Interesting Discussion Is "rounding" acceptable when measuring parts? Tolerance Limits - What is acceptable? Quality Tools, Improvement and Analysis 72
F 1. Suggest a Gage for Checking Rounding of Gears 2. When to conduct Stability Study? Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 2
A Is there an SOP on Rounding Numbers Document Control Systems, Procedures, Forms and Templates 8
D Resolution V Factorial Design with 5 factors (3 numerical and two text) Using Minitab Software 1
K How do you convert Subjective Data into Numerical Data? Preventive Action and Continuous Improvement 11
A AS9100 7.5.1.3 Control of .... Numerical NC/CNC Machines Programs. AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 3
A Control of Production Equipment,Tools and Numerical Control (N.C.) Machine Programs AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 1
T MSA 3rd Edition Bias Analysis - p. 86, the new numerical analysis of results Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 2
S Process and system auditing - numerical score methods General Auditing Discussions 3
M Determining a tolerance value for Measuring devices in-house inspection General Measurement Device and Calibration Topics 12
Proud Liberal Improving low p-value Statistical Analysis Tools, Techniques and SPC 13
BeaBea Registrars with VAR (Value Added Reseller) experience Registrars and Notified Bodies 8
qualprod Best approach to get a real value as average? Statistical Analysis Tools, Techniques and SPC 6
F Missing value of Uncertainty B Measurement Uncertainty (MU) 10
F Calibration certificate content - Average Value and True Value ISO 17025 related Discussions 6
S In BAC5300 we have machining mismatch allowed is 3tau, what is the value of tau? Document Control Systems, Procedures, Forms and Templates 1
S Change value of target during a batch Capability, Accuracy and Stability - Processes, Machines, etc. 0
A Acceptance p-value for linearity and bias analysis in minitab results Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 0
A Torque Value for Different types of Fasteners (Socket Head, Button Head, CSK) Manufacturing and Related Processes 2
M IATF 16949 - 8.5.6.1.1 Providing a list of process controls: Does this requirement add value to QMS? IATF 16949 - Automotive Quality Systems Standard 4
qualprod Cycle times, value stream mapping, inventory, average values? Lean in Manufacturing and Service Industries 1
Ashok sunder What are the criteria for setting a target KPI value against a quality objective? Benchmarking 7
S Adding Value prior to signing EASA Form 1 EASA and JAA Aviation Standards and Requirements 5
M Creating a Plant Level Value Stream Map Process Maps, Process Mapping and Turtle Diagrams 1
A IMDS - Changing the Locked Weight Value RoHS, REACH, ELV, IMDS and Restricted Substances 1
T Value Chain Map for Food Services Industry Service Industry Specific Topics 1
O P-Value less than 0.05. but everything else in control Statistical Analysis Tools, Techniques and SPC 19
qualprod P x I = Value interpretation for residual risk? ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 1
O CPK with a P value less than 0.005 Manufacturing and Related Processes 8
G What degrees of freedom means in uncertainty budget and how do I set the value Measurement Uncertainty (MU) 2
Q Really do they add value (Vision, Mission, Values)? ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 1
D What is the exact Temperature Coefficient Value to be set on a Conductivity Meter? General Measurement Device and Calibration Topics 2
M Value Stream Mapping Calculations Process Maps, Process Mapping and Turtle Diagrams 5
L How to interpret the average R bar Value shown in the R Chart Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 2
G Non Value Added Corrective Actions IATF 16949 - Automotive Quality Systems Standard 15
R How To Calculate & Print CDF and Lower Bound CDF value for some t(time) with Minitab? Using Minitab Software 1
P Purpose of calculating Uncertainty value in calibration study Measurement Uncertainty (MU) 5
J Agenda of Value Stream Mapping workshop required Quality Tools, Improvement and Analysis 1
M What is the value of documenting in-process rework for easily-detectable issues? Quality Manager and Management Related Issues 4
R VSM - Value Stream Mapping (catheter manufacturing unit) Customer Complaints 10
W Quality for value adding or certification? ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 23

Similar threads

Top Bottom