What are the uncertain digits of a 1/64" calibrated ruler?

P

potato

#1
What are the uncertain digits of a 1/64" calibrated ruler?

There are two schools, I think:

1) person measuring can estimate between markings. Since 1/64"=.015625, and as a rule of thumb (?) the error on a ruler is half of the markings is .0078125, the 3 digit is uncertain. So, a reading of 1/64" would equal .016".

2) Since 1/64"=.015625", and the error is .0078125, then if you add and subtract the error to 1/64", you could get readings of .0078125 to .0234375. In this case, the first digit is certain, and the second is uncertain. So, a reading of 1/64"=.02".

So, which is it?
 
Elsmar Forum Sponsor
N

Norml1

#2
Re: uncertain digits of a 1/64" ruler?

When recording observed values, the number of digits to be recorded are all exactly known digits plus one additional digit that can be reasonably estimated, otherwise the reading is recorded to the nearest graduation.
 

normzone

Trusted Information Resource
#3
The measurement should be reported as follows:

Let's say the observed measurement is in between 7/64 and 8/64.

The measurement should be reported as 7/64 +

All else is interpolation and estimation.
 
N

Norml1

#4
Interpolation and estimation should be fine when using a ruler, in my estimation! It certainly depends on how inspectors have been trained on the use of measuring equipment and recording of data.
 

normzone

Trusted Information Resource
#5
I prefer to call them as I can defend them. I've met too many wannabe metrologists willing to demonstrate that they can hold a ruler better than anybody else, contact error and parallax error be damned.

:nope:
 
Last edited:

Hershal

Metrologist-Auditor
Trusted Information Resource
#6
For line width as a Type B, I agree with potato. However, parallax has also been brought in, a Type B, plus the uncertainty from any previous calibration it may have had. Additionally, temp and RH must be considered as Type B contributions as rulers will change. For a metal ruler, one has the thermal coefficient of expansion/contraction for the metal. Thus, the contributions can get complex.

However, the key is whether the change is significant enough to see.
 
B

bbrewington

#7
Shouldn't you do a Gage R&R study with some samples to determine the actual error inherent in the user-ruler-sample system? Maybe you could estimate the error, but this would allow you to experimentally verify the error.
 
Thread starter Similar threads Forum Replies Date
SteelMaiden Job Security in Uncertain Times Career and Occupation Discussions 26
O 14-digits UDI EU Medical Device Regulations 3
L What are the rules on significance of digits in numbers in IEC/ISO standards? IEC 60601 - Medical Electrical Equipment Safety Standards Series 5
F DMM - Capacitance - +/- % of reading + digits? Measurement Uncertainty (MU) 3
5 Number of 'significant digits' in measurements Inspection, Prints (Drawings), Testing, Sampling and Related Topics 31
B Rounding Numerical Values Up or Down with respect to the number of Significant Digits Measurement Uncertainty (MU) 9
G Explanation of Rule of Thumb (10:1) - Tolerance Zone or Digits Number Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 3
D Drafting Conventions per ASME Y14.5m - Three significant digits rule Various Other Specifications, Standards, and related Requirements 12
L How many digits should be used when measuring density? Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 5
V Significant digits when reporting measurements Inspection, Prints (Drawings), Testing, Sampling and Related Topics 4
Q Does a gage used for a visual verification need to be calibrated? Manufacturing and Related Processes 7
T Disposable Calibrated Items? General Measurement Device and Calibration Topics 5
D Is a lost calibrated tool an non-conformance for an audit? AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 58
D Filling totes and pails - when is a calibrated scale / flowmeter required in ISO 9001 General Measurement Device and Calibration Topics 4
S Requirements for ANSI Z540.3 Compliance as End User of Calibrated Instruments AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 0
R Transferring a calibrated counting scale to a sister company Calibration Frequency (Interval) 2
J Gear Surface Finish - Print with the word "calibrated" Manufacturing and Related Processes 2
M What kind of instrument that must be calibrated? General Measurement Device and Calibration Topics 3
G Can calibrated device values be used instead of manufacturers spec? General Measurement Device and Calibration Topics 2
M Where to obtain a calibrated DICOM image? ISO 13485:2016 - Medical Device Quality Management Systems 1
Q Calibrated Equipment Managment Software Suggestions General Measurement Device and Calibration Topics 12
J Calibration Justification - Requirements for Measurement with a Calibrated Device General Measurement Device and Calibration Topics 1
O Storage of Calibrated Tools General Measurement Device and Calibration Topics 12
I Uncalibrated source to calibrated meter, then compare to UUT General Measurement Device and Calibration Topics 4
K Looking for Calibrated Tool Shadowboard Substrate Ideas AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 5
N Calibration Traceability - Fluke 753 dpc with thermocouple Calibrated by Fluke ISO 17025 related Discussions 4
T Auditor states my Oven Thermocouples must be Calibrated General Measurement Device and Calibration Topics 18
L Should Air Screwdrivers be Calibrated? General Measurement Device and Calibration Topics 15
S Using Calibrated OD mic over non-Calibrated ID mic for final dimension Manufacturing and Related Processes 17
G Filling out inspection report using calibrated pins Inspection, Prints (Drawings), Testing, Sampling and Related Topics 6
M Establishing traceability from calibrated glassware to non calibrated ones General Measurement Device and Calibration Topics 5
M Auditor has requested that the granite table in the lab be Calibrated Calibration and Metrology Software and Hardware 19
B AS9100C 7.5.1 d and calibrated equipment in the production areas AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 5
M Need help with Network Analyzers and which DUT can be Calibrated with it Calibration and Metrology Software and Hardware 2
T New Equipments calibrated by Manufacturer need Calibration from Independent Labs? General Measurement Device and Calibration Topics 2
L Acceptance Criteria for External Calibrated Standards IATF 16949 - Automotive Quality Systems Standard 1
A Calibrated Surface Plates treated as General Use Tables General Measurement Device and Calibration Topics 9
N Is there a standard which states how often instruments should be calibrated? Calibration Frequency (Interval) 12
Chennaiite Is Design Verification Software required to be Calibrated IATF 16949 - Automotive Quality Systems Standard 7
L Can new guy use his Calibrated Tools? Calibration and Metrology Software and Hardware 12
C Measuring Equipment on Injection Machine should be Calibrated by 3rd party? General Measurement Device and Calibration Topics 21
Jerry Eldred Where to get UV Intensity Meter Calibrated General Measurement Device and Calibration Topics 3
C ISO 9001 Surveillance Audit Nonconformance - Thermometers not Calibrated General Measurement Device and Calibration Topics 117
Y Do Thermocouples need to be Calibrated? General Measurement Device and Calibration Topics 18
M Disposal of Calibrated Measurement and Test Equipment General Measurement Device and Calibration Topics 18
J Do desktop calendars need to be calibrated? General Measurement Device and Calibration Topics 31
D Calibration of Pin Gages using a Calibrated Caliper that measures to 4 decimal places General Measurement Device and Calibration Topics 15
H "Internal Calibration" using other Calibrated Equipment Calibration Frequency (Interval) 13
N Can a Calibrated Digital Thermometer be used to monitor my oven? General Measurement Device and Calibration Topics 12
Q Acceptance Procedure for Receiving Calibrated Equipment & Tools Document Control Systems, Procedures, Forms and Templates 13

Similar threads

Top Bottom