What are the uncertain digits of a 1/64" calibrated ruler?

P

potato

#1
What are the uncertain digits of a 1/64" calibrated ruler?

There are two schools, I think:

1) person measuring can estimate between markings. Since 1/64"=.015625, and as a rule of thumb (?) the error on a ruler is half of the markings is .0078125, the 3 digit is uncertain. So, a reading of 1/64" would equal .016".

2) Since 1/64"=.015625", and the error is .0078125, then if you add and subtract the error to 1/64", you could get readings of .0078125 to .0234375. In this case, the first digit is certain, and the second is uncertain. So, a reading of 1/64"=.02".

So, which is it?
 
Elsmar Forum Sponsor
N

Norml1

#2
Re: uncertain digits of a 1/64" ruler?

When recording observed values, the number of digits to be recorded are all exactly known digits plus one additional digit that can be reasonably estimated, otherwise the reading is recorded to the nearest graduation.
 

normzone

Trusted Information Resource
#3
The measurement should be reported as follows:

Let's say the observed measurement is in between 7/64 and 8/64.

The measurement should be reported as 7/64 +

All else is interpolation and estimation.
 
N

Norml1

#4
Interpolation and estimation should be fine when using a ruler, in my estimation! It certainly depends on how inspectors have been trained on the use of measuring equipment and recording of data.
 

normzone

Trusted Information Resource
#5
I prefer to call them as I can defend them. I've met too many wannabe metrologists willing to demonstrate that they can hold a ruler better than anybody else, contact error and parallax error be damned.

:nope:
 
Last edited:

Hershal

Metrologist-Auditor
Staff member
Super Moderator
#6
For line width as a Type B, I agree with potato. However, parallax has also been brought in, a Type B, plus the uncertainty from any previous calibration it may have had. Additionally, temp and RH must be considered as Type B contributions as rulers will change. For a metal ruler, one has the thermal coefficient of expansion/contraction for the metal. Thus, the contributions can get complex.

However, the key is whether the change is significant enough to see.
 
B

bbrewington

#7
Shouldn't you do a Gage R&R study with some samples to determine the actual error inherent in the user-ruler-sample system? Maybe you could estimate the error, but this would allow you to experimentally verify the error.
 
Thread starter Similar threads Forum Replies Date
SteelMaiden Job Security in Uncertain Times Career and Occupation Discussions 26
L What are the rules on significance of digits in numbers in IEC/ISO standards? IEC 60601 - Medical Electrical Equipment Safety Standards Series 5
F DMM - Capacitance - +/- % of reading + digits? Measurement Uncertainty (MU) 3
5 Number of 'significant digits' in measurements Inspection, Prints (Drawings), Testing, Sampling and Related Topics 31
B Rounding Numerical Values Up or Down with respect to the number of Significant Digits Measurement Uncertainty (MU) 9
G Explanation of Rule of Thumb (10:1) - Tolerance Zone or Digits Number Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 3
D Drafting Conventions per ASME Y14.5m - Three significant digits rule Various Other Specifications, Standards, and related Requirements 12
L How many digits should be used when measuring density? Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 5
V Significant digits when reporting measurements Inspection, Prints (Drawings), Testing, Sampling and Related Topics 4
J Gear Surface Finish - Print with the word "calibrated" Manufacturing and Related Processes 2
M What kind of instrument that must be calibrated? General Measurement Device and Calibration Topics 3
G Can calibrated device values be used instead of manufacturers spec? General Measurement Device and Calibration Topics 2
M Where to obtain a calibrated DICOM image? ISO 13485:2016 - Medical Device Quality Management Systems 1
Q Calibrated Equipment Managment Software Suggestions General Measurement Device and Calibration Topics 12
J Calibration Justification - Requirements for Measurement with a Calibrated Device General Measurement Device and Calibration Topics 1
O Storage of Calibrated Tools General Measurement Device and Calibration Topics 12
I Uncalibrated source to calibrated meter, then compare to UUT General Measurement Device and Calibration Topics 4
K Looking for Calibrated Tool Shadowboard Substrate Ideas AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 5
N Calibration Traceability - Fluke 753 dpc with thermocouple Calibrated by Fluke ISO 17025 related Discussions 4
T Auditor states my Oven Thermocouples must be Calibrated General Measurement Device and Calibration Topics 18
L Should Air Screwdrivers be Calibrated? General Measurement Device and Calibration Topics 15
S Using Calibrated OD mic over non-Calibrated ID mic for final dimension Manufacturing and Related Processes 17
G Filling out inspection report using calibrated pins Inspection, Prints (Drawings), Testing, Sampling and Related Topics 6
M Establishing traceability from calibrated glassware to non calibrated ones General Measurement Device and Calibration Topics 5
M Auditor has requested that the granite table in the lab be Calibrated Calibration and Metrology Software and Hardware 19
B AS9100C 7.5.1 d and calibrated equipment in the production areas AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 5
M Need help with Network Analyzers and which DUT can be Calibrated with it Calibration and Metrology Software and Hardware 2
T New Equipments calibrated by Manufacturer need Calibration from Independent Labs? General Measurement Device and Calibration Topics 2
L Acceptance Criteria for External Calibrated Standards IATF 16949 - Automotive Quality Systems Standard 1
A Calibrated Surface Plates treated as General Use Tables General Measurement Device and Calibration Topics 9
N Is there a standard which states how often instruments should be calibrated? Calibration Frequency (Interval) 12
Chennaiite Is Design Verification Software required to be Calibrated IATF 16949 - Automotive Quality Systems Standard 7
L Can new guy use his Calibrated Tools? Calibration and Metrology Software and Hardware 12
C Measuring Equipment on Injection Machine should be Calibrated by 3rd party? General Measurement Device and Calibration Topics 21
Jerry Eldred Where to get UV Intensity Meter Calibrated General Measurement Device and Calibration Topics 3
C ISO 9001 Surveillance Audit Nonconformance - Thermometers not Calibrated General Measurement Device and Calibration Topics 117
Y Do Thermocouples need to be Calibrated? General Measurement Device and Calibration Topics 18
M Disposal of Calibrated Measurement and Test Equipment General Measurement Device and Calibration Topics 18
J Do desktop calendars need to be calibrated? General Measurement Device and Calibration Topics 31
D Calibration of Pin Gages using a Calibrated Caliper that measures to 4 decimal places General Measurement Device and Calibration Topics 15
H "Internal Calibration" using other Calibrated Equipment Calibration Frequency (Interval) 13
N Can a Calibrated Digital Thermometer be used to monitor my oven? General Measurement Device and Calibration Topics 12
Q Acceptance Procedure for Receiving Calibrated Equipment & Tools Document Control Systems, Procedures, Forms and Templates 13
hogheavenfarm Does anyone know of a calibrated Fillet weld gage? General Measurement Device and Calibration Topics 12
S Can Laser Alignment Tools be Calibrated General Measurement Device and Calibration Topics 7
G New gage calibrated at factory do I need the certificate? Calibration Frequency (Interval) 4
D Scales calibrated by an ISO 17025 accredited organization? TS 16949 requirement? ISO 17025 related Discussions 44
A Usage of Calibrated Equipment - Vernier Caliper Misc. Quality Assurance and Business Systems Related Topics 10
howste Condition of Item Calibrated - ISO 17025 Clause 5.10.2f - Calibration Certificate ISO 17025 related Discussions 13
O Calibrating a Gage Block In-house with Calibrated Digital Calipers General Measurement Device and Calibration Topics 7

Similar threads

Top Bottom