0.00005" tolerance on micrometer with 0.0005" resolution?

greif

Involved In Discussions
#1
I see that Mitutoyo 293 series (std. 0-1" digital micrometer with 0.00005" resolution) have a factory spec of 0.00005".

This seems rather extreme to have the tolerance be the same as the resolution. What are everyone's thoughts?
 
Elsmar Forum Sponsor

NickV....

Starting to get Involved
#2
From my experience I don't think the 5th digit even indicates a value between 0.00000-0.00009", it only shows a value of 0.00000 or 0.00005". So accurate to the 5th digit.....I don't believe so.
 
Last edited:

dwperron

Trusted Information Resource
#3
I see that Mitutoyo 293 series (std. 0-1" digital micrometer with 0.00005" resolution) have a factory spec of 0.00005".

This seems rather extreme to have the tolerance be the same as the resolution. What are everyone's thoughts?

I need the full model number to get a complete answer to this.
Some have a 0.00005" tolerance, others have 0.0001"
There are parallelism and flatness specs that need to be accounted for.
Note that "Quantizing error: ±1 is not included " in the tolerance.
 

dwperron

Trusted Information Resource
#5
I am looking at the specs on this Mitutoyo web page:
Coolant Proof Micrometer Series 293-with Dust/Water Protection Conforming to IP65 Level

And the first 0-1" micrometer listed: 293-330-30
For that micrometer here are the full specifications:
Technical Data
• Resolution: .00005"/0.001mm
• Quantizing error: ±1 is not included.
• Flatness: .000012"
• Parallelism: .00004"

How you combine the specifications is up to you. Conservatively, you can just add the terms together. More aggressively, you can combine them via RSS.
 
Thread starter Similar threads Forum Replies Date
R Inspecting straightness tolerance of .00005" on a shaft Inspection, Prints (Drawings), Testing, Sampling and Related Topics 6
J Measuring Hole @ .00005" Inspection, Prints (Drawings), Testing, Sampling and Related Topics 4
D Tolerance symbol Inspection, Prints (Drawings), Testing, Sampling and Related Topics 8
D Calibration tolerance question using Pipettes Medical Device and FDA Regulations and Standards News 1
M Determining a tolerance value for Measuring devices in-house inspection General Measurement Device and Calibration Topics 12
N Drawing tolerance vs. Measurement device General Measurement Device and Calibration Topics 7
I Control Plan (Product/Process specification/ Tolerance) acceptance FMEA and Control Plans 27
J Mechanical inspection techniques of close tolerance parts Inspection, Prints (Drawings), Testing, Sampling and Related Topics 4
Proud Liberal Small radius with tight tolerance on a torus General Measurement Device and Calibration Topics 4
L GRR for a tolerance that has changed Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 6
T How to justify this High %Tolerance Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 3
D Tolerance definition based on expected Cp/cpk Reliability Analysis - Predictions, Testing and Standards 14
N % Tolerance - Type 1 study on the gages, then a gage R&R (ANOVA) Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 4
S Tolerance limits for micro balance General Measurement Device and Calibration Topics 1
J Determining SPC tolerance Statistical Analysis Tools, Techniques and SPC 21
Q % Study variation low, % tolerance high - GR&R Interpretation help Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 3
R Uncertainty in measurement larger than tolerance Measurement Uncertainty (MU) 2
WEAVER Electronic Weighing Scale Calibration Tolerance Manufacturing and Related Processes 1
I Determining Calibration Tolerance of a Measurement Device General Measurement Device and Calibration Topics 2
Ronen E Tolerance intervals (?) question - Flow Rate Probability Range Statistical Analysis Tools, Techniques and SPC 6
D Tolerance when verifying an analytical balance General Measurement Device and Calibration Topics 3
E Discussion between co-worker on tolerance and uncertainty and how to apply it. Thoughts? 17025 ISO 17025 related Discussions 1
C Thread Tolerance - Can I use a 3A Ring on a part that the drawing calls out for a 2A? Manufacturing and Related Processes 5
T GRR based on part tolerance or process variation. Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 7
A Excel OOT (Out of Tolerance) Formula Excel .xls Spreadsheet Templates and Tools 3
N Tolerance Interval plots in Minitab Statistical Analysis Tools, Techniques and SPC 0
S Question about a basic additive variance/tolerance example Quality Tools, Improvement and Analysis 2
G Assigning a calibration tolerance - An x-y coordinate machine - Uncertainty as my verification tolerance General Measurement Device and Calibration Topics 4
R Feeler Gauge Calibration - What tolerance is used for calibrating feeler gauges? General Measurement Device and Calibration Topics 4
S SPC (Statistical Process Control) for Unilateral Tolerance - Questions Statistical Analysis Tools, Techniques and SPC 6
B Gage R&R Acceptable (10-30%), deduct Total Variation from Tolerance Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 12
Y How to fix weight tolerance for plastic injection molded part? Does it vary with material groups? Manufacturing and Related Processes 1
F Position tolerance check gage manufacturing Inspection, Prints (Drawings), Testing, Sampling and Related Topics 8
M GD&T tolerance or band? Using a symbol like parallelism // Inspection, Prints (Drawings), Testing, Sampling and Related Topics 8
J What is the difference between Process Variation and Tolerance? Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 4
J Gage R&R without tolerance Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 8
A Calibration of Pressure Gauge, How to Determine Calibration Tolerance General Measurement Device and Calibration Topics 1
V Using K-Factor(Tolerance Interval) Analysis for Design Verification Statistical Analysis Tools, Techniques and SPC 3
C Acceptable NDC for %GR&R part inspection to Tolerance (%Tolerance) Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 3
O Cpk for Unilateral Tolerance Capability, Accuracy and Stability - Processes, Machines, etc. 9
S Doubts about SPC taken in Machining - Part has +-0.01 Tolerance Statistical Analysis Tools, Techniques and SPC 5
A Calibration tolerance for data logger General Measurement Device and Calibration Topics 3
N Straightness Gage Tolerance General Measurement Device and Calibration Topics 0
G Calculating Tolerance of a Panel Meter with a 2 degrees of an Arc General Measurement Device and Calibration Topics 0
Hami812 Cpk Setting Tolerance - Cart before the Horse? (Wifi Routers) Capability, Accuracy and Stability - Processes, Machines, etc. 3
kedarg6500 Excel spreadsheet for Unilateral Tolerance Study wanted Excel .xls Spreadsheet Templates and Tools 2
U Control Charting a Feature with Bonus Tolerance Quality Tools, Improvement and Analysis 10
J Process Capability - How much percentage of tolerance? VDA Standards - Germany's Automotive Standards 3
B Gage R&R MSA - Variation, Tolerance, Variance by different methods IATF 16949 - Automotive Quality Systems Standard 23
R Fixing of tolerance limit - Electronic weighing balance with the capacity of 150 Kgs General Measurement Device and Calibration Topics 5

Similar threads

Top Bottom