0.00005" tolerance on micrometer with 0.0005" resolution?

greif

Involved In Discussions
#1
I see that Mitutoyo 293 series (std. 0-1" digital micrometer with 0.00005" resolution) have a factory spec of 0.00005".

This seems rather extreme to have the tolerance be the same as the resolution. What are everyone's thoughts?
 
Elsmar Forum Sponsor

NickV....

Starting to get Involved
#2
From my experience I don't think the 5th digit even indicates a value between 0.00000-0.00009", it only shows a value of 0.00000 or 0.00005". So accurate to the 5th digit.....I don't believe so.
 
Last edited:

dwperron

Trusted Information Resource
#3
I see that Mitutoyo 293 series (std. 0-1" digital micrometer with 0.00005" resolution) have a factory spec of 0.00005".

This seems rather extreme to have the tolerance be the same as the resolution. What are everyone's thoughts?

I need the full model number to get a complete answer to this.
Some have a 0.00005" tolerance, others have 0.0001"
There are parallelism and flatness specs that need to be accounted for.
Note that "Quantizing error: ±1 is not included " in the tolerance.
 

dwperron

Trusted Information Resource
#5
I am looking at the specs on this Mitutoyo web page:
Coolant Proof Micrometer Series 293-with Dust/Water Protection Conforming to IP65 Level

And the first 0-1" micrometer listed: 293-330-30
For that micrometer here are the full specifications:
Technical Data
• Resolution: .00005"/0.001mm
• Quantizing error: ±1 is not included.
• Flatness: .000012"
• Parallelism: .00004"

How you combine the specifications is up to you. Conservatively, you can just add the terms together. More aggressively, you can combine them via RSS.
 
Thread starter Similar threads Forum Replies Date
R Inspecting straightness tolerance of .00005" on a shaft Inspection, Prints (Drawings), Testing, Sampling and Related Topics 6
J Measuring Hole @ .00005" Inspection, Prints (Drawings), Testing, Sampling and Related Topics 4
A Nested ANOVA MSA - Excel sheet with bilateral tolerance Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 1
dhuot1990 Out of Tolerance for Weights Manufacturing and Related Processes 3
F Tolerance Acceptance Criteria General Measurement Device and Calibration Topics 3
M Definition of Characteristics Tolerance Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 3
R Quantity Discrepancy Tolerance Standard(s)? AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 5
T Simulate Tolerance Range with Real Parts Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 7
D Tolerance and MPEs for Re-calibration Manufacturing and Related Processes 0
S GD&T Bonus Tolerance OOS Capability, Accuracy and Stability - Processes, Machines, etc. 2
WEAVER Can you determine exact date an instrument went out of tolerance? General Measurement Device and Calibration Topics 10
K COPLANARITY: Composite profile tolerance on multiple surfaces- what does" lower dimensional reference frame tolerance" control? Inspection, Prints (Drawings), Testing, Sampling and Related Topics 11
I Profile tolerance with a positional tolerance to a hole ? Inspection, Prints (Drawings), Testing, Sampling and Related Topics 3
A % STUDY VARIATION VS. % TOLERANCE Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 31
A +0/-.001 Tolerance question - Feature size is 1.249 +0/-.001 - Actually measures 1.2493 (.0003 OHL Inspection, Prints (Drawings), Testing, Sampling and Related Topics 12
L Validation without Tolerance Qualification and Validation (including 21 CFR Part 11) 0
A Need to calculate tolerance Intervals with a set of non-normal data and 3-Parameter Weibull distribution Using Minitab Software 0
Q Acceptable Tolerance - how to derive? Measurement Uncertainty (MU) 16
D Tolerance symbol Inspection, Prints (Drawings), Testing, Sampling and Related Topics 8
D Calibration tolerance question using Pipettes Medical Device and FDA Regulations and Standards News 3
M Determining a tolerance value for Measuring devices in-house inspection General Measurement Device and Calibration Topics 12
N Drawing tolerance vs. Measurement device General Measurement Device and Calibration Topics 7
I Control Plan (Product/Process specification/ Tolerance) acceptance FMEA and Control Plans 27
J Mechanical inspection techniques of close tolerance parts Inspection, Prints (Drawings), Testing, Sampling and Related Topics 4
Proud Liberal Small radius with tight tolerance on a torus General Measurement Device and Calibration Topics 4
L GRR for a tolerance that has changed Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 6
T How to justify this High %Tolerance Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 3
D Tolerance definition based on expected Cp/cpk Reliability Analysis - Predictions, Testing and Standards 14
N % Tolerance - Type 1 study on the gages, then a gage R&R (ANOVA) Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 4
S Tolerance limits for micro balance General Measurement Device and Calibration Topics 1
J Determining SPC tolerance Statistical Analysis Tools, Techniques and SPC 21
Q % Study variation low, % tolerance high - GR&R Interpretation help Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 3
R Uncertainty in measurement larger than tolerance Measurement Uncertainty (MU) 2
WEAVER Electronic Weighing Scale Calibration Tolerance Manufacturing and Related Processes 1
I Determining Calibration Tolerance of a Measurement Device General Measurement Device and Calibration Topics 2
Ronen E Tolerance intervals (?) question - Flow Rate Probability Range Statistical Analysis Tools, Techniques and SPC 6
D Tolerance when verifying an analytical balance General Measurement Device and Calibration Topics 3
E Discussion between co-worker on tolerance and uncertainty and how to apply it. Thoughts? 17025 ISO 17025 related Discussions 1
C Thread Tolerance - Can I use a 3A Ring on a part that the drawing calls out for a 2A? Manufacturing and Related Processes 5
T GRR based on part tolerance or process variation. Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 7
A Excel OOT (Out of Tolerance) Formula Excel .xls Spreadsheet Templates and Tools 3
N Tolerance Interval plots in Minitab Statistical Analysis Tools, Techniques and SPC 0
S Question about a basic additive variance/tolerance example Quality Tools, Improvement and Analysis 2
G Assigning a calibration tolerance - An x-y coordinate machine - Uncertainty as my verification tolerance General Measurement Device and Calibration Topics 4
R Feeler Gauge Calibration - What tolerance is used for calibrating feeler gauges? General Measurement Device and Calibration Topics 4
S SPC (Statistical Process Control) for Unilateral Tolerance - Questions Statistical Analysis Tools, Techniques and SPC 6
B Gage R&R Acceptable (10-30%), deduct Total Variation from Tolerance Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 12
Y How to fix weight tolerance for plastic injection molded part? Does it vary with material groups? Manufacturing and Related Processes 1
F Position tolerance check gage manufacturing Inspection, Prints (Drawings), Testing, Sampling and Related Topics 8
M GD&T tolerance or band? Using a symbol like parallelism // Inspection, Prints (Drawings), Testing, Sampling and Related Topics 8

Similar threads

Top Bottom