CMM Equipment Validation and Qualification Approach

PeterLe

Involved In Discussions
#1
Hello everyone!

I just got a new Quality Engineering position and I have been asked to do an Equipment Qualification on a CMM (http://www.ogpnet.com/ogpVidQuest300.jsp). I'm pretty familiar with process validation, however I don't have any experience doing an Equipment Qualification on a measurement system. I believe equipment qualification is an IQ/OQ.

Now, I'm a bit unsure on how to conduct the OQ portion of the equipment qualification. I've read you can do a gauge R&R, DOE, etc. But I'm wondering what is the general approach for conducting an equipment qualification for a CMM? Thank you so much in advance!
 
Elsmar Forum Sponsor

PeterLe

Involved In Discussions
#3
Thanks Stijloor!

After doing some research, what do you guys think of this general approach?

IQ: We can reference the calibration and preventive maintenance documentation.

OQ: Take a lot (traceable) of known parts with known dimensions (using current inspection plan) and have one operator measure key dimensions. Compare the CMM to the inspection plan results by doing a t-test. Any idea what the correct sample size would be?

PQ: I'm not sure if this is necessary as we are qualifying the equipment and not validating. Please let me know your thoughts. But if we were to do a PQ, would this be a gauge R&R study? 3x10x10?

Any help would be much appreciated! Thank you in advance!
 

yodon

Staff member
Super Moderator
#4
To me, that would not put you in a very defensible position.

IQ is typically (much) more than just PM and calibration. You should consider overall installation (is it set up properly according to the manufacturer's instruction, etc.). Consider the software running on the machine - is it up-to-date, are there any known issues that might affect your operations? I presume there are custom 'programs' for individual parts - installation should show that these are under control, etc.

For OQ, you can either test specific pieces or do a more general test (range of capability). If you go with individual pieces, you would need to repeat OQ and PQ each time you added a new part. If you went with a general OQ approach, confirming the entire range of expected pieces, then you don't have to do additional testing when adding a new piece (presuming it's within the range tested). OQ should also show that bad pieces are identified. I don't know if there are any safety measures, but if so, those would also be verified.

Sample size - whether for OQ testing or PQ testing needs to be statistically defensible (outside my area).

For PQ, since there's not a "production run" you may want to just demonstrate some capability for changing between parts to measure (has no impact). The decisions for what you would should be documented in a Validation Plan.
 

PeterLe

Involved In Discussions
#5
To me, that would not put you in a very defensible position.

IQ is typically (much) more than just PM and calibration. You should consider overall installation (is it set up properly according to the manufacturer's instruction, etc.). Consider the software running on the machine - is it up-to-date, are there any known issues that might affect your operations? I presume there are custom 'programs' for individual parts - installation should show that these are under control, etc.

For OQ, you can either test specific pieces or do a more general test (range of capability). If you go with individual pieces, you would need to repeat OQ and PQ each time you added a new part. If you went with a general OQ approach, confirming the entire range of expected pieces, then you don't have to do additional testing when adding a new piece (presuming it's within the range tested). OQ should also show that bad pieces are identified. I don't know if there are any safety measures, but if so, those would also be verified.

Sample size - whether for OQ testing or PQ testing needs to be statistically defensible (outside my area).

For PQ, since there's not a "production run" you may want to just demonstrate some capability for changing between parts to measure (has no impact). The decisions for what you would should be documented in a Validation Plan.
Hello yodon! Thank you so much for your reply!

After doing research, the past few days, I agree with you the IQ needs to be much more stringent.

As far as the OQ goes, I still need to find out what management wants: Whether they just want the equipment qualified (confirming the specification of the manufacturer) or validate a specific routine with a specific part. The latter would require a gauge r&r. Then of course if management were to go with the gauge r&r route, then yes we would definitely have to conduct a validation if the company wants to use other routines/parts.
 

PeterLe

Involved In Discussions
#6
Hello everyone!

So after some research, I'm still not sure how to approach the OQ. What I would like to do is write some test scripts for the CMM. For example when we go to the software and want to measure the diameter, I want to verify that when I push the diameter button on the software, that it will indeed measure the diameter. So in that case, I will need to get a piece with a known diameter and then measure it using the diameter feature on the software to see if it does measure the diameter. Does this make sense? Is this the right approach for the OQ?

Then I'd also have to write test scripts for the other features such as line, radius, length, etc?

Again I want to just qualify the equipment and not conduct a PQ. The PQ will be saved later for specific routines that we will use.
 

yodon

Staff member
Super Moderator
#7
OQ should be based on your requirements on how you use the system. You would need to define, for example, the types of measurements done (as you have already alluded to), but more importantly, the accuracy.

Suggest you try to establish a range for the measurements or items to be measured and then the OQ can confirm operations throughout the range. This way, when you add a new part to be measured, you don't need to re-run any validation, it will already be covered by the existing validation (as long as it's within the range of the validation conducted).

You may have other requirements like speed, reporting, security, etc. These should be considered.

Hope that helps.
 
D

danile1

#8
Hello PeterL, can i ask you how did you performed the validation of the CMM after all?
I am in the same position rightnow, i need to validate the company's CMM and have no idea where to start. Any information will be appreciated.
 

Eredhel

Quality Manager
#9
We have two CMMs that get calibrated once per year. They are done by the manufacturer, a tech comes down for a couple days per machine. There are also independent places out there that can do calibrations. Is your company willing to pay to farm that out? I can't imagine trying to do it in house.
 

Chrisx

Involved In Discussions
#10
I believe the calibration adequately validates that the device will provide accurate/precise measurements within allowable tolerances. I haven't validated a CMM, but I have validated vision systems. My take on it was that a software validation was probably more suitable. I ran test parts and went thru each measurement function in the software. I ran test cases to demonstrate it would generate a failure for out of specification results and correctly pass parts that were in specification. A training part can be very valuable for this exercise. I believe our CMM came with such a part to use for learning each measurement function.
 
Thread starter Similar threads Forum Replies Date
G GR&R on automatic equipment such as a CMM - Do you still have to use 3 operators Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 8
A Cg, Cgk and GRR of a CMM Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 5
Marco Bernardi MMC & LMC modifiers and CMM measuring techinques like diameter least squares and circularity or minimum/maximim diameter. Calibration and Metrology Software and Hardware 2
J CMM Programmer position - Baltimore Maryland Job Openings, Consulting and Employment Opportunities 0
L In house calibration - Our CMM's are outside certified can I use them to certify our standards General Measurement Device and Calibration Topics 4
M Honeywell CMM's - Why Honeywell will no longer sell their manuals Federal Aviation Administration (FAA) Standards and Requirements 2
Marco Bernardi Plane measurement with a 3D touch machine like a CMM. Calibration and Metrology Software and Hardware 3
Marco Bernardi Diameters measurement with 3D touch machine like a CMM Calibration and Metrology Software and Hardware 4
Emran.mi Measurement system analysis - Can you help me about implementation MSA for CMM device Manufacturing and Related Processes 2
A Gage type 1 study on CMM Capability, Accuracy and Stability - Processes, Machines, etc. 2
V Recording CMM dimensional results on CFG-1003 APQP and PPAP 3
G Measuring customer parts on a CMM - How many decimals to report to the customer? ISO 17025 related Discussions 28
J CMM Accuracy Formula General Measurement Device and Calibration Topics 3
J Manual Vision CMM Calibration General Measurement Device and Calibration Topics 7
D CMM Room cleanliness requirements ISO 17025 related Discussions 7
P IATF 16949 MSA Studies for CMM machines IATF 16949 - Automotive Quality Systems Standard 3
D Can a Mill be used as a CMM? General Measurement Device and Calibration Topics 2
Ron Rompen Best Practices in CMM Correlation Studies General Measurement Device and Calibration Topics 3
B Zeiss CMM Calypso output to Excel or CSV file Help Inspection, Prints (Drawings), Testing, Sampling and Related Topics 17
J CMM Probe Certification General Measurement Device and Calibration Topics 1
S Opinions on the "Best" CMM for High Accuracy Machining General Measurement Device and Calibration Topics 9
P Getting ready for Boeing's AC7130 requirement for suppliers using a CMM AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 3
J CMM Uncertainty Calculation Question - Deviations Measurement Uncertainty (MU) 9
K "Verification of Calibration" - CMM arm General Measurement Device and Calibration Topics 6
J Outsourced CMM Measurement Inspection Service and ISO 17025 ISO 17025 related Discussions 14
M Gage R&R with CMM 1X1X10 Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 8
T CMM measurement and usage in the Automotive Industry Calibration and Metrology Software and Hardware 2
P CMM measurement using 2D drawings Calibration and Metrology Software and Hardware 1
M Translating and Rotating Rules when programming or measuring with a CMM Inspection, Prints (Drawings), Testing, Sampling and Related Topics 4
4 Quality vs Production on CMM Set Up Requirements Manufacturing and Related Processes 1
G Approval of Jigs (work holding devices) for CMM Inspection, Prints (Drawings), Testing, Sampling and Related Topics 3
J How to Retrofit an old, manual CMM Calibration and Metrology Software and Hardware 5
O Camio Output Control - Programming on Camio 4.6 CMM Software Inspection, Prints (Drawings), Testing, Sampling and Related Topics 1
F Comparison of 2 CMM machines using Gage R&R Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 7
R ISO - Clause 7.5.1.3 - CMM Software Program Validation ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 2
S Stated Accuracy of Portable CMM Arm and Real World Use Inspection, Prints (Drawings), Testing, Sampling and Related Topics 9
K Gage R on a 10 Piece Sample with a CMM using Minitab Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 2
C Does anyone know anything about the Mitutoyo MACH V CMM? Inspection, Prints (Drawings), Testing, Sampling and Related Topics 1
T CMM Inspection of Profile Tolerance Inspection, Prints (Drawings), Testing, Sampling and Related Topics 15
B Result of a Flatness MSA on a CMM Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 5
V CMM plane construction method types and accuracy differences for measuring Pos Tol Inspection, Prints (Drawings), Testing, Sampling and Related Topics 4
B MSA result on parts measured with a CMM Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 15
M MCOSMOS - Monitor your CMM load time Quality Assurance and Compliance Software Tools and Solutions 2
G Update Numerex Air Bearing CMM? Capability, Accuracy and Stability - Processes, Machines, etc. 6
F How to get Honeywell APU CMM manual and CFM56-5B & 7B CMM manual Federal Aviation Administration (FAA) Standards and Requirements 7
Marc CMM Training at NIST - August 28-29, 2013 General Measurement Device and Calibration Topics 1
D Geomeasure CMM Manual HLL Software Manual Inspection, Prints (Drawings), Testing, Sampling and Related Topics 2
S Micrometer Calibration Using a CMM Calibration and Metrology Software and Hardware 12
J CMM calibration using a perfect sphere that is supplied Inspection, Prints (Drawings), Testing, Sampling and Related Topics 8
M Zeiss U-Soft versus Uni-Touch CMM Software Calibration and Metrology Software and Hardware 7

Similar threads

Top Bottom