Comparison of two test equipments

T

tohbin

#1
I have a comparison problem here on two test equipment. These two testers give different results for chips tested. For example tester 1 might classify the chips as in Bin 2 but Tester 2 classify the same chips as in Bin 3. I wonder how I can do a comparison test here to justify that these two testers give varying results. Hope somebody can help out here. Thanks.

:confused:
 
Elsmar Forum Sponsor
D

D.Scott

#2
Easiest way I know is to do proficiency testing. Send your test to an independent 3rd tester. Many labs use an outside lab to check the proficiency of their tests. If you only want to check this time, use another tester in house or send it out.

Dave
 
T

tohbin

#3
Hi Dave,
Thought of using a 3rd independent tester. But what if I want to show my results in statistical way? Any method that can be used? (my data is attribute)
 
D

D.Scott

#4
Tohbin

Without knowing anything about the test you are doing, I can't offer any suggestion for statistical data.

I am not sure what measurement would class a chip from Bin 2 to Bin 3 but if there is a numerical value established, that could result in statistical data.

Sorry I am not able to answer your question. Maybe some of the others who recognize the test might be able to help.

Dave
 
D

Dave Strouse

#5
What you need ..

is an attribute gage R&R to be performed.
I'm assuming your test is not destructive. If it is, you can still do R&R but it gets messier.
Take a look at Jurans Handbook, 5th edition, section 23.51 on "Measure of Inspector and Test Accuracy". This reading outlines the plan to compare the results of two inspectors (human in the example, but can just as easily be your machines).

You will need a quantity of parts spanning the range of defects.

You will also need a "check" inspector that is most likely a human or the outside third party inspector that D. Scott mentioned. This check inspector will examine each part on test and decide it's "good" versus "bad" status.

MINITAB software also has an attribute R&R routine as of release 13. It's about $700 off the shelf I think, but you can probably negotiate. There may be other software packages that do this.

If you really get hung up on the analysis I could do it for you. I would want results in some electronic format , Excell spreadsheet or even a text file with good delimiters. My days of manual transcriptions from checksheets and charts are over I hope!

:rolleyes:
 
M

Michel Saad

#6
Tohbin,

A gage R&R is made to see the capability of a measurement equipement to be repeteable with the inclusion of all the variations due to parts, equipment and appraiser. It is not the right tool to compare two pieces of equipment. A hypothesis test is what would be required if the data was variable. Since the data is attribute, the answer is simple. It has to be excately the same. The part that is rejected in bin 2 on machine one has to be rejected in bin 2 on machine 2.
 

Atul Khandekar

Quite Involved in Discussions
#7
Tohbin,

As D.Scott said, a little more detail would help. What kind of test is this? What is the parameter being checked? How is pass/fail decision made? Could there be a calibration problem?
-Atul
 
D

Dave Strouse

#8
Mind your R's

Michael -
You may remember the 3 R's from school reading ,'riting nd 'rithmetic. ALL must be learned.

Similarlly a Gage R&R has Repeatability and Reproducability. Reproducability is getting the same results using different operators(testers in this case) and is EXAXTLY what Tohbin wants to know.

The attribute Gage R&R makes an assessment of the confidence intervals around the agreement of appraiser to appraiser ( reproducability), within appraiser (repeatability) and appraiser to standard (bias).

No appraiser wheter human or machine will give exactly the same results every time. If only the world were that simple!
 

Atul Khandekar

Quite Involved in Discussions
#9
That the testers are not able to reproduce results is quite clear. Are we asking which tester is right and which is wrong? Looking at it from calibration angle... It is a good idea to obtain a 'Master' chip(s) with 'Good' and 'bad' status determined by a much better test equipment, then have the two regular testers test them and see which one's giving wrong results. (Some kind of a bias test?)

-Atul
 
Last edited:
Thread starter Similar threads Forum Replies Date
G Guide 43 Interlaboratory Comparison Test Scheme General Measurement Device and Calibration Topics 7
Q Capability - CPk comparison values Capability, Accuracy and Stability - Processes, Machines, etc. 12
O ISO 13485 vs. GMP - Comparison matrix wanted EU Medical Device Regulations 3
T Interlaboratory comparison or proficiency testing in destructive testing of welded joints ISO 17025 related Discussions 2
F Measurement Audit and ILC for ISO 17025 Clause 7.7.2 - Comparison with results of other laboratories ISO 17025 related Discussions 0
K Comparison essential requirements EU compared to those of MDSAP countries Other Medical Device Regulations World-Wide 3
L Comparison matrix between IATF 16949:2016 to ISO 12207, ISO 9001 and Automotive SPICE IATF 16949 - Automotive Quality Systems Standard 3
P ISO 15378 2015 to 2017 Comparison wanted General Auditing Discussions 4
E 2 participants in inter-laboratory comparison tests ISO 17025 related Discussions 3
T MDD and IVD comparison Other Medical Device Regulations World-Wide 2
Q JIS T 1115 Comparison (Japan Medical Device Standard) Japan Medical Device Regulations 0
A Does anyone have a comparison between ISO 9001:2015 and ISO 13485:2016? ISO 13485:2016 - Medical Device Quality Management Systems 2
J Machinery Directive vs. MDD Comparison Matrix wanted EU Medical Device Regulations 6
T Automated and Manual Measurement System Comparison (Correlation) Quality Tools, Improvement and Analysis 3
A ISO 13485:2003 vs. ISO 13485:2016 Differences Comparison ISO 13485:2016 - Medical Device Quality Management Systems 4
A ISO9001:2015 comparison with AS9100:2016 ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 2
D Comparison of ISO 9001:2008 and CAN3-Z299.3 Other ISO and International Standards and European Regulations 1
C Checklist comparison between ISO9001:2008 and ISO 3834 Quality Management System (QMS) Manuals 1
N Digital vs Dial Caliper Comparison Measurement Uncertainty (MU) 17
P Comparison of OEDC and US FDA GLP (Good Laboratory Practices) Other Medical Device and Orthopedic Related Topics 4
P Alternative To PT/ILC (Inter-Laboratory Comparison) Requirement General Measurement Device and Calibration Topics 3
ncwalker Ranking Criteria Systematically - Pairwise Comparison.xlsm Lean in Manufacturing and Service Industries 8
C What is "Participation in interlaboratory comparison or proficiency-testing programs" General Measurement Device and Calibration Topics 8
G Comparison Study of CMMs and software along with Probe Types Inspection, Prints (Drawings), Testing, Sampling and Related Topics 12
F Comparison of 2 CMM machines using Gage R&R Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 7
M SAE AS 9101 Rev D and E Comparison wanted - March 2014 AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 1
S ISO 9001:2008 / ISO TS16949:2009 Comparison ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 6
Q ISO 9001:2008 & 2015 comparison ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 1
C How to determine a sample size for comparison purposes ? Quality Tools, Improvement and Analysis 2
S Comparison between Rapapport Vassilliadis Broth and Selenite Broth for Salmonella Food Safety - ISO 22000, HACCP (21 CFR 120) 1
M CMDR vs. MDD Comparison Canada Medical Device Regulations 3
L Australia/Canada and USA v's EU Medical Devices Regulations Comparison Other Medical Device Regulations World-Wide 4
S Method Comparison Design Onput Sample Range Requirement Design and Development of Products and Processes 3
S Comparison between Microgen A+B,API 24e and microbact 24e US Food and Drug Administration (FDA) 1
F Statistical Comparison of Product: High Average vs. Low Range Capability, Accuracy and Stability - Processes, Machines, etc. 13
M Comparison between TS 16949 clauses 8.5.2 and 8.5.2.1 IATF 16949 - Automotive Quality Systems Standard 6
J Comparison table between ISO 20000 and ISO 9001 IT (Information Technology) Service Management 7
P GMP or quality system "requirement" comparison for different sector Various Other Specifications, Standards, and related Requirements 1
P IEC 60601-2-25:2011 Comparison Table (ECG, Diagnostic) IEC 60601 - Medical Electrical Equipment Safety Standards Series 0
P The Name for a Calibration - Bootstrapping or Comparison General Measurement Device and Calibration Topics 12
H Quick Comparison Check of Multiple Thermocouples on one Datalogger General Measurement Device and Calibration Topics 6
M Adding Bizminer's Industry Financial data to my Peer Company Comparison Manufacturing and Related Processes 0
AnaMariaVR2 Regulatory Review of Novel Therapeutics ? Comparison of 3 Regulatory Agencies US Food and Drug Administration (FDA) 0
T IEC 60601-2-27 - Comparison of 2nd to 3rd edition IEC 60601 - Medical Electrical Equipment Safety Standards Series 6
optomist1 ISO 9001 vs TL 9000 - Looking for a comparison matrix Other ISO and International Standards and European Regulations 3
R 21 CFR 820 comparison to RDC No.59 Other Medical Device Regulations World-Wide 2
Z Comparison between AS9100 and FAA 145 Repair-Station (CFR's, FAR's) Federal Aviation Administration (FAA) Standards and Requirements 2
K Multiple Comparison in Chi Square - More than 2 Rows/Columns in Contingency Table Using Minitab Software 9
M ISO 13485 x ICH Q10 Pharmaceutical Quality System - Comparison Evaluation ISO 13485:2016 - Medical Device Quality Management Systems 2
A How to create a Multiple Operations Specifications Comparison Spreadsheet? Excel .xls Spreadsheet Templates and Tools 3

Similar threads

Top Bottom