SBS - The best value in QMS software

MSA study for visual system with artifical inteligence

#1
Hi Elsmar Forum Users

I'm wondering how to conduct MSA study for visual inspection system where high speed camera detects scratches on surface inside alu pomp. The visual system is supported with artifical inteligence to perform detection without human assessment. How to prepare and how many samples? Do I need physical samples or on ON/NOK photos. How many repetition/control series have to be performed to properly validated such system? First validation by eng dept was performed with assessment of ca 1000 photos taken by camera with miss rate ca 0,5%. This same sample size for MSA as well?

Do you have any ideas, experience?

Thanks in advance for your help.
 
Elsmar Forum Sponsor

Johnson

Involved In Discussions
#2
Hi,

You can use the method described in AIAG MSA Manual for attribute measurement system analysis.
But you should decide the acceptance criteria for your system depending on reliability requirements on your detection system.
I would suggest physical samples should be used instead of photos or pictures.
You should select at least 10 samples which must include upper limit which you must reject and lower limit which you may accept. The number of samples depending on how many types of scratches like width, length, area, depth, and their combination etc, and the cost you want to spend on the study and the reliability requirements on your detection system.
You should run test for each samples at least 3-10 times, and again the more the better but the cost is high.
You can refer General Acceptance Criteria of Attribute type MSA:
Acceptable for the appraiser when, Effectiveness ≥90% & Miss alarm ≤2% & False alarm ≤5%.
Marginally acceptable for the appraiser when, Effectiveness ≥80% & Miss alarm ≤5% & False alarm ≤10%.
There were some posts in this forum you can check,like :
Acceptance Criteria for Attribute MSA Study Effectiveness Summary

Regards,
Johnson Shao
 
#3
Hi Johnson,

Thank for your comprehensive answer. I plan to collect ca. 150 NOK parts (based on 3 monthly Pareto) and 50 OK parts to induce false alarm. Parts will be clearly marked as masters NOK/OK. Then conduct 5-7 trials/run tests with randomly selected NOK/OK parts. Sounds good?
 
Thread starter Similar threads Forum Replies Date
A MSA - Is an attribute study required for visual inspection? Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 3
O How can you deploy an MSA study on a visual inspection appearance variable Inspection, Prints (Drawings), Testing, Sampling and Related Topics 4
Nihls MSA Study Type 1 (CMM) Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 1
M MSA Study Type 1 not capable. We are at the limit. And manufacturing wants to continue producing. Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 7
T Correct MSA study for an automated camera system which makes attribute inspection Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 1
N MSA Study for a Leak Testing Device Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 6
D Do I need part variation while doing Destructive Variable Gage R&R MSA study Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 19
Prashant G MSA Study - AS 9100 and and our customer want us to do MSA study for their parts dimension Reliability Analysis - Predictions, Testing and Standards 4
E MSA Study on MTS dynamic rate measurements Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 5
C Do Calibration Reference Standards require an MSA study? Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 2
O MSA Study for a steel ruler Manufacturing and Related Processes 6
S Conducting an MSA study for ICT(HP3070) and Functional Testing Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 3
S MSA Study Requirements for Control Plans FMEA and Control Plans 5
B Doing MSA Variables Data Study on Threads Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 3
B Conflict between department of MSA and Capability Study Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 1
B How to select parts for a MSA Study Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 19
V MSA Attribute Data Analysis Study IATF 16949 - Automotive Quality Systems Standard 1
C Help with my first MSA Study Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 4
Manix MSA - How to Approach a Gauge R&R Go/NoGo Attribute Study Statistical Analysis Tools, Techniques and SPC 2
Q Need help on MSA study on a torque analyzer Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 3
SATHYABALARAMAN MSA (Measurement Systems Analysis) Study plan Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 5
B Meaningful MSA Study on Viscosity Measuring Equipment IATF 16949 - Automotive Quality Systems Standard 14
M MSA 4 - Results of GR&R Study using Range & Average Method Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 9
I Interpretation of MSA (Measurement Systems Analysis) Linearity and Bias Study Results Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 1
A Need help with a Kappa Study (MSA) - Reviewing x-ray Images Six Sigma 11
J Minor NC - No MSA study on Tensile Tester IATF 16949 - Automotive Quality Systems Standard 4
G Ford - Type 1 Gage Study MSA (Measurement Systems Analysis) acceptable? Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 7
L How to do an MSA Study on Stopwatches Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 6
H Is my MSA Study Spreadsheet okay to AIAG MSA Manual 4th Edition? Using Minitab Software 18
E MSA (Measurement System Analysis) Study on an Automated Process Quality Tools, Improvement and Analysis 4
kedarg6500 Bias Study-Finding degree of freedom-P 92 of MSA manual 4th Ed. Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 6
V Excel Templates for MSA Study as per 4th Edition Manual Excel .xls Spreadsheet Templates and Tools 11
C What is the most appropriate MSA (Measurement System Analysis) Study Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 4
Rameshwar25 Acceptance Criteria for Attribute MSA Study Effectiveness Summary Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 7
D ANOVA vs. X bar & R - MSA Study in Mintab - Which to use and why? Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 1
A Yearly MSA (Measurement System Analysis) & Capability Study - TS 16949 Requirements Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 2
R X Bar R chart - Interpretation in MSA study Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 2
C Starting an MSA study - How to decide which is appropriate or required Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 2
T Bias Study - Use of 't' statistic - Page 88 item 8 of v4 of the MSA manual Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 7
B NDC relates which type of MSA Study Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 16
E Bias Study - How can I calculate significant 't' value? Page 87-90 of MSA manual Capability, Accuracy and Stability - Processes, Machines, etc. 18
J Sampling Method for Stability Study - Implementing MSA Study on Testers Inspection, Prints (Drawings), Testing, Sampling and Related Topics 9
N Sample Selection for MSA Study - Entire range of the Tolerance? Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 4
Miner Intro to MSA of Continuous Data – Part 7: R&R using Wheeler’s Honest Gage Study Imported Legacy Blogs 17
D Ford MSA - Ford TYPE 1 study on a Marposs post process gauge Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 5
V MSA (Measurement System Analysis) Doubt on Analytic Method (Attribute Study) IATF 16949 - Automotive Quality Systems Standard 8
N Basic MSA - A simple way to complete an MSA study on Dial Calipers Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 5
P MSA Study Types - How to make an informed decision about a gauge Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 18
B MSA (Gage R&R) vs. Capability Cpk Study - Helium Leak Check Station Statistical Analysis Tools, Techniques and SPC 2
D Cpk and MSA study for Chemical Production Line Capability, Accuracy and Stability - Processes, Machines, etc. 4

Similar threads

Top Bottom