Calibration requirements for ISO 9001:2000 - We do not conduct GRR studies

S

sbickley

#1
Hi Everyone,

We currently use many measuring instruments in our First Article and repeat inspection processes. This equipment is currently calibrated by an outside part once per year and we do not conduct GRR studies. We also do not conduct daily tool checks when they are checked out, etc.

Is this acceptable or should we be doing more to ensure conformance with the standard?

Please give me some ammunition if we need to do more so I can sell this to management.

Thanks,
Scott
 
Elsmar Forum Sponsor

Sidney Vianna

Post Responsibly
Staff member
Admin
#2
Let's roll the dice

Scott, the (ISO 9001:2000) Standard does not require R&R studies, nor it determines the frequency of calibration/verification of the measuring/test equipment. If you believe that the calibration frequencies should be increased, or you should have more strict controls over how you manage the instruments, my suggestion is for you to collect data to make a business case.

For example, if you can determine that you had a significant number of products returned and you can trace the problem for erroneous reading of the instruments, you might be able to quantify the cost of non-quality associated with this lack of control and compare such costs with the ones derived from enhanced calibration practices, including more frequent calibrations.

I am not very familiar with the Gaming business, but I would suspect that your sector must do some significant risk management. After all the stakes are high (pun intended). :lol:
Imagine one of your clients having to pay millions of dollars to a gamer, due to equipment malfunction, and the root cause being out-of-spec equipment accepted due to IM&T equipment used to test was out of spec! :eek: ! This could have some serious repercussions for your organization, as a supplier. I can only imagine the legalese in the contracts between casinos and their equipment suppliers. :argue:

Good luck!
 
S

sbickley

#3
Thanks Sidney!

You reaffirmed my original belief, though I didn't want to express that view so that I could get an unbiased response. Our games actually determine the "win" by a Random Number Generator and firmware programs - the meters ARE, however, used to visually indicate a jackpot. Here is where it gets tricky --- you can have the symbols line up, but have a computer malfunction and NOT GET PAID - of course that is bad. Furthermore, I haven't yet found a way to calibrate a meter motor -- it seems to work or not work. We have our own "homemade" testers that test our firmware programs - but there doesn't seem to be anything to calibrate there. Very challenging!

Any suggestions there?
 

Govind

Super Moderator
Staff member
Super Moderator
#4
When there is, software involved with the equipment the calibration definitely become challenging as to what to calibrate.
Unlike hardware, Software does not wear out and hence there is no bias. However, Software can have malfunction and cause error outputs. Firmware is an embedded software.
Changes to the operating environments (system), corruption due to high electrostatic discharge, etc can cause malfunction of the software program.
Verification and validation of software based on functional specification will be one of the ways to ensure that software is working as required. I can see relevance to Software reliability also in this context.
Iam not sure what the "homemade" tester is testing. An educated guess would be to execute the program several times and check the randomness of the output?
Regards,
Govind.
 
S

sbickley

#5
Govind said:
When there is, software involved with the equipment the calibration definitely become challenging as to what to calibrate.
Unlike hardware, Software does not wear out and hence there is no bias. However, Software can have malfunction and cause error outputs. Firmware is an embedded software.
Changes to the operating environments (system), corruption due to high electrostatic discharge, etc can cause malfunction of the software program.
Verification and validation of software based on functional specification will be one of the ways to ensure that software is working as required. I can see relevance to Software reliability also in this context.
Iam not sure what the "homemade" tester is testing. An educated guess would be to execute the program several times and check the randomness of the output?
Regards,
Govind.
Govind,

You are correct. We perform extensive testing with regard to Hi-Pot testing, ESD protections, electrical interference -- in addition, we also perform a 1 million cycle game run during the latter stages of development to work out any anomolies in the firmware. The games then go to a Wide Area Market (WAM) field test which gauges game functional performance and customer acceptance (casino) and end customer acceptance (player).
 

Govind

Super Moderator
Staff member
Super Moderator
#6
sbickley,
In my opinion,you are doing all the right things wrt validating the functional performance of the software giving adequate considerations to operation environment. If this software is driving any mechanical unit, you may want to monitor for the wear that can make the output lose its randomness.
Did you see my posting on Software reliability. Since you are performing 1 million cycle, you should have very rich data for software reliability. Did you ever try fitting in a distribution (eg: Raleigh) and predict?
Govind.
 
G

Graeme

#7
ISO 10012:2003 Measurement management systems

sbickley said:
Hi Everyone,

We currently use many measuring instruments in our First Article and repeat inspection processes. This equipment is currently calibrated by an outside part once per year and we do not conduct GRR studies. We also do not conduct daily tool checks when they are checked out, etc.

Is this acceptable or should we be doing more to ensure conformance with the standard?

Please give me some ammunition if we need to do more so I can sell this to management.

Thanks,
Scott
Scott,

(A short answer :D is that if it meets your needs then it's OK. :D But it may not really be fully suitable, which is probably your concern.)

I can't directly answer your question, but I can point you to a standard that may help. In ISO 9001:2000, at the end of clause 7.6 Control of measuring and monitoring devices there is a note that specifies ISO 10012-1 and 10012-2 as guidance. Those standards have since been superseded by ISO 10012:2003 Measurement management systems - requirements for measurement processes and measuring equipment. This can be purchased from ASQ or ANSI.

ISO 10012 provides guidance for management of an organization's complete measurement system. (For some reason, many people believe it is only for the calibration/inspection/test areas, but that is not correct.) As stated in the scope, the standard provides guidance for
  • management of measurement processes, and
  • metrological confirmation of of measuring equipment used to support and demonstrate compliance with metrological requirements.
The "measurement processes" are not restricted by location or function. If a measurement is made that affects product quality, in a core or support process, then is can be managed using this guidance.

Metrology is the science of measurement, so "metrological confirmation" is calibration and "metrological requirements" are the measurement requirements of a product or process.

According to the standard, the measurement requirements are based on the product, customer requirements, legal and regulatory requirements, and so on. All measurement process in production or evaluation have to be managed. All measurements relating to conformance to requirements must be made with calibrated measuring instruments. ISO 10012 is the guidance standard for applying these and other principles to ISO 9001:2000.

As for testing the random number routines, I think NIST has something on that - a search in the Information Technology Laboratory area for "random number" turned up almost 150 links including this one. I think they have routines for testing the randomness according to the expected distribution, algorithms for generating specific distributions, and lots of stuff that is way above my understanding level.
 
S

sbickley

#9
Honestly, I have to defer to the probability experts when auditing that area. I, of course, look at the paytable test results to ensure that what we manufacture matches the test, but we have our own software to generate the high end math and RNG stuff. Sometimes, you just gotta know your limits - mine are on the sideline there.
 
L

Leonardo Lopez

#10
Sidney Vianna said:
Scott, the (ISO 9001:2000) Standard does not require R&R studies, nor it determines the frequency of calibration/verification of the measuring/test equipment. If you believe that the
Does this means that the studies have to be done only on that measurement equipment used for a PPAP product?
 
Thread starter Similar threads Forum Replies Date
Q Do these certificates of calibration meet ISO 9001 requirements for traceability to NIST? ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 10
B Gage calibration frequency, ISO and IATF - What are the requirements Calibration Frequency (Interval) 3
E ISO 9001:2015 - Record requirements for out of calibration tool ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 28
S ISO 17025 Requirements for Mobile On-site Calibration ISO 17025 related Discussions 2
L ISO 17025 Para. 5.4.5 - Method (Calibration Procedure) Validation Requirements ISO 17025 related Discussions 2
T ISO 9001 Calibration Requirements General Measurement Device and Calibration Topics 27
Raffy ISO 13485 NIST Traceability requirements for calibration of test equipment ISO 13485:2016 - Medical Device Quality Management Systems 3
P ISO 9001 Requirements for ISO 17025 Accredited Calibration Laboratory ISO 17025 related Discussions 5
M ISO 13485 Calibration Supplier Evaluation Requirements question Other ISO and International Standards and European Regulations 2
N ISO 17025 Requirements for Environmental Conditions for In-House Calibration ISO 17025 related Discussions 5
R ISO 17025 M&TE (Measuring & Test Equipment) Calibration Requirements ISO 17025 related Discussions 4
T ISO 17025 Clause 5.4.2 - Calibration and Test Method Requirements ISO 17025 related Discussions 6
A Identification of Calibration Status - ISO 9001 Clause 7.6c Requirements ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 9
D ISO 17025 and Calibration Laboratory Risk Management Requirements ISO 17025 related Discussions 1
B New Measurement Equipment Calibration Requirements - ISO/TS 16949 IATF 16949 - Automotive Quality Systems Standard 4
Q ISO 9001:2008 Calibration of Measurement Equipment Requirements ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 58
S ISO/TS 16949:2009 and Shipping Scale Calibration Requirements IATF 16949 - Automotive Quality Systems Standard 6
N ISO 17025 External Calibration Laboratory Requirements within ISO/TS 16949 ISO 17025 related Discussions 28
M "As Found" (aka "As Received") Calibration Data - ISO 13485 Requirements ISO 13485:2016 - Medical Device Quality Management Systems 8
S ISO 17025 Validation Requirements - "calibration using reference standards or..." ISO 17025 related Discussions 5
J Calibration service requirements for device manufacturers - ISO 13485 requirements ISO 13485:2016 - Medical Device Quality Management Systems 2
B Pin Gage Calibration Procedure - ISO 17025:2005 accreditation requirements? ISO 17025 related Discussions 8
Douglas E. Purdy Calibration Training Requirements & ISO/TS 16949 General Measurement Device and Calibration Topics 4
G Limited Calibration requirements in ISO 13485 - Temperature controller ISO 13485:2016 - Medical Device Quality Management Systems 3
B Calibration 'Requirements' under ISO? Design and Development Laboratory M&TE Design and Development of Products and Processes 10
A ISO 14001 Calibration Requirements: Do ALL measuring devices need to be calibrated? ISO 14001:2015 Specific Discussions 5
B ISO 13485 Calibration Requirements - Requiring a Documented Procedure for control? ISO 13485:2016 - Medical Device Quality Management Systems 8
W ISO 9001 Calibration Requirements for Hotel Industry ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 17
W Complying with ISO 9001 Calibration Requirements - Report Before and After Data General Measurement Device and Calibration Topics 12
T Temperature Requirements For In House Calibration - AS9100 AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 16
G Tool tracebility and First calibration requirements for aerospace (AS9100) organisation AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 5
A Digital Timer Calibration Requirements General Measurement Device and Calibration Topics 3
N Calibration Requirements for Production Equipment ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 3
E Calibration Certificate Content Requirements General Measurement Device and Calibration Topics 3
G Calibration: Conforming to ISO9001 Requirements General Measurement Device and Calibration Topics 6
eternal_atlas Section 7.8.4 Specific requirements for calibration certificates ISO 17025 related Discussions 2
T In house Calibration? Measurement equipment traceability requirements - ISO9001 General Measurement Device and Calibration Topics 12
J Calibration Justification - Requirements for Measurement with a Calibrated Device General Measurement Device and Calibration Topics 1
E IATF 16949 Cl. 7.1.5.2.1 - Calibration and Verification Records Requirements IATF 16949 - Automotive Quality Systems Standard 1
B IATF 16949 - 7.1.5.3.1 Internal calibration laboratory requirements IATF 16949 - Automotive Quality Systems Standard 9
S Clarification of threaded ring gage calibration procedure/requirements General Measurement Device and Calibration Topics 2
M Calibration Records Requirements for all the Calibrations and Verifications we do General Measurement Device and Calibration Topics 4
D AMS 2750E - Digital Instrument Calibration Accuracy Requirements General Measurement Device and Calibration Topics 1
R AS9100 Calibration Requirements General Measurement Device and Calibration Topics 4
C Black Oxide Gage Pin Calibration Requirements General Measurement Device and Calibration Topics 4
M ISO17025 Testing Laboratory Equipment Calibration Requirements ISO 17025 related Discussions 4
R TUS Sensors in AMS2750 Calibration Requirements Various Other Specifications, Standards, and related Requirements 12
T Gage Block Calibration Requirements question General Measurement Device and Calibration Topics 19
D Calibration requirements for New Gages General Measurement Device and Calibration Topics 11
S Auditing TS 16949 Cl. 7.6.3.1 - Internal Calibration Laboratory Requirements IATF 16949 - Automotive Quality Systems Standard 8

Similar threads

Top Bottom