All-or-Nothing Rating System - Internal Audit Checklist - ISO 9001

[ngaran]

How, exactly, is internal audit rated? Counting number of non-conformities and rating auditees turns out to be difficult to define precisely (we've been arguing about it in the office for years). Our Audit Checklist summarizes requirements of ISO 9001 and our organization's own standards and compare it to system in action (the so-called actual practice). The department who owns the system or process is rated during internal audit. There are items (clauses) that can be rated as all-or-nothing. For example. People category 6.2.2 Competence, awareness and training. Even if you determined the necessary competence of personnel, you provided necessary trainings, you keep the records but failed to evaluate the effectiveness, your rating in “people category” is zero. I feel that all-or-nothing rating system is not fair because if you didn't meet single requirement out of all, the rating is “zero”.

[Colin]

My first question would be 'who designed the rating system'? There is certainly no requirement in ISO 9001 to have a rating system.

Now, you may wish to have one but I agree that the scenario sounds a little harsh to get a zero when you indicate that 2 out of 3 criteria you list are being met.

Has the scoring for the rating system been defined, or is it down to personal judgement on the day?

[ngaran]

In Reply to Parent Post by Colpart

My first question would be 'who designed the rating system'? There is certainly no requirement in ISO 9001 to have a rating system.

the rating system was established before i joined the company.

In Reply to Parent Post by Colpart

Has the scoring for the rating system been defined, or is it down to personal judgement on the day?

ussually yes unless auditee is protesting.

[jerry_Malaysia]

In Reply to Parent Post by ngaran

the rating system was established before i joined the company.


ussually yes unless auditee is protesting.

I used to having the so-called all-or-nothing rating as well when i started ISO9001:2000 implementation back in year 2001. However, we have revised the rating to "grade 1-5" a couple of years ago in order to properly indicate the performance. Lately, we have revise it again because it was rather ambiguous.

There isn't any requirement for the rating system, so one should establish a rating system that is most effective and would benefits the organization most. If the rating system is not at all relevant, remove it.

[ngaran]

In Reply to Parent Post by jerry_Malaysia

here isn't any requirement for the rating system, so one should establish a rating system that is most effective and would benefits the organization most. If the rating system is not at all relevant, remove it.

we need to measure things because we established quality objectives at each relevant function... everywhere within the organization. i think measuring things will drive strategic improvements. maybe the "all-or-nothing" thing is the only meaningless exercise. otherwise "audit rating system" is wrong way of measuring quality objectives.

[ngaran]

In Reply to Parent Post by Colpart

Has the scoring for the rating system been defined, or is it down to personal judgement on the day?

i mean the rating system is defined.