Does this look like a Process Audit?

jeepdog

Starting to get Involved
#1
I just read the threads and I would like to add a question if I may. I too have been going nuts w/ the idea of process auditing. If I perform what I presume is a process audit for a detail part coming in the door and making its way to stock (i.e. product realization) we go thru - shipping receivers – PO clauses – Op. sheets - inspection- calibration -secondary machining- tooling- signed operations – evidence of inspection- shipping- packaging - purchase orders & approvals – approved vendors –special processes – flow down requirements- risk- Stock.

By the time I’m done preparing for this audit, I have 109 questions on a checklist which I’m told I’m not supposed to need or use and I’m told I’m auditing elements not the process. The questions I have developed come from our procedures and instructions. I ask things like “Is there evidence Critical characteristics are identified on ICL’s”, “Is there evidence Op. sheets are approved and have a revision” “Is there evidence of an approved list of vendors” and so on.
Essentially I turn every action stated in every procedure and instruction in the chain into a question.

I feel I am doing a process audit as I get from one end to the other and that a checklist is appropriate, but in the end I have a lengthy audit. Is an audit of 109 questions unusual? My auditors balk at what seems like a lot of questions but how do I show we do what we say without asking the questions? Am I too deep in the weeds with my questions? And I am newly RABQSA auditing certified (though I never got to get to this question for my first party audits). Sorry about the amount of info here!
 
Elsmar Forum Sponsor

Jim Wynne

Staff member
Admin
#2
I just read the threads and I would like to add a question if I may. I too have been going nuts w/ the idea of process auditing. If I perform what I presume is a process audit for a detail part coming in the door and making its way to stock (i.e. product realization) we go thru - shipping receivers ? PO clauses ? Op. sheets - inspection- calibration -secondary machining- tooling- signed operations ? evidence of inspection- shipping- packaging - purchase orders & approvals ? approved vendors ?special processes ? flow down requirements- risk- Stock.

By the time I?m done preparing for this audit, I have 109 questions on a checklist which I?m told I?m not supposed to need or use and I?m told I?m auditing elements not the process. The questions I have developed come from our procedures and instructions. I ask things like ?Is there evidence Critical characteristics are identified on ICL?s?, ?Is there evidence Op. sheets are approved and have a revision? ?Is there evidence of an approved list of vendors? and so on.
Essentially I turn every action stated in every procedure and instruction in the chain into a question.

I feel I am doing a process audit as I get from one end to the other and that a checklist is appropriate, but in the end I have a lengthy audit. Is an audit of 109 questions unusual? My auditors balk at what seems like a lot of questions but how do I show we do what we say without asking the questions? Am I too deep in the weeds with my questions? And I am newly RABQSA auditing certified (though I never got to get to this question for my first party audits). Sorry about the amount of info here!
Has your company identified its QMS processes? Those are the processes you should be auditing. What is the process you're referring to? While there might be trails that lead into other processes, 109 questions is definitely excessive.
 

Mikishots

Trusted Information Resource
#3
I just read the threads and I would like to add a question if I may. I too have been going nuts w/ the idea of process auditing. If I perform what I presume is a process audit for a detail part coming in the door and making its way to stock (i.e. product realization) we go thru - shipping receivers – PO clauses – Op. sheets - inspection- calibration -secondary machining- tooling- signed operations – evidence of inspection- shipping- packaging - purchase orders & approvals – approved vendors –special processes – flow down requirements- risk- Stock.

By the time I’m done preparing for this audit, I have 109 questions on a checklist which I’m told I’m not supposed to need or use and I’m told I’m auditing elements not the process. The questions I have developed come from our procedures and instructions. I ask things like “Is there evidence Critical characteristics are identified on ICL’s”, “Is there evidence Op. sheets are approved and have a revision” “Is there evidence of an approved list of vendors” and so on.
Essentially I turn every action stated in every procedure and instruction in the chain into a question.

I feel I am doing a process audit as I get from one end to the other and that a checklist is appropriate, but in the end I have a lengthy audit. Is an audit of 109 questions unusual? My auditors balk at what seems like a lot of questions but how do I show we do what we say without asking the questions? Am I too deep in the weeds with my questions? And I am newly RABQSA auditing certified (though I never got to get to this question for my first party audits). Sorry about the amount of info here!
If you're really going from one end to the other using this amount of scope, I'd say that what you're doing is a system audit, not a process audit. Individual processes make up a system. A registrar would be the group primarily interested in doing system audits.

Unless you've actually identified this entire flow as one process, I'd break it up into discrete processes and audit them that way. E.g. Purchasing, Production, NCM control, Inspection (incoming, in process, final), Order handling, Demand management etc. You could bundle control of docs , records, calibration, audits, CAPA as a QA process, supporting the PR activities.
 

John Broomfield

Staff member
Super Moderator
#4
I just read the threads and I would like to add a question if I may. I too have been going nuts w/ the idea of process auditing. If I perform what I presume is a process audit for a detail part coming in the door and making its way to stock (i.e. product realization) we go thru - shipping receivers ? PO clauses ? Op. sheets - inspection- calibration -secondary machining- tooling- signed operations ? evidence of inspection- shipping- packaging - purchase orders & approvals ? approved vendors ?special processes ? flow down requirements- risk- Stock.

By the time I?m done preparing for this audit, I have 109 questions on a checklist which I?m told I?m not supposed to need or use and I?m told I?m auditing elements not the process. The questions I have developed come from our procedures and instructions. I ask things like ?Is there evidence Critical characteristics are identified on ICL?s?, ?Is there evidence Op. sheets are approved and have a revision? ?Is there evidence of an approved list of vendors? and so on.
Essentially I turn every action stated in every procedure and instruction in the chain into a question.

I feel I am doing a process audit as I get from one end to the other and that a checklist is appropriate, but in the end I have a lengthy audit. Is an audit of 109 questions unusual? My auditors balk at what seems like a lot of questions but how do I show we do what we say without asking the questions? Am I too deep in the weeds with my questions? And I am newly RABQSA auditing certified (though I never got to get to this question for my first party audits). Sorry about the amount of info here!
jeepdog,

What is the name of this process?

What is your audit objective?

Auditors usually sample to verify effectiveness. Six questions are usually enough to initiate discussion and elicit evidence of effectiveness at critical points along the process necessary to fulfill the process audit objective.

When auditing you should have no need to repeat the comprehensive process monitoring already completed many times over by your colleagues.

John
 

jeepdog

Starting to get Involved
#5
Thank you all for responding- I?m buried in work which I guess is good but delays my response time. This was typed before I read your additional responses 1:55 NY time
To be concise: We have identified 4 core processes; Customer Order Process- Design Process ? Product Realization ? Management Systems (3rd party auditors balked at more because then they have to create more PEARS). Regardless, I am trying to break down our processes for auditing purposes to 7 basic areas.
1) Management Review ( to include 5.1 through 5.6.3 and 8.2.1, 8.2.2)
2) Resources and training ( to include 6.1 through 6.4)
3) Contracts ( to include 7.11 through 7.1.3 and 7.2.1 through 7.2.3)
4) Design (to include 7.3.1 through 7.3.7)
4) Purchasing (to include 7.4.1 through 7.5.1 and 7.1.4)
5) Product Realization (to include 7.5.2 through 7.5.5)
6) Calibration and Inspection (to include 8.2.3, 8.2.4 and 7.6)
7) Non-conforming product (to include 8.3 through 8.5.3)
My previous inquiry concerned #5 above ?Product Realization? I am trying to audit the process as stated in my previous question. I?m auditing the process of taking a detail part in from start to finish. Each function along the way has over 20 auditable sub routines I can ask. These functions include; OP sheets, calibration, purchase orders, shipping, stock room, etc.
So am I way down too deep in the weeds? Can I ask general questions and still satisfactorily cover the audit?
My audit objective has always been to see that we do what we say we do and meet contractually our customer?s requirements. Output Objectives and such, not so much.
 

John Broomfield

Staff member
Super Moderator
#6
Thank you all for responding- I?m buried in work which I guess is good but delays my response time. This was typed before I read your additional responses 1:55 NY time
To be concise: We have identified 4 core processes; Customer Order Process- Design Process ? Product Realization ? Management Systems (3rd party auditors balked at more because then they have to create more PEARS). Regardless, I am trying to break down our processes for auditing purposes to 7 basic areas.
1) Management Review ( to include 5.1 through 5.6.3 and 8.2.1, 8.2.2)
2) Resources and training ( to include 6.1 through 6.4)
3) Contracts ( to include 7.11 through 7.1.3 and 7.2.1 through 7.2.3)
4) Design (to include 7.3.1 through 7.3.7)
4) Purchasing (to include 7.4.1 through 7.5.1 and 7.1.4)
5) Product Realization (to include 7.5.2 through 7.5.5)
6) Calibration and Inspection (to include 8.2.3, 8.2.4 and 7.6)
7) Non-conforming product (to include 8.3 through 8.5.3)
My previous inquiry concerned #5 above ?Product Realization? I am trying to audit the process as stated in my previous question. I?m auditing the process of taking a detail part in from start to finish. Each function along the way has over 20 auditable sub routines I can ask. These functions include; OP sheets, calibration, purchase orders, shipping, stock room, etc.
So am I way down too deep in the weeds? Can I ask general questions and still satisfactorily cover the audit?
My audit objective has always been to see that we do what we say we do and meet contractually our customer?s requirements. Output Objectives and such, not so much.
jeepdog,

Of your four processes only three are processes:

  1. Securing customer orders (selling?)
  2. Designing (products and their processes?)
  3. Realizing (and delivering) products
Management Systems is not a process.

Developing your management system for the convenience of your third party auditors is appalling to me.

Your process owners could usefully complete their own PEARs (of the key processes within your core process) in any case.

Best wishes,

John
 
#7
JD - any process can be audited from a basic premise of:

What's the objective (s) for the process ? These may be managements or customers. e.g. Got to make 100 of X and 200 of Y with zero scrap or rework (100% FTT)
What's the plan for process and how is it controlled? For example a machining process uses travellers and they define the various steps to go through including any inspections.
Are any documents needed the right ones? Work instructions, check sheets, move tickets etc.
Are there any inspections made and what equipment is used? If it is necessary to calibrate them, has it been done?
Do they make rejects? If so are they tagged etc.
WHat records do they keep of the process? What do the results show in terms of the objectives in Q1?
IF they are making rejects, how are they meeting their plans? Do management know? Are there shortages or problems being caused by other processes (suppliers? design specs? etc.
Of course, you can throw in preservation/tagging of the parts/assemblies too for good measure!

This might be enough to get going on a small-scale audit to give auditors some practice etc. Keep your eyes open for issues, so that the next process audited can be linked to this one for problem reolution - like machine pm for example, which may be causing downtime!
 
Thread starter Similar threads Forum Replies Date
N Small Company - Internal audit process - Who does the audit? Internal Auditing 16
A What does a good business practice Process Audit look like for AS9100D? Process Audits and Layered Process Audits 9
X Audit Findings - The Process/Clause Matrix does not identify all the processes ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 30
D NADCAP Audit - No work in house - How does a NADCAP auditor audit the process? AS9100, IAQG 9100, Nadcap and related Aerospace Standards and Requirements 8
J Process Audit recommendation within ISO TS 16949? Does it exist like in VDA? Process Audits and Layered Process Audits 18
B Process FMEA Scope - Does PFMEA cover Incoming (Receiving) Inspection & Dock Audit? FMEA and Control Plans 8
R Where does IATF 16949 address Process mapping? IATF 16949 - Automotive Quality Systems Standard 3
Watchcat Does 820.30 include the manufacturing process? 21 CFR Part 820 - US FDA Quality System Regulations (QSR) 2
Watchcat Does ISO 13485 7.3 include the manufacturing process? ISO 13485:2016 - Medical Device Quality Management Systems 14
L How to evaluate the process capability of a data set that is non-normal (cannot be transformed and does not fit any known distribution)? Capability, Accuracy and Stability - Processes, Machines, etc. 12
M IATF 16949 - 8.5.6.1.1 Providing a list of process controls: Does this requirement add value to QMS? IATF 16949 - Automotive Quality Systems Standard 4
D Where does FMEA fit in your ISO 14971 Risk Management process? ISO 14971 - Medical Device Risk Management 13
C Does Japan accept the Bracketing Approach for Process Validation Japan Medical Device Regulations 1
J Where does process validation fit within design & development? Design and Development of Products and Processes 7
N What does an effective design process look like? (shoots flare in the air) Design and Development of Products and Processes 2
M Does a process map satisfy 21 CFR 820.20(d) (Quality Plan)? 21 CFR Part 820 - US FDA Quality System Regulations (QSR) 4
O Design and Development Process - Does one size fit all? ISO 13485:2016 - Medical Device Quality Management Systems 13
P Does anyone have a DFMEA process Interface Matrix .xls template FMEA and Control Plans 7
L Medical Device New Product Design & Development- How long does this process take you? Other Medical Device and Orthopedic Related Topics 1
Chris Ford How does the EPA Establishment Registration Process Work? Various Other Specifications, Standards, and related Requirements 2
Marc Does ISO 9001 *require* that Internal Audits be Process Audits? ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 5
JodiB What point does the Accreditation begin in the process? ISO 17025 ISO 17025 related Discussions 6
B ISO9001 Process Organisation Diagram - Does this make sense to you? ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 4
K Does FMEA include Inspection Process? FMEA and Control Plans 11
F How does Process Mapping help to make a process more Transparent to the Customer? Process Maps, Process Mapping and Turtle Diagrams 2
Z Does this Process need an established Documented Procedure? ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 11
R Does IVD 510k application always goes to pre-IDE and IDE process? 21 CFR Part 820 - US FDA Quality System Regulations (QSR) 2
Q Does every Process Control listed in FMEA have to be listed in the Control Plan FMEA and Control Plans 4
D BMW Project - How does their APQP process work? IATF 16949 - Automotive Quality Systems Standard 6
G Is 100% Inspection a Control or does a Process need another type of control? FMEA and Control Plans 9
G What does a Process Capability Index of greater than 1 suggest? Capability, Accuracy and Stability - Processes, Machines, etc. 3
J Change Management System - Does ISO 9001 specify you need a process flow? ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 11
H What process does 7.0 Product Realization refer to? ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 18
B What does "Targeted process follows Normal distribution" mean? Statistical Analysis Tools, Techniques and SPC 9
D What does the entire process range mean? (MSA manual page 73) Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 7
K Process monitoring, measuring and analyzing, does this means all company processes? ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 3
C Does a Chronically Unstable Process need a Capability Analysis? Statistical Analysis Tools, Techniques and SPC 10
S TUV NCR No: 1 - Autoclaving: The process validation does not comply ISO 13485:2016 - Medical Device Quality Management Systems 8
J Does anyone have a procedure that covers Layered Process Audits Process Audits and Layered Process Audits 1
O PPAP Process Map - Does anyone map out the PPAP process for the Big Three? Process Maps, Process Mapping and Turtle Diagrams 2
J Does GM require an Inspection Standard in the APQP process? APQP and PPAP 3
Le Chiffre ISO 13485 Process Model Diagram - Does anyone have one? ISO 13485:2016 - Medical Device Quality Management Systems 9
T Does Delphi's requirement for layered process audits only apply to their products? Process Audits and Layered Process Audits 15
C Toyota Firewall Process - TPS - Does anyone know what this is? Details? FMEA and Control Plans 14
G Does The FDA oppose the use of Process Flow Charts? ISO 13485:2016 - Medical Device Quality Management Systems 8
L Does anyone have a completed AIAG Process Identification tool Manufacturing and Related Processes 4
S What does ?risks of the process? mean in process analysis? IATF 16949 - Automotive Quality Systems Standard 1
M APQP & PPAP - Does Toyota follow the APQP and PPAP process? Customer and Company Specific Requirements 5
J Does any black belt meet this situation? The problem is the process Six Sigma 6
L Does the APQP process end with the approval of the PPAP? APQP and PPAP 5
Similar threads


















































Top Bottom