Sample Size in Auditing - Percentage audited when performing an internal audit

Marc

Hunkered Down for the Duration
Staff member
Admin
#1
On 8/22/02 9:57 AM, Califano, Dina wrote:

Marc,

I tried to post a question on the auditing forum, but I did not yet recieve the e-mail required to complete the registration process.

I was wondering if you could answer this question for me.

I was wondering what the industry standard is for percentage audited when performing a quality audit. The departments that I will be auditing, currently have their own staff (a no-no) performing their own audit on 2% of the work processed. The average payments processed for this department is 1900 a week. Is auditing 2% of these enough?
Well, auditors, what do you say? Can you honestly say you determine a statistically valid sample size when you audit? How do you determine what the population is when you're planning and such?

I think this has been discussed before but I couldn't find the thread in a search.
 
Elsmar Forum Sponsor
D

D.Scott

#2
IMHO - I can see no problem with their own staff doing the audits as long as they are not doing their own work. After all, they understand the process better than anyone (I hope).
Next, the sample size should be based on the circumstances of the department. 38 audits would be fine if the audit results are not showing where a higher number is needed. (95% confidence would have sample size of 125 for 1900 "lot"size).
If management has determined 2% as an acceptable indicator, I wouldn't challenge it unless the results weren't giving valid results.

Just MHO

Dave
 

gpainter

Quite Involved in Discussions
#3
The number 3 usually comes up when auditing a QMS. Been to different courses by different providers and talked to different auditors and 3 seems to be the number.
 
C

C Emmons

#4
I conduct internal audits on 19 different sites - My sampling size is one days worth of documentation - that way I cover a sample of all associates in the facility as well. I work for a transportation company - So for instance - we require our drivers to sign the bills of lading in a specific format - when I am auditing a site - I audit one days worth of bills of lading - that gives me a sampling of all drivers...Dont know if it would work for your industry.
 
R

Rick Goodson

#5
Regardless of whether you are doing internal auditing or third party auditing, there isn't enough time to do statistically valid sampling. As Mr. Painter puts it so well, three seems to be the magic number.

Actually you can draw some valid conclusions from the small sample sizes. Intuitively if a process is running well there should be very few errors. If you draw small samples from a process that has a very small error rate, the probability of finding a non-conformance is extremely small. If you find non-conformances the process probably has a large error rate. Unfortunately, not finding errors does not prove the process is in good control.
 

Mike S.

Happy to be Alive
Trusted Information Resource
#6
D.Scott said:

38 audits would be fine if the audit results are not showing where a higher number is needed. (95% confidence would have sample size of 125 for 1900 "lot"size).
Dave
Dave,

Tis' been awhile since I've went thru my statistics text for a refresher, but I don't see how you can make the above statement about a sample size of 125 for a 1900 lot size giving a 95% confidence interval if you don't know the std. dev. of the process and what degree of sampling error is acceptable. Help. What have I forgotten????
 
J

JCVP1969

#7
I know it is not exactly the answer you are looking for but there is a random sampling statistical quality control standard that may offer some guidance!

It is not really auditing but at least something to base it on that is useful when someone queries your decision.

Anyway here is the link (give me a shout if it does not work!)http://www.ili.co.uk/cgi-bin/main_frames?DATA=49B981BE:
 
R

RJFisher

#8
Our CB always chooses 3 samples of whatever she's auditing, so I just follow suit with our internal auditing... :agree1:
 
#9
If your internal audit process replicates the CB process then go ahead with that sampling. I'd suggest that if you want to get real value from your audits then you will take whatever sample shows the process is under control. It may be one sample or all of what was 'done' in July.

It depends on the objective(s) of the audit, not just some number plucked out of the air or an emulation of another auditor who was doing an entirely different type of audit!
 
Thread starter Similar threads Forum Replies Date
N Auditing Proof of Delivery signed by the customer - Determining Sample Size General Auditing Discussions 6
P Unrealistic Packaging Validation Sample Size 21 CFR Part 820 - US FDA Quality System Regulations (QSR) 13
J Control chart for huge sample size Statistical Analysis Tools, Techniques and SPC 9
S Is there a standard for sample size during R&D phase Other ISO and International Standards and European Regulations 18
J Sample size definition in an Automotive SMT pilot lot run Misc. Quality Assurance and Business Systems Related Topics 1
E Correct way to certify hydrostatic testing when it is not 100% (and Sample Size) Various Other Specifications, Standards, and related Requirements 6
B Determining sample size for device sterility Inspection, Prints (Drawings), Testing, Sampling and Related Topics 3
D Determining of sample size for 'Operational Qualification' AQL - Acceptable Quality Level 3
F Bayes Success run Theorem for sample size during OQ&PQ Qualification and Validation (including 21 CFR Part 11) 4
I Device modifications - Clinical sample size rationale EU Medical Device Regulations 5
J Sample size for creating a data base as a reference to a tested variable Other Medical Device and Orthopedic Related Topics 6
T Sample Size for Design Validation Design and Development of Products and Processes 4
C AS9138 Sample Size Determination AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 1
V Acceptable maximum RSD (relative standard deviation) for an sample size Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 1
E Sample size for design verification of variable in single use device Design and Development of Products and Processes 19
R Sample size for clinical validation/investigation EU Medical Device Regulations 4
R Process Validation sample size selection Statistical Analysis Tools, Techniques and SPC 0
J Interesting Discussion Sample Size Determination for Medical Device Other Medical Device and Orthopedic Related Topics 9
P Is it possible to make an educated decision using a very very small sample size? Inspection, Prints (Drawings), Testing, Sampling and Related Topics 3
F Sample Size for Biocompatibility Tests Other Medical Device Related Standards 4
V Firmware Verification Testing & Sample Size Software Quality Assurance 1
R Determining Sample Size for Medical Device Component Validation Inspection, Prints (Drawings), Testing, Sampling and Related Topics 0
S Surveillance Sampling Test - Determining Sample Size Inspection, Prints (Drawings), Testing, Sampling and Related Topics 5
H Sample Size Calculation (Confidence Interval and Reliability) - Medical Devices Reliability Analysis - Predictions, Testing and Standards 6
P Cleaning and Disinfection Validation Sample Size of 3? Other Medical Device Related Standards 2
V Sample Size Calculation for Image Analysis - Microscopy Inspection, Prints (Drawings), Testing, Sampling and Related Topics 2
G Sample Size, Significant Figures, Scale General Measurement Device and Calibration Topics 3
L Heated Sealed Packages - Sample Size for OQ (Operational Qualification) and PQ Inspection, Prints (Drawings), Testing, Sampling and Related Topics 11
P Frequency and Sample Size Requirements for an MSA Studies Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 4
V When and How to apply the Bayes Success Run approach for Sample Size Determination Inspection, Prints (Drawings), Testing, Sampling and Related Topics 4
N Sample Size Justification for Medical Device Shelf-Life Inspection, Prints (Drawings), Testing, Sampling and Related Topics 13
C Process Qualification Sample size Document Control Systems, Procedures, Forms and Templates 6
G Sample size for IEC 60601-1-11 environmental tests IEC 60601 - Medical Electrical Equipment Safety Standards Series 1
G IEC 60601-1-2 Sample Size issue Other Medical Device Related Standards 1
A How to calculate Mean and standard deviation without sample size in Minitab Using Minitab Software 5
D What is the minimum Sample Size for Weibull Analysis Reliability Analysis - Predictions, Testing and Standards 12
C Sample Size for Stability Testing Other Medical Device and Orthopedic Related Topics 2
M Calculating Cpk when sample size equals to 1 Capability, Accuracy and Stability - Processes, Machines, etc. 12
F Power and sample size for factorial design Using Minitab Software 4
S Sample Subgroup Size for NP/P chart - nPbar>=5 Statistical Analysis Tools, Techniques and SPC 4
U Sample size to prove parts are good with 99.73% confidence Inspection, Prints (Drawings), Testing, Sampling and Related Topics 4
F Sample Size to get Statistically Valid Data Measurement Uncertainty (MU) 6
S Low Sample Size for Gage R&R Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 1
S SPC Card for One Sample Size - Customer requires for all critical dimensions Statistical Analysis Tools, Techniques and SPC 8
S Determining sample size for inspection to achieve x% confidence re defects Misc. Quality Assurance and Business Systems Related Topics 10
S Determining Sample Size - AQL & LQ AQL - Acceptable Quality Level 10
B Bayes Success-Run on Attribute Data - Determining Sample Size Statistical Analysis Tools, Techniques and SPC 2
J Flammability: Testing Burn Rate with Improper Sample Size fmvss 302 Various Other Specifications, Standards, and related Requirements 1
H Factory Dictated Sample Size Justification Statistical Analysis Tools, Techniques and SPC 9
M Design Verification: "Difference" in Sample Size Calculations? Design and Development of Products and Processes 1

Similar threads

Top Bottom