ASQ Certification Exam Pass Rates - Per QCI

H

holly21

#1
I recently attended a local ASQ meeting where the guest speaker was Bill Wortman of the Quality Council of Indiana. He shared some information concerning certification exam pass rates that I thought was interesting. I was surprised at the variance from exam to exam.

I know that ASQ doesn’t typically publish this information, so after checking with the moderator, I’m happy to post and share. Below I’ve listed the certification, the average pass rate, and the time period over which the average is calculated.


CMI 58% 3/95 – 3/05
CQT 50% 3/95 – 3/05
CQM 62% 3/95 – 3/05
CRE 51% 3/95 – 3/05
CSSBB 76% 10/01 – 3/05
CQE 43% 12/94 – 12/04
CQA 70% 6/98 – 12/04
CSQE 60% 6/99 – 12/04
CQIA 84% 12/00 – 12/04
CCT 72% 6/03 – 12/04
 
Elsmar Forum Sponsor

Jim Wynne

Staff member
Admin
#2
Using ASQ's unique methods of data interpretation, I think it's safe to say that all of those who passed must now have better jobs, and CSSBBs must be much smarter than CQEs.
 

Wes Bucey

Quite Involved in Discussions
#3
holly21 said:
I recently attended a local ASQ meeting where the guest speaker was Bill Wortman of the Quality Council of Indiana. He shared some information concerning certification exam pass rates that I thought was interesting. I was surprised at the variance from exam to exam.

I know that ASQ doesn’t typically publish this information, so after checking with the moderator, I’m happy to post and share. Below I’ve listed the certification, the average pass rate, and the time period over which the average is calculated.


CMI 58% 3/95 – 3/05
CQT 50% 3/95 – 3/05
CQM 62% 3/95 – 3/05
CRE 51% 3/95 – 3/05
CSSBB 76% 10/01 – 3/05
CQE 43% 12/94 – 12/04
CQA 70% 6/98 – 12/04
CSQE 60% 6/99 – 12/04
CQIA 84% 12/00 – 12/04
CCT 72% 6/03 – 12/04
There are lots of reasons folks don't pass the ASQ certification exams.

I regret that ASQ does not apparently explore the "why" behind the apparently high failure rates of some of the exams.

These numbers "seem" accurate to me.

Govind has been on a crusade of late in trying to disseminate information about the exams to help folks study "smarter" in preparing for the exam.

It is important to know the exams are not graded on a curve, but on an absolute scale. ASQ does sometimes give everyone credit for questions which are found to be "ambiguous" or "wrong" after the exam has been taken.

Anecdotally, I hear most folks just were not prepared for the relentless effort needed to complete the test within the time period. Rehearsal with timed tests is paramount, regardless of how much knowledge you have of the BOK.

A second problem is the number of folks dealing with English as a second language. (In many cases, even regional "English" from Alabama, Canada, Great Britain, Australia, India can foment problems) - this springs back to time problems in that the effort of assimilating the nuances of English used in the exam takes time.

I would guess there are many folks who are completely naive in the way they approach the test. I recall seeing posts in ASQ Forums similar to:
"I am sitting for the CQE next month. Which books should I study?"

Folks - even I would hesitate to wait until a month before an exam to start asking about books to study. These tests are NOT like the SAT - they don't test your native intelligence, they test your knowledge and ability to apply the Body of Knowledge. Think of most of them as the final exam after a particularly rigorous graduate level course in school. If a school term lasts three months, you should probably expect to be reviewing and studying for the equivalent of that same school term. If you aren't conversant with the BOK, the fact these are open book tests won't help you one bit.

I have a lot of complaints about the certification system, but the fact so many folks fail a test is not in my list of complaints.
 
L

Lynda Young - 2008

#4
ASQ Certification

I have a problem with the percentages that are listed. I have written both the CQE and CQM in each I obtained a 70 + on both. The rating I received was 540 with 550 being the passing grade on their "bell curve". Am I missing something?
 
R

ralphsulser

#5
Wes said:Anecdotally, I hear most folks just were not prepared for the relentless effort needed to complete the test within the time period. Rehearsal with timed tests is paramount, regardless of how much knowledge you have of the BOK.

This is absolutely correct-actually the discipline one must be prepared to practice, practice, practice.

When I passed the CQE on the first time that what I did, and the info was that only 50% pass the first time. This was Dec. 1986
 
L

Lynda Young - 2008

#6
ASQ Certification

ralphsulser said:
Wes said:Anecdotally, I hear most folks just were not prepared for the relentless effort needed to complete the test within the time period. Rehearsal with timed tests is paramount, regardless of how much knowledge you have of the BOK.

This is absolutely correct-actually the discipline one must be prepared to practice, practice, practice.

When I passed the CQE on the first time that what I did, and the info was that only 50% pass the first time. This was Dec. 1986
I agree that that can be a problem, I was ready for the for the efford and did not have a problem with the timing in either exam, I finished with extra time. It is the use of the "Bell curve" that I feel is wrong.
 

Wes Bucey

Quite Involved in Discussions
#7
The issue of curves, cut scores, etc. is a frequent topic of discussion among ASQ members. Here are some excerpts from recent posts in the ASQ Forums moderated by our own Govind which address this topic. There was some "misinformation" that was answered by Sally Harthrun, the lady who manages certification for ASQ - her comment is in blue:
Gregory Gay

Posts: 60

Re: Letter: Study as if Exams Are Closed Book
Posted: Jan 18, 2005 5:55 PM Reply


Just a little about cut scores
There is not a minimum on any section
if you do really good on one section,
you can do really bad on another
it is the total score that counts
no one question is any more important than any other question. questions are developed by sections of the bok and there maybe more questions in one section than in another.

an exam cycle is about 5 years and the cut score is developed on the first exam in that cycle. each exam after the first is adjusted up or down depending on if any questions on the new exams are in error. There is a mini exam made up of part of the first exam in each of the following exams in the cycle. this mini exam is scored to equate the first and new exam to help determine if the cut scores remains stable. It is quite a process, but not that hard.

It is worth note that there is a cut score not a passing rate or a grade on the curve. If 100 percent of the people taking the exam reach the cut score they all pass. Although it is a "secret" what the cut score is, it is not hard to determine what the cut score is when you know a few people that have taken the exam and some passed and some failed.

We are talking about a certification exam and it does not make much sense to certify people passing at 60 percent. And although I would like to see high scores it just does not make sense to fail a certification attempt at 89 percent. Even at 80 percent you are missing 20 questions per 100 questions asked. That seem like a lot when you are working on zero defects, and 3 parts per million in the day job.

I tell people to get through 80 percent correct. It is a good goal and study guide. Cut score could be higher or lower than 80 percent, however if you are studying at least the 80 percent level in all sections your strong sections will carry you through the exam.

What I tried to do was study at the 95 percent level in my weakest areas (why study what you are good at), and also study the hardest in the areas that most people miss. Your score will be higher than theirs. So although there is not a curve, you should still pass. People have a lot trouble with statistics. I do also, so I studied that section the hardest to try to get 95 percent in stats.

What is really fun after you have obtained a certification is helping develop the new exams. I think I learned more on the subject matter creating exams than preparing to take them. Each 5 years the exam cycle starts over and ASQ is always looking for certified individuals to keep the exams current.

What is really crazy, I know of an individual that takes CQE by recert exam not points. And has done it for a few 3 year cycles. I think he like pain. (willy)

Best of luck in your certification efforts. It is not as hard as it might seem if the prep is there.

Gregory


indeed, is a minimum pass
> > mark for the 10 sections of the BOK.
> > Questions pertaining to each section must be
> passed
> > at a 75% rate. Exams are not separated into
> sections
> > but questions can be attributed to one section or
> > more.
>
> Govind is correct about the "cut score". What
> qualifies as a passing score is determined AFTER the
> exams are scored each time based on a VERY closely
> guarded secret formula. Because the questions change
> for each exam there are questions which are thrown
> out after the scoring is done when the scorers
> realize the question was a bad question or there were
> multiple right answers or the right answer was not
> one of the possible answers. They also evaluate the
> score distribution to determine if the current exam
> was more difficult or easier than normal.
> Incidentally, the "cut score" practice is a commonly
> y accepted practice in the ETS (Educational Testing
> Service) world.


@@@@@@@@@@@@@@@@@@@@@

Sally Harthun, the Manager of Certification

Posts: 8

Re: Letter: Study as if Exams Are Closed Book
Posted: Jan 19, 2005 10:27 AM Reply


Hi Bill - I would be happy to answer this question. For all of our exams, it is an overall score that must be obtained. You can do very poorly in one section of the BOK, but if you do well enough in the other areas to obtaining the passing grade you pass. We do not limit the number of people who pass by section or any other method. Anyone who obtains the passing score passes - it is just that simple. I know that people do, indeed, believe there is some type of "limit" that we place on the number of people who pass, but that simply is not true. We tried to address that rumor when we put together the "Ten Myths of Certification" that is listed on the web site. Thanks for allowing me to address this once again.
The ten myths:
http://www.asq.org/cert/pdf/TopTenMythsOfCert.pdf said:
Top 10 Myths of Certification
Myth: If an answer is obvious it must be a trick question.
FACT: Just because an answer is obvious to you doesn’t mean it is obvious to everyone. Don’t let the fact that this is a test question get in the way of your knowledge. Answer it and move on. Don’t read more into the question in an effort to make it harder.

Myth: Guessing wrong can hurt your score more than leaving an answer blank.
FACT: There is no penalty for guessing, and you have a 25% chance of getting it right. Although some tests use “formula scoring” methods, ASQ certifications do not. You get one point for each question you answer correctly and zero points for those you get wrong or leave blank.

Myth: The passing score for all ASQ exams is 70%.
FACT: The passing score for each ASQ exam is established as a minimum performance standard during the cut-score process.

Myth: Taking a section refresher course or buying ASQ exam prep material is a sure way to pass.
FACT: Section refresher courses and the self-directed products are excellent ways to prepare for the examinations, but using them does not guarantee that you will pass. Refresher courses are meant to renew your knowledge, not to instruct you in areas that aren’t familiar to you. Questions from the self-directed products will assist you in becoming familiar with how to answer certain questions, but they are not the same questions that you will see on the exams. Individual study is also a critical element for success.

Myth: If you do poorly on one area of the body of knowledge, you automatically fail the test.
FACT: Your total score on the examination determines whether you pass or fail, not your score on any one portion of the test. Even in the certified quality manager’s exam it is possible to pass if you do poorly on the constructed response portion, as long as your overall score is at or above the passing grade.

Myth: ASQ limits the number of people who pass.
FACT: Anyone who meets or exceeds the passing score (cut point) passes the examination. ASQ does not set a passing rate.

Myth: The grading of the constructed response portion of the certified quality manager exam is very subjective.
FACT: The constructed response portion of the exam is designed to test the candidate’s ability to respond to realworld situations. The responses are scored by certified quality managers who have been trained in the evaluation techniques used for the scoring process. In addition, all the scorers judge the papers against a standard of performance that is specific to each essay question. That standard is neither arbitrary nor subjective, but is developed on the basis of sound quality practices, as described and prescribed in major textbooks in the field of quality. The essay questions are pretested on a group of certified quality managers, so the development of the question includes a reality check to make sure that the committee’s expectation of performance matches actual responses.

Myth: It takes a long time to receive exam results.
FACT: ASQ works very hard to provide exam results as quickly as possible and is very aware that the examinees are anxious to learn whether they have passed or failed. As a direct result of bringing the exam development in house, ASQ has recently reduced the exam turnaround time from eight weeks to two weeks, and to three and one-half weeks for the quality manager results. There are many steps that have to be completed, verified, and checked prior to sending out the results. The answer sheets are sent back to ASQ headquarters and scanned, and statistics must be run and reviewed by the test development staff and appropriate volunteers. The results are then scored, verified, and uploaded to a computer before any result letters can be generated. ASQ is continuously working to reduce this cycle time.

Myth: Test questions are deliberately tricky.
FACT: ASQ goes through an extensive process to ensure that examination questions are as accurate, clear, and concise as possible.

Myth: I can’t learn from my mistakes if I don’t get my scored test back.
FACT: Because of its policy to reuse examination questions, ASQ cannot release copies of the examinations. Releasing tests would give the retake applicants an unfair advantage over candidates taking the examinations for the first time. The integrity of the examination process is of paramount importance to ASQ. Besides, it would not support the underlying premise of the certification program for candidates to just study the questions they got wrong, as it would not ensure that they would understand the material any better. It is more appropriate for the retake candidates to use the diagnostic information to identify the areas where they are weak and improve their knowledge in those areas.
 

Govind

Super Moderator
Staff member
Super Moderator
#8
Pass rate:
First of all, I would like to thank Holly taking the initiative to post the information. One thing you may want to check with Mr.Bill Wortman is if he also included the results of exams conducted during Special administration like Conferences. Very few people sit in these exam (mostly single digits/exam). Even if one or 2 people fail, or Pass, this % will skew the overall % on either end. Including these special administration data may not be a good idea. Iam sure Mr.Wortman would have taken care of this, as he is very familiar with various certifications for many years.

Scores and process:
ASQ cut off score for various exams have always come up. It is a closely guarded secret. It is not known outside the Certification offerings. The process of obtaining such cut score (which is described in any certification brochure Page 5- Grading Process).

ASQ takes very careful review of candidates who sit for Cut score process so that they do not skew the score and/or add bias. Equaters are created to compare the difficulty between exam-to-exam and statistically analyzed. Cut score adjustments are made if indeed one is different than other based on performances of candidate groups.

ASQ takes a look at every exam question based on historical performance and see if the discriminator is significant enough between top quintile to the bottom quintile. Poorly performing questions are critiqued and reviewed at Item review.

Exam preparation:
Wes, thanks for pointing the right direction from previous discussions and ASQ Brochure. Very good inputs on your post regarding exam failures. Many exam failures can be attributed to lack of preparation and practice. Certification exam require between an average 125~150 hours of good preparation. Wes is right. Trend look like, many wait until the last minute to even enquire about references and when they get too close to exam, either they reschedule or try their luck.

Almost every week, someone call me or send mail asking about certification preparation. Sometimes I find that people try to register in exams not very appropriate for them. Right selection of exam based on their job requirement, experience, career progression is also very important. This also can cause failure, as they may be ready to face the exam with mere self-study or refresher courses. I have provided them with suggestions with Pros-Cons.

Language also is a probably a reason when it comes to non-native speakers. But the impact could be mainly on Certification like CQMgr and CQA where you can expect more of non-mathematical, non-statistical questions.

BTW, Good inputs from all the contributors. Please continue with our thoughts.

Regards,
Govind.
 

gard2372

Quite Involved in Discussions
#9
Missed it by "That Much"

Hello Covers,

I recently took the CQE at a local conference in March. I believe their were only about 5-6 CQE testers, the rest were made up of CSSBB's, CQM's, CQA's, etc...

Unfortunately I did not pass. I got 510 out of 550. This was my first test in the ASQ Best Answer format. I did better than I thought only to have paid $180 to find out what I had already presumed that I did not allow myself enough time to study. I studied almost everyday for about 3 months, while juggling a full time college schedule and a full time job.

I'm scheduled for a CQE refresher course in Oct, to prep for the CQE in December. I have to admit that all these threads are correct from the successful ASQ Cert takers. Study as if it were a closed book exam and utilize effective time management... I used the full five hours.

I used the Quality Council of Indiana's Study materials (I am not supporting the solicitation of their materials) and found them to be very helpful. I also used the ASQ Press CQE Handbook, CQT Handbook, and Juran's Quality handbook. All of these reference materials were helpful.

The Quasi Pareto analysis of my test results in comparison to the other CQE testers that passed were almost even, except when it came to the Quantitative analysis section you know Stats (scored 33 correct out of 53 or something like that) :mad: I did take two courses in Statistics last year so the material wasn't totally foreign but I admit I need to brush up.

All in all I think I did o.k. for the first time taking a CQE exam (speaking from a Lamen standpoint) 510 out of 550. I now have somewhat of a measuring stick in which to set the bar for my preparation for the next CQE exam.

Thanks to all of you seasoned Covers.

Rob :agree1:
 
Last edited:
B

Bill Pflanz

#10
holly21 said:
CMI 58% 3/95 – 3/05
CQT 50% 3/95 – 3/05
CQM 62% 3/95 – 3/05
CRE 51% 3/95 – 3/05
CSSBB 76% 10/01 – 3/05
CQE 43% 12/94 – 12/04
CQA 70% 6/98 – 12/04
CSQE 60% 6/99 – 12/04
CQIA 84% 12/00 – 12/04
CCT 72% 6/03 – 12/04
Govind and I have answered many questions on the ASQ Board over the last year about certifications. Here are a few of my thoughts.

The CQM pass rate may be higher since it has a requirement of 10 years experience in the quality field. It requires a broad knowledge of quality that is usually obtained in the workplace and regular review of quality literature that quality professionals gather over that time. I believe its pass rate has improved as the study material has grown.

CQA is obviously meant for practicing auditors and the questions reflect that real world experience. I would expect a higher pass rate from that group since many in the auditing arena (including ISO 9000 audits) are interested in the certification.

I am surprised by the high pass rate for CSSBB although it is consistent with my local ASQ section results (as a section officer I see our member pass rate information). CQE's who take the test usually do well. For those who think you can pass it by just reading the Six Sigma books by the gurus or knowing DPMO calculations, you will not do well. After the CQE and CRE certifications, it is probably the most technical.

The CQIA is testing the most basic knowledge of quality and is not surprising that it has the highest pass rate.

ASQ refrains from issuing information about raw scores since the same test is not used every time. The cut score is supposed to make it more fair for test takers when a test is more difficult or easier than other versions. The scaled score that you receive is not the number of questions that you answered correctly or a percentage of the questions but a conversion using a statistically based procedure of "equating" to compensate for the differences in the test. The scaled score shows your performance against previous results taking into account the difficulty level of the test. The 550 that was referred to is the scale score but it does not tell you anything about your raw score. The cut off for passing has always been 550.

The arithmatic average (used for simplicity) for all certifications is a pass rate of 63%. If you factor in that the newer certifications have higher pass rates, that would probably explain the usual rule of thumb of a 40-60% pass rate that I have heard used in the past. In our school system, a 63% pass rate would be considered a failure. Maybe we need a No Quality Professional Left Behind federal program to increase the pass rate. :D


Bill Pflanz
 
Thread starter Similar threads Forum Replies Date
A Any recommendation for ASQ's CPGP (Pharmaceutical GMP Professional) Certification exam questions? ASQ - American Society for Quality 2
Q ASQ CQM (Certified Quality Manager)/OE Certification Exam Preparation Materials Professional Certifications and Degrees 3
Govind Test Run: Improve Your Chances of Passing an ASQ Certification Exam Professional Certifications and Degrees 2
W Where to buy referenced standards - ASQ Biomedical Auditor Certification - CBA exam Professional Certifications and Degrees 1
ScottK Good Luck to anyone sitting for an ASQ Certification exam tomorrow. Professional Certifications and Degrees 21
Govind ASQ Certification Exam: Tips, Trips and Traps Professional Certifications and Degrees 6
A Quality Council of Indiana - ASQ's CQE and CQA Certification exam materials Professional Certifications and Degrees 23
V Certified Auditor - Need of additional certification specific to industry ( GMPs) ASQ vs ECA vs others Professional Certifications and Degrees 1
P ASQ Certified Biomedical Auditor (CBA) Certification Preparation 2019 ASQ - American Society for Quality 3
J ASQ Chicago Training Institute - If any of you are interesting in teaching ASQ Certification preparation ASQ - American Society for Quality 1
D ASQ CMQ/OE Certification - Share your thoughts ASQ - American Society for Quality 3
P ASQ Certified Supplier Quality Professional is the certification worth it? Supplier Quality Assurance and other Supplier Issues 1
R The on-line re-certification option on ASQ's website Professional Certifications and Degrees 5
H RABQSA ISO 9001:2008 Lead Auditor or ASQ CQA - Which certification? ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 4
Q Question about 2012 ASQ CQE certification primer vs 2006 primer Professional Certifications and Degrees 2
D Which ASQ Certification should I start with? Career and Occupation Discussions 9
H Choosing between RABQSA Lead Auditor or ASQ CQA Certification Professional Certifications and Degrees 2
G IQF Six Sigma DMAIC Certification vs. ASQ Certification Six Sigma 4
V Presentation and Question about ASQ's Six Sigma Certification Six Sigma 5
V Best Six Sigma certification agencies in India vs. Online ASQ certification course Professional Certifications and Degrees 12
G ASQ CQA Certification vs. RABQSA or IRCA Lead Auditor Certification Professional Certifications and Degrees 7
T ASQ Certification Testing Book and Study Guide recommendations wanted Book, Video, Blog and Web Site Reviews and Recommendations 7
Q ASQ's CMQ Certification - Training Costs and Benefits Professional Certifications and Degrees 3
H Passing the ASQ Certification Tests - One method that works for me Professional Certifications and Degrees 0
hogheavenfarm Test taking time? Passing the ASQ Certification Tests Imported Legacy Blogs 14
S ASQ - Six Sigma Black Belt Certification Professional Certifications and Degrees 3
Govind ASQ Pharmaceutical GMP Professional Certification Professional Certifications and Degrees 10
M Planning for ASQ certification - How & Where to start. Professional Certifications and Degrees 5
Wesley Richardson ASQ Certification Handbook is available Professional Certifications and Degrees 3
W ASQ Lean Division - Lean Certification program is on HOLD (June 2007) ASQ - American Society for Quality 3
Govind ASQ Certification Renamed: CMI to CQI Professional Certifications and Degrees 2
ScottK RABQSA Certification for ASQ CQA's - Some Questions Professional Certifications and Degrees 3
L Study Materials for Preparing for ASQ Certification Exams Book, Video, Blog and Web Site Reviews and Recommendations 6
RoxaneB Certified Performance Technologist - How does it compare to an ASQ certification? Professional Certifications and Degrees 4
Govind Certified Six Sigma Green Belt - A New ASQ Certification is Coming! Professional Certifications and Degrees 4
A ASQ certification Renamed - Manager of Quality / Organizational Excellence Professional Certifications and Degrees 3
Wes Bucey ASQ Certification - necessary to maintain? Career and Occupation Discussions 13
Govind CQPA (Certified Quality Process Analyst) - NEW ASQ Certification Professional Certifications and Degrees 18
Z ASQ or RAB Auditor Certification - Which is Better? ISO 9001 and ISO 14001 Professional Certifications and Degrees 8
gard2372 Approved Statistical Calculator for ASQ Certification Exams Professional Certifications and Degrees 6
gard2372 Good Statistics Calculator for ASQ Certification Exams Statistical Analysis Tools, Techniques and SPC 1
Govind ASQ Certification Exams Definitions Sheet Professional Certifications and Degrees 4
G Why a CQE certification? Who should become an ASQ Certified Quality Engineer? Professional Certifications and Degrees 2
Govind ASQ Professional Certification Rates are Going Up Professional Certifications and Degrees 18
Govind ASQ's CQM, CRE and CSQE Certification - NEW - Sample exams Professional Certifications and Degrees 25
M Need Advice About Proving the Value of ASQ Certification Professional Certifications and Degrees 8
Marc ASQ (American Society for Quality) Certification Exams - Any Real Value? Professional Certifications and Degrees 28
S ASQ's CQT (Certified Quality Technician) Certification - Is it worth taking the test? Professional Certifications and Degrees 9
O ASQ CQE Exam Experience, Home versus Exam Center ASQ - American Society for Quality 0
R ANSI/ASQ Z1.4. for CQE Exam Professional Certifications and Degrees 8

Similar threads

Top Bottom