Customer Satisfaction Scale - How to Benchmark Customer Satisfaction?

Mikael

Quite Involved in Discussions
#1
Hi

I would like to know how I can construct a scale to be used for benchmarking Customer satisfaction. E.g. I construct a scale from 1-10 and if the focal company perform 5 in satisfaction for the customers and the competitor is 8 in satisfaction for the customers , the difference should be 3??? But such a scale would be an ordinal scale right:

http://www.math.sfu.ca/~cschwarz/Stat-301/Handouts/node5.html

and so by it is not allowed to calculated the difference?


Any alternatives?
 
Elsmar Forum Sponsor

Jim Wynne

Staff member
Admin
#2
Re: Customer Satisfaction Scale - How to Benckmark Customer Satisfaction?

Hi

I would like to know how I can construct a scale to be used for benchmarking Customer satisfaction. E.g. I construct a scale from 1-10 and if the focal company perform 5 in satisfaction for the customers and the competitor is 8 in satisfaction for the customers , the difference should be 3??? But such a scale would be an ordinal scale right:

http://www.math.sfu.ca/~cschwarz/Stat-301/Handouts/node5.html

and so by it is not allowed to calculated the difference?


Any alternatives?
When it comes to this sort of survey, I'm always reminded of the scene in the movie This is Spinal Tap where one of the band members shows the Rob Reiner character a guitar amplifier and tells him that the volume control goes up to 11, instead of just 10 as is usually the case. Reiner asks why they just didn't make the "10" setting louder, and the answer, after some hesitation, is "These go to 11."



In order to be able to reliably measure anything, you have to control for everything that might bias the measurements, and in the case of something as nebulous as customer satisfaction you're facing an impossible task. Even measurement of dissatisfaction is fraught with peril because dissatisfied customers don't always complain, and there might be instances of customers who are generally satisfied but have employees who complain about everything anyway. IMO, the single best indicators of customer satisfaction are repeat orders and awarding of new business. Everything else is guessing, and it doesn't matter if one customer gives you an 11 and another gives you a 10.
 
Last edited:

Jen Kirley

Quality and Auditing Expert
Staff member
Admin
#3
Re: Customer Satisfaction Scale - How to Benckmark Customer Satisfaction?

The site you directed us to was quite scientific-looking. In my experience, customer satisfaction surveys are simple looking forms that are fast and easy to fill out. Constructing such a quick "temperature check" must be done with care, so you can get as valuable information as possible.

Here is a toolkit that includes a section about constructing surveys --starts on page 16.
 

BradM

Staff member
Admin
#4
Re: Customer Satisfaction Scale - How to Benckmark Customer Satisfaction?

Hi

I would like to know how I can construct a scale to be used for benchmarking Customer satisfaction. E.g. I construct a scale from 1-10 and if the focal company perform 5 in satisfaction for the customers and the competitor is 8 in satisfaction for the customers , the difference should be 3??? But such a scale would be an ordinal scale right:

http://www.math.sfu.ca/~cschwarz/Stat-301/Handouts/node5.html

and so by it is not allowed to calculated the difference?


Any alternatives?
Hello, there! Whether your scale is nominal or ordinal will depend on what values you use, and how you measure the variables.

Also, you stated number regarding customer satisfaction of your competitors. How are you going to measure that? How will you know which competitors are involved in the evaluation?

Here's a pretty good thread on measuring customer satisfaction.

Measuring customer satisfaction

There are other threads that discuss surveys.

Craig Cochran has a post here on measuring service quality:

Measuring Service Quality


Notice the effort and time spent validating the simple survey items. That is just the start of developing a good survey.

Please know-you're not alone in your frustration of developing measures of customer satisfaction:yes:. It is difficult to do, and I hope we're providing you some information to assist in your approach.
 

Mikael

Quite Involved in Discussions
#5
Re: Customer Satisfaction Scale - How to Benckmark Customer Satisfaction?

Thank you all for the interesting thoughts and links:), I did search on the subject but I was mostly focus on the Benchmark problem.

No doubt that "satisfaction" is problematic and in the end the best thing is probably to BE the Customer yourself.
And why even measure Satisfaction - meanwhile I found this link:

http://www.marketvaluesolutions.com/customer-satisfaction-article.htm

Lets say that I don't even do a survey, that I just by my own knowledge give my company(A) and the competitor (B) a number on a scale, and thereby I want to subtract A from B, which is nonsenses unless it is at least an interval scale, but in this case the scale will always be ordinal, right? So it seems kind of impossible to do that?

Brad, yes it depends on the values and input, and thereby the kind survey, but no matter what you make use of, is seems to me impossible to construct an interval scale for CS? And thereby it is (academic) impossible to do benchmark, unless you measures and compare with sales or such, but that's not what I need?

BTW: I have anybody heart about fuzzy logic, could it solve the problem?
 

Jim Wynne

Staff member
Admin
#6
Re: Customer Satisfaction Scale - How to Benckmark Customer Satisfaction?

Lets say that I don't even do a survey, that I just by my own knowledge give my company(A) and the competitor (B) a number on a scale, and thereby I want to subtract A from B, which is nonsenses unless it is at least an interval scale, but in this case the scale will always be ordinal, right? So it seems kind of impossible to do that?
This is essentially the 10/11 problem I alluded to earlier. Not only that, but assigning arbitrary values to something as nebulous as "satisfaction" is trying to nail Jell-O to the wall. The problem isn't the measurement method, it's trying to measure something without first rigorously defining the salient components of what you're trying to measure.

Brad, yes it depends on the values and input, and thereby the kind survey, but no matter what you make use of, is seems to me impossible to construct an interval scale for CS? And thereby it is (academic) impossible to do benchmark, unless you measures and compare with sales or such, but that's not what I need?
The fact that you're struggling with measurement means that you really don't know what you need, and that's because there are too many undefined variables and dubious measurement methods and targets.

BTW: I have anybody heart about fuzzy logic, could it solve the problem?
The problem isn't solvable. You can do your best to understand customer perceptions and try to turn them in your favor, but that's about it. Customer satisfaction, in the end, depends on episodic phenomena. It's a one-interaction-at-a-time thing. When a customer is in trouble and needs for you to bend your schedule to get them out of it, you're not likely to enhance their satisfaction by telling them they're SOL, and the schedule is the schedule. Nonetheless, it might not be economically responsible for you to bail them out, so you have to weigh each transaction in risk/reward fashion. You might find it necessary on occasion to "fire" a chronically dissatisfied customer, one whose expectations are patently unreasonable.

We need to remember Dr. Deming's admonitions regarding the unknown and unknowable, the fact that there are important things that can't be rationally measured, and that relentlessly trying to measure them is wasteful.
 

Jen Kirley

Quality and Auditing Expert
Staff member
Admin
#7
Re: Customer Satisfaction Scale - How to Benckmark Customer Satisfaction?

Jim's right, and his points were well made.

The problem with measuring customer satisfaction has two parts:

1) How to know what to ask
2) How to understand the answers

Start with the objective. "We want to know customer satisfaction." From there the question must be formed: "My customer: how happy are you?" But a numerical value has no value unless it can tell you what was done well and what needs to be improved. The questions would need to be framed in specific terms:

"How happy are you with our help desk personnel's help in solving your problems?"
"How fast was our delivery?"
"How easy was our instruction manual to use?"
"How easy were our product's features to use?"

The answers to the questions would be even better if there were some means for the customer to tell you why a given factor was less than great. How else can you know how to respond to to the findings?

Customer satisfaction can be assigned a number scale, formulae to derive an average with and compare against competitors, but satisfaction is a very personal thing. Your data should be designed to help you understand why your relative position is this and you competitor's is that, so you organization can develop a strategy to narrow the gap or come up with something unique to offer instead.

All of this doesn't need a scientifically designed survey with 95% confidence levels and so on, and I wonder what makes your own knowledge thorough and sensitive enough to be actionable. Some of the best data anywhere are gathered by customer service personnel as they are doing their work with the customer. Why wait for a blanket survey to find out how well it went?
 

Crusader

Trusted Information Resource
#8
Re: Customer Satisfaction Scale - How to Benckmark Customer Satisfaction?

Thank you all for the interesting thoughts and links:), I did search on the subject but I was mostly focus on the Benchmark problem.
To benchmark, I ask my Customer to rate Us vs our competitor. The Customer buys from more than 1 source (remember: don't put all eggs in 1 basket) so why not ask the Customer directly? I get actual detailed data and a rating number on a scale of 1 - 4.
Just my :2cents:
 
Last edited:
T

Ted Schmitt

#9
Re: Customer Satisfaction Scale - How to Benckmark Customer Satisfaction?

To benchmark, I ask my Customer to rate Us vs our competitor. The Customer buys from more than 1 source (remember: don't put all eggs in 1 basket) so why not ask the Customer directly? I get actual detailed data and a rating number on a scale of 1 - 4.
Just my :2cents:
I do the exact same thing... a quick phone call and 4 questions. All questions are directly related to each one of my 4 quality objectives. I just don´t rate 1-4. The question is always in comparison to my competition.

Example (simple) : Are our prices competitive with the competition?

They are all yes or no answers which makes "summing it all up" easier...
 
M

madannc

#10
Re: Customer Satisfaction Scale - How to Benckmark Customer Satisfaction?

IMHO there was a post that determined satisfaction in terms of sales or repeat orders, to take this a step further would be to be the preferred supplier.

To measure this would be market position to give you a start position. Then looking at strategies to increase (or maintain) that position:

These strategies are product development (innovation), cost reduction (value), reliability (Quality). All areas that are within the QMS.

Each of these has measures:

Development - What are our competitors providing... do we need to aswell... can it be improved upon (or are we just a me too), QFD (Quality Function Deployment) helps with this (plenty of threads and info here and on the net. As a simplistic example providing an amp with volume of 11 give the customer something that other providers don't but does the customer really want it? Determining what the customer wants is not easy but when you get it right.... (e.g. ipods) or when you get it wrong... (e.g. Sinclair C5) makes huge differences.

Cost Reduction - Supplier costs, factory efficiency, waste reduction (rework, scrap etc etc), efficiency all things that a good QA Eng should be involved with and driving gives you opportunity to pass on to customer.

Reliability - Effective CA's, designing with reliability in mind, monitoring customer complaints, being vigilant of competitor issues and if there is potential to happen to you. Again all things that QA should be involved with.

This brief synopsis hopefully highlights that although "focus groups", questionaires, surveys, etc etc have their place it is equally important to internally measure with the customer in mind. The real key to success in this is management commitment, I have been lucky in that 2 of the companies I have worked for have this, but there are numorous others that did not.

As a quality "proffessional" (whatever that means, I like to think more in terms of problem solver) I always try and set quality objectives that focus on business objectives in addition to meeting reg's and std's... which when you break them down are really just business models.

My suggestion would be look at what you currently measure internally and and how valuable is that information in terms of being a preffered supplier.

:2cents:
 
Thread starter Similar threads Forum Replies Date
R Customer Satisfaction importance in companies with Government/Public Administration as main customer? ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 11
I ISO 9001:2015 Section 9.3.2 C1 "customer satisfaction and feedback from relevant interested parties" ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 7
Q Customer Satisfaction through On-Time Delivery ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 9
A Have sites like Ebay and Amazon killed customer satisfaction/feedback? Customer Complaints 7
I ISO9001:2015 9.1.2 - Customer Satisfaction Feedback ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 6
V AS9100 8.2.1 (C) or 9.1.2 (D) Customer Satisfaction - KPI's AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 5
K How can I monitor customer satisfaction? ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 14
C Customer Satisfaction Process - Audit "Suggestion for Improvement" General Auditing Discussions 14
Ajit Basrur CDRH Customer Satisfaction Results at 87% US Food and Drug Administration (FDA) 1
R Why customer satisfaction is not appropriate regulatory objective in medical device? ISO 13485:2016 - Medical Device Quality Management Systems 8
G How to assess Customer Satisfaction without using surveys ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 14
A Customer Satisfaction Measurement When You Have Only 1 Customer AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 4
S Conduct Customer Satisfaction Survey for every submitted Bid? ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 3
J Looking for a Customer Satisfaction Survey Form Other Medical Device Related Standards 2
Z Customer Satisfaction Survey Analysis Quality Tools, Improvement and Analysis 2
E Marketing and Sales involvement in 8.2.1 Customer Satisfaction ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 5
M Customer Satisfaction Survey - Poor Response ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 11
R Customer Satisfaction for Legal Services ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 2
S Need to prepare Internal Customer Satisfaction Survey form for QA department Misc. Quality Assurance and Business Systems Related Topics 5
M Customer Satisfaction Excel File Customer Complaints 3
C Customer Feedback, Satisfaction, Complaint Procedure and Measurement Customer Complaints 8
M 8.2.1.1 - Customer Satisfaction - How to satisfy the end requirement? IATF 16949 - Automotive Quality Systems Standard 1
M 8.2.1 ?NOTE- Is Monitoring of Internal Customer Satisfaction a requirement? IATF 16949 - Automotive Quality Systems Standard 1
E 8.2.1 Customer Satisfaction - Is Internal Customer Satisfaction Employee Satisfaction IATF 16949 - Automotive Quality Systems Standard 6
W Customer Satisfaction Surveys in Oil Industry Customer Complaints 8
M Customer Conversion and Retention / Satisfaction Measurement Index Benchmarking 4
B Increasing Customer Satisfaction While Decreasing Employee Workload Customer Complaints 4
R Supplier Satisfaction Survey about Working with us as a Customer Supplier Quality Assurance and other Supplier Issues 7
R Setting Targets (Objectives) for Customer Satisfaction ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 12
M Customer Satisfaction Surveys - User Friendly & Online methods. ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 2
S Customer Satisfaction Surveys - Response Rate, Analysis, Customer Feedback ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 14
A Minitab for Customer Satisfaction Analysis Using Minitab Software 1
J How to Increase Customer Satisfaction Rating? Customer Complaints 20
K Customer Satisfaction - Would you advise to investigate the trend or the incidence? Customer Complaints 9
I Calculating the CSI (Customer Satisfaction Index) Misc. Quality Assurance and Business Systems Related Topics 17
K Definition Customer Satisfaction - ISO 9001 Definition Definitions, Acronyms, Abbreviations and Interpretations Listed Alphabetically 16
R Analyzing Customer Satisfaction Indexes Quality Manager and Management Related Issues 1
Antonio Vieira Customer Satisfaction Survey Sample Size Inspection, Prints (Drawings), Testing, Sampling and Related Topics 7
F Customer Satisfaction Survey - Further actions needed for Customers Comments? ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 4
E Customer Satisfaction - Customer Perception of Government Contract Officers ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 2
V Complaints Handling Responsibility - Customer Satisfaction - ISO 10002 Clause 5.3.2 Customer Complaints 9
Sidney Vianna ISO 10004:2012 - Customer satisfaction - Guidelines for monitoring and measuring Other ISO and International Standards and European Regulations 18
B Quality Policy - Need to include "Customer Satisfaction & Continual Improvement? ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 10
S Customer Satisfaction Reporting Responsibilities Career and Occupation Discussions 10
H Determining Customer Satisfaction in a Small Aerospace Job Shop AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 6
S Is it mandatory to monitor customer satisfaction for a non-regular product? ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 16
C The "Perfect Order" as a Customer Satisfaction Measurement Customer Complaints 7
D Obtaining Customer Perception Information - Customer Satisfaction - Clause 8.2.1 ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 11
D 8.2.1 Monitoring & Measuring customer satisfaction ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 1
T How to monitor customer satisfaction without surveys? ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 16

Similar threads

Top Bottom