Customer Satisfaction

I work in med device but if customer surveys arent providing the info you need I think there are other metrics you can capture.

1) On-time payment behavior. Some customers are always late. Im not talking about that. I am thinking trends on that. Work with your billing group to track that. Happy customers pay without needing 20 reminders.
2) They re up their contract with you without much hassle. They recommit for another 5 years with only minor haggling on price.
3) They are not sending an email about the cost its taking them to rework your products
4) Complaints generally
5) Complaints that require escalation internally - worse
6) Meeting behavior - Informal technical calls without contracts present. They are willing to talk to you about items other than cost.
7) They are willing to let you visit and access production to see how your product is being used.
8) Their audits of you. What have they said? Major NC? Is the tone warm or threatening?
9) Blame posturing. How do their engineers treat you when a problem pops up?
10) Sales feedback. Sales enjoys working with this account and is received in a friendly manner. Discussions are not tense.
11) When a problem comes up they call you first because they want you not to be blindsided. They dont draft a 20 page SCAR and email it to your entire QA group and sales group.

If you want you can weight each of these but these will be subjective but if you trend it that removes some subjectivity. Not all customers complain via literal complaints.
That is a different perspective than I had coming into this - that makes a lot of real-world sense in terms of representing what really is going down - thank you! I will definitely keep this in mind!
 
‘Normalizing’ can be useful IF the data are real, measurable and objective. Please avoid numerical jabberwocky it will only fool you.
Remember what Deming said: some things that can be counted don’t matter and some things that matter can’t be counted.

There is nothing that requires a (fake) math formula. I had a Sr. Director of supply chain once ask me about a very complex formula for the supplier quality score. I tried to explain what this team was doing and how flawed it was. Then I changed track: I asked what were the 3 top suppliers that kept him up at night. His answer was swift and sure. I then asked him what suppliers were the 3 worst based on the ‘score’. (They were actually good suppliers and the 3 worst were listed as great.) ‘Nuff said. The score was eliminated.
Keep it simple and provable! I will definitely keep that in mind - It is so easy to overengineer some of these things - Thank you for the reminder of that!
 
You posted this in the AS9100 sub forum, so, I will answer based on that. I believe that the IAQG is adamant about CB audits taking into account DATA and METRICS provided by the registrants customers as part of the planning and performance of their audits. I would pay a lot of attention to that aspect.

The risk of having an “aggregated” index of customer satisfaction is the fact that it might mask some serious individual, granular issues with a few specific customers. It might give a false or misleading sense to management that our overall customer satisfaction performance is great while a few business relationships are on the brink of divorce.

ISO 10004 is a good guidance standard for the management of the customer satisfaction process. Consider implementing it.

Good luck.
Wow - I had not considered that; I will look into ISO 10004 that thank you!
 
You might like the formula but its numerical jabberwocky as the denominators are from different populations. It just substitutes ‘math’ for thinking. Math is a real thing. Its also not a measure of Customer Satisfaction. Sorry.
I do think surveys can eb useful to gain feedback but it is better to have real conversations with more than one group such as the QA or Purchasing group…
Customer Satisfaction is a complex thing and we shouldn’t try to over simplify it. Thinking is better than mathing.
The requirement per 9.1.2 includes: "The organization shall determine the methods for obtaining, monitoring, and reviewing this information."

You may not like the math, however, it is verifiable, it is objective.

It has been determined.

Requirements also include: "Information to be monitored and used for the evaluation of customer satisfaction shall include, but is not limited to, product and service conformity, on- time delivery performance,..."

The math example is reviewing product and service conformity, as well as on-time delivery. Taken with Customer Satisfaction, those are the only metrics specifically spelled out by the standard.

Thinking leads to subjective results. I am not sure why that would be better.
 
The requirement per 9.1.2 includes: "The organization shall determine the methods for obtaining, monitoring, and reviewing this information."

You may not like the math, however, it is verifiable, it is objective.

It has been determined.

Requirements also include: "Information to be monitored and used for the evaluation of customer satisfaction shall include, but is not limited to, product and service conformity, on- time delivery performance,..."

The math example is reviewing product and service conformity, as well as on-time delivery. Taken with Customer Satisfaction, those are the only metrics specifically spelled out by the standard.

Thinking leads to subjective results. I am not sure why that would be better.
Thinking still matters.

Picture a pandemic. Supply chains wobble. A hospital used to order 100 Gizmos and file complaints on 2 percent. Now they order 200 and staff are slammed. Broken units get tossed in a bin and nobody files paperwork. Complaints drop to near zero while real failures rise. The metric looks great

If I saw that, I would not celebrate. I would investigate. Send sales or service to the site and ask what they are actually seeing. If they report a box of discarded units and a 10 percent failure rate, the complaint metric is no longer measuring product performance. It measures customer's capacity to complain.

And it is not just pandemics. Normal business changes can swing complaint counts
Staff turnover
Training changes
Workflow changes
Budget pressure
New IT restrictions
Facility moves

When the data shows a sudden, unprecedented shift, it warrants thinking to explain what changed and whether the metric still means what we think it means.
 
Thinking still matters.

Picture a pandemic. Supply chains wobble. A hospital used to order 100 Gizmos and file complaints on 2 percent. Now they order 200 and staff are slammed. Broken units get tossed in a bin and nobody files paperwork. Complaints drop to near zero while real failures rise. The metric looks great

If I saw that, I would not celebrate. I would investigate. Send sales or service to the site and ask what they are actually seeing. If they report a box of discarded units and a 10 percent failure rate, the complaint metric is no longer measuring product performance. It measures customer's capacity to complain.

And it is not just pandemics. Normal business changes can swing complaint counts
Staff turnover
Training changes
Workflow changes
Budget pressure
New IT restrictions
Facility moves

When the data shows a sudden, unprecedented shift, it warrants thinking to explain what changed and whether the metric still means what we think it means.
In your opinion Do you think your thinking and Kronos thinking are both correct but serve to have different outcomes? It seems both are defendable in an audit citing 9.1.2 but 1 way is to force the KPI to provide genuine feedback regardless of external factors while the other satiates the standard and the company may rely more on POC awareness of active true customer satisfaction?
 
Critical thinking is always needed. Biased, blinkered ‘thinking’ (which is really only remembering something that you have seen or experienced a lot of in isolation of other things that have occurred) is only coincidentally ever ‘right’.

Sure any old math or survey can satisfy an auditor, because it is typical and it does effect minimal compliance to the standard. And if all you want is mere compliance to a minimum quality standard, go for it.

Understanding Customer Satisfaction is hard. It takes effort. And yes it takes critical thinking to sift through the conflicting messages. A number is not knowledge. Context matters.

Can you have both? Maybe, but not in my experience. That is because those who are proponents of minimal or easy compliance do it because they don’t understand and therefore can’t defend true quality efforts. These are typically opposing forces. But since I haven’t seen everything I am open to the rare occurrence actually happening.
 
In your opinion Do you think your thinking and Kronos thinking are both correct but serve to have different outcomes? It seems both are defendable in an audit citing 9.1.2 but 1 way is to force the KPI to provide genuine feedback regardless of external factors while the other satiates the standard and the company may rely more on POC awareness of active true customer satisfaction?
Kronos thinking says the smoke alarm is code compliant. It is wired, tested monthly, and logged. If it does not go off, the house must be fine. From an audit standpoint, that is defensible.

But businesses dont exist to pass audits. They exist to make customers happy and generate revenue at the same time.

Thinking says wait a second, I smell smoke. Maybe the battery is dead, maybe the fire is slow and smoldering, maybe the alarm is in the wrong room. Before declaring the house safe, I check the kitchen.

Just measuring KPI assumes all your customers are obeying the "If it has a problem I file a complaint" They don't all do that. In the last week Ive noticed buggy behavior in my iPhone, my laptop and an item I bought in clamshell packaging. I could have cut my hands trying to open it even with real tools. I complained zero times. Some customers tolerate poor performance and just live with it or they silently look for another solution.
 

Attachments

Last edited:
...I smell smoke. Maybe the battery is dead, maybe the fire is slow and smoldering, maybe the alarm is in the wrong room. Before declaring the house safe, I check the kitchen....
This is a good point. I would propose that whoever is not 'thinking' and 'questioning the smoke' will not survive for reasons outside of the scope of a managment system standard.

I agree the advice is less useful to an organization, and potentially more about satisfying the requirement of the standard. If you think about the number as an indicator, it may be the 'smoke'.

For a business to succeed, you need to understand the needs and expectations of the customer. I submit that organizations that are successful do that in ways that are good for the customer and organization, but may not satisfy a requirement.

I will agree with Bev and say that there are better methods of taking the temperature of the customer that provide more useful information to the organization.
 
Back
Top Bottom