Service Supplier Rating where Objective Pass/Fail Data is not Available

I

Ironcountry

#1
Does anyone have a method to evaluate suppliers of services where objective pass/fail data is not available? This would include; Test Labs, Consultants, Calibration Labs, etc.
 
Elsmar Forum Sponsor
D

Duke Okes

#2
Re: Service Supplier Rating

You could create your own pass/fail criteria, or use 3rd party criteria such as accreditation, etc.
 
I

Ironcountry

#3
Re: Service Supplier Rating

I should have been more clear, the intial evaluation is covered but ongoing is much more difficult as there is no pass/fail criteria as in a received product.
 

harry

Trusted Information Resource
#4
Re: Service Supplier Rating

I should have been more clear, the intial evaluation is covered but ongoing is much more difficult as there is no pass/fail criteria as in a received product.
Consider using 'critical incidents' or 'Exception incident tracking' for re-evaluation. If there are no bad incidents during the period under review, you can consider them as acceptable (still meeting needs or requirements).
 
Last edited:
R

red66climb

#5
Re: Service Supplier Rating

Many companies forget to re-evaluate service providers altogether, but it is required. Whenever licensing or certification is required, you may require that service providers provide evidence that licenses and/or certification is maintained. If 3rd party reports are issued, theese might be shared with the customer.

On-time delivery is applicable for product and services. For example, did the service provider show up on-time? Did they provide a report on-time? Was billing accurate? Was pricing fair? Did you get the bare minimum or did the service provider go above and beyond? How long does it take to place an order? Is it hard to understand communications from the service provider? (i.e. - I just don't understand their report.)

Sometimes you can set objective criteria for evaluating service providers up-front. For example:

1) You hired a consultant to perform internal audits, and asked them to help prevent findings from 2nd and 3rd party auditors by finding them during internal audits. Benchmarking the number of past findings vs. the number of findings in subsequent audits is a potential metric.

2) Pest control suppliers could be evaluated based upon the # of pests observed before and after services were provided for the same month or quarter in the previous year.

3) A company was hired to install a piece of equipment. Did the equipment pass the IQ on the initial attempt? Was installation on-time? Was training provided? Did stakeholders have positive or negative comments?

4) A webhosting service provides a commodity service, but there are lots of metrics that the IT department can use to evaluate the service. How many service disruptions were experience? How much scheduled down-time was experienced? How quickly did the hosting service respond to questions? Were questions resolved during the 1st call?

I also like to select suppliers that have the potential to make companies better. For example, if a client has an internal initiative to implement a Lean Manufacturing or 6-Sigma program, I will suggest suppliers that do this well. Then they can learn from their suppliers--regardless of product or service.

When service providers are difficult to evaluate objectively, try asking a cross-functional team to score the supplier on a scale of 0 to 10. Everyone knows a "0" is not good, but a composite or average score will eliminate some of the bias of certain departments.
 
A

arios

#6
The following can be options to monitor your service suppliers:

a) On time delivery
b) Service (supportive, answers questions, timely resolution to issues)
c) For calibration labs: adequacy of information on calibration service reports
d) Adherence to service agreements, e.g. prices
 
#7
Does anyone have a method to evaluate suppliers of services where objective pass/fail data is not available? This would include; Test Labs, Consultants, Calibration Labs, etc.
I agree with previous replies that you could come up with your evaluation criteria. For example -

Test / Calibration Labs - first check if they are certified to ISO 17025. Check their customer base and if they are serving big names, your comfort level increases. Additionally, you can do a system audit of the test lab before using them

Consultants - I would prefer interviewing the consultant and check if he could meet my organization expectations. If the consultant is to be hired for some technical area, assess his expertise by a Subject Matter Expert.

Hope that helps :)
 
A

arios

#8
Consultants - I would prefer interviewing the consultant and check if he could meet my organization expectations. If the consultant is to be hired for some technical area, assess his expertise by a Subject Matter Expert.

Hope that helps :)
And to assess the consultant's capabilities, if possible get references, and call his/her clients to determine that what he or she claims can be supported. There have been cases of "consultants" claiming a certain level of expertise and in reality they don't have it, and the result represents a significant cost for the companies (e.g. failed audits).
 
Thread starter Similar threads Forum Replies Date
B Software service provider as critical supplier ISO 13485:2016 - Medical Device Quality Management Systems 5
C One Time Service Supplier - Temperature and Humidity Testing Service ISO 13485:2016 - Medical Device Quality Management Systems 5
B IATF 16949 Clause 8.4.1.2 - Supplier Selection Process - Service Providers IATF 16949 - Automotive Quality Systems Standard 13
B Supplier Approval of electronic document storage service ISO 13485:2016 - Medical Device Quality Management Systems 8
S Supplier/ Service Provider Accreditation ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 6
T Do Machine Service Contractors Need to be an Approved Supplier? ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 3
Crusader Service-Type Supplier Evaluation Exclusion? Supplier Quality Assurance and other Supplier Issues 12
V Supplier Service Level Agreements (Supplier Quality Development) APQP and PPAP 2
T Supplier Scorecards - Service/Parts (Diesel trucks and engines) Supplier Quality Assurance and other Supplier Issues 1
A Supplier Quality Plan for Service Providers - Assistance and advice wanted Supplier Quality Assurance and other Supplier Issues 2
D What knowledge should supplier and buyers of computers (public service agency) share? Supplier Quality Assurance and other Supplier Issues 1
B Evaluation of Service Supplier - Third party audit NC against clause 7.4.1 General Auditing Discussions 6
A Vendor (Supplier) Evaluation of Service Providers ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 5
S Service Quality at its best? Telephone line supplier Coffee Break and Water Cooler Discussions 3
Q "Service" Vendor (Supplier) Evaluation - How are you evaluating suppliers? Supplier Quality Assurance and other Supplier Issues 5
D Supplier Evaluation and Selection in the ?Service? industry Supplier Quality Assurance and other Supplier Issues 2
J Service Supplier Evaluations - Criteria for evaluation and control of registrars Supplier Quality Assurance and other Supplier Issues 7
M Process Flow of ECN Product User and Service Guides Process Maps, Process Mapping and Turtle Diagrams 1
P Medical device testing lab/service standard Other Medical Device Related Standards 1
I Clinical study suppliers (service providers) -- extent of control ISO 13485:2016 - Medical Device Quality Management Systems 4
J Setting up a service center in the EU ISO 13485:2016 - Medical Device Quality Management Systems 2
G Verification of Expected Service Life: Max # Reprocessing Cycles IEC 60601 - Medical Electrical Equipment Safety Standards Series 4
K Definition and Example of Shelf life, Expiry date, Expected service life and Lifetime EU Medical Device Regulations 6
G Lifecycle / Expected Service Life of Steel Parts Other Medical Device and Orthopedic Related Topics 5
S Is the Design Service Provider required to be ISO 13485 certified? ISO 13485:2016 - Medical Device Quality Management Systems 13
Ajit Basrur Does "Refurbishment" fall under "Service"? ISO 13485:2016 - Medical Device Quality Management Systems 13
V Datron Wavetek Fluke 9500 schematics or service? Calibration and Metrology Software and Hardware 2
T Do I need to add non-product related service providers to my ASL? AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 12
H AS9100 D - 8.1.2 Configuration Management for Build-to-Print Service Provider AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 1
J ISO 9001:2015 Clause 8.5.1 Control of Production and service provision - Help with Work Instruction Access ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 13
abrego44 AIAG PPAP manual for service part APQP and PPAP 5
J Service for Reviewing Aerospace Reports AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 3
K Unused Service Parts in Newly Manufactured Medical Device? Other US Medical Device Regulations 1
J Med Device Class for a Service Organization ISO 13485:2016 - Medical Device Quality Management Systems 2
W States that require service provider to have state license Medical Device and FDA Regulations and Standards News 0
M Scope for ISO 13485 Certification of a Translation Service Provider ISO 13485:2016 - Medical Device Quality Management Systems 19
A AS9100D - Clause 8.1 Operation - Coating service company AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 1
chris1price Contract Sterilization Service Providers ISO 13485:2016 - Medical Device Quality Management Systems 5
J EU 207/2012 E-IFU Service Video EU Medical Device Regulations 1
S How is the service life for class I reusable medical devices described in MDR? EU Medical Device Regulations 7
S How is the service life described for class I reusable medical devices in MDR? Elsmar Xenforo Forum Software Instructions and Help 1
L AS9100 - Product and Service Provision 8.5.1q AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 6
JoCam Rental, service & installation - regulatory requirements EU Medical Device Regulations 2
E Qualification for non gmp service providers Supplier Quality Assurance and other Supplier Issues 1
I Equipment service dates ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 9
H Operational planning and product and service provision when things happen so fast ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 11
D IEC 60601-1 - Service life testing IEC 60601 - Medical Electrical Equipment Safety Standards Series 8
D Device functionality over service life - Objective evidence required? Design and Development of Products and Processes 10
Q ISO 9001 8.5.1 - Control of production and service performance ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 5
L Design & Development of a SERVICE Service Industry Specific Topics 13

Similar threads

Top Bottom