SBS - The Best Value in QMS software

Process to Validate the Accuracy of Test Reports (AS9100)

A

alspread

#1
AS9100:D has re-instated the requirement to "implement a process to validate the accuracy of test reports" for material identified as a significant operational risk. AS9100:B had a similar requirement, but included the term "periodically" and most places set up some kind of independent test on some kind of frequency.
I am looking for any thoughts, insight, ideas that are being used out there for an effective way to, "validate the accuracy of test reports" for operational risky raw material.

Thoughts???

Thanks:confused:
 
Elsmar Forum Sponsor

Ninja

Looking for Reality
Staff member
Super Moderator
#2
Re: Validate the accuracy of test reports

Is that not simply incoming QA that you already do for critical parameters?

If a vendor tells me on the test report that this powder has SSA=7.8, and I measure and get 7.6, I have "validated the accuracy of the test report", no?

Perspective: BET SSA measurement error is in the neighborhood of +/- 0.5 at that range.

Sound like the standard is simply requiring you to do normal due diligence and call it "validating a test report"
 
A

alspread

#3
Re: Validate the accuracy of test reports

Thanks for the feedback. I guess I should have been clearer about the kind of material.
The first part of the clause requires evaluation of the data in the test reports (check the certificate information/details against the specification requirement). the second part of the clause requires validation of the accuracy of said test report.

In my case, raw material is bar stock, plate stock, aluminum, titanium, nickel alloys, etc.
 

Ninja

Looking for Reality
Staff member
Super Moderator
#4
Re: Validate the accuracy of test reports

So you got a bar of nickel alloy and a test report.

What properties are "critical" or "significant operational risk"...and what did you do in incoming QA last month when the bar showed up to make sure it was what you needed?

My guess (hope) is that you are already complying with the requirement and have been for some time.
 

Mike S.

Happy to be Alive
Trusted Information Resource
#5
Here's my take:

When the supplier sends you their raw material test report, compare it to the spec’s for the material and see if the actual results fall within the spec windows. You have then evaluated the data.

If you periodically get a 3rd party to test the raw material and have them send you their test report, you could compare their data to both the spec and the 2nd party supplier’s data, and thus (hopefully) "confirm that the product meets requirements" a second time and "validate the accuracy of test reports" from the supplier.
 

Sidney Vianna

Post Responsibly
Staff member
Admin
#6
I am looking for any thoughts, insight, ideas that are being used out there for an effective way to, "validate the accuracy of test reports" for operational risky raw material.

Thoughts???
We don't need to go too far to see the reason for this requirement. The sensible way to validate the accuracy of test reports is to periodically have a sample tested by another reliable lab and compare the results.

How often to perform such validation? Taking into account risk, it would depend on the level of assurance you have from the supplier and how safety-critical the material is.

Let's remember that Boeing Commercial Airplanes had reinstated the requirement in their X31764 document, after the requirement was dropped in AS9100 Rev. C.

It reads:
Validation of Raw Material Test Reports:

When Seller utilizes test reports to accept Seller purchased raw material, the following requirements apply:

Test reports shall be checked 100% against Seller's requirements and applicable specifications.

Validation test requirement: Seller shall periodically validate test reports for raw material accepted on the basis of test reports. That validation shall be accomplished by Seller or other independent party through periodic, scheduled tests of raw material samples. Schedules for frequency of tests will be established by Seller based on historical performance of the raw material supplier.

Seller shall retain test reports provided by the raw material supplier, as well as Seller's validation test results as quality records traceable to the conformance of Goods, as specified elsewhere in this Contract.
 
B

BoardGuy

#7
Here is the simple way to address this requirement without the expense of testing every piece of raw material received.

1) Purchase order must specific the specification to which the material must conform (with the revision listed) and that test reports must contain actual test results.
2) Receiving Inspector compares material certification actual results to specification requirements for the material. Inspector places check mark next to each conforming reading.
3) At completion of review receiving Inspector stamps and dates material test reports.

Now the check marks indicate that a specific item conforms to the specification requirement and the inspector stamp and date indicates who performed the inspection and accepted the material.

The second part of the process is then to select randomly (we use first receipt of material each year) a sample of the raw material to be independently tested to assure accuracy of received test reports from that supplier. We explain to the customer and auditors that we are verifying the truthfulness of the supplier certification.
 

Sidney Vianna

Post Responsibly
Staff member
Admin
#8
(we use first receipt of material each year)
That might not pass the risk based thinking litmus test...

From a risk based thinking perspective, one should use historical performance of the supplier, as well as the criticality of the product and the volume of material received.
 
B

BoardGuy

#9
That might not pass the risk based thinking litmus test...
Although 6.1 (RBT) specifies that the organization shall plan action to address risk there is:

No requirement for formal methods for risk management
No requirement to document risk management process
No requirement to retain documented information as evidence of determination of risks.
[FONT=&quot]
So per Clause 6.1 and [/FONT]
[FONT=&quot]Annex A.4 what would be the litmus test? The requirement is that “[/FONT][FONT=&quot]The organization shall implement a process to validate the accuracy of test reports”.[/FONT]
 

Sidney Vianna

Post Responsibly
Staff member
Admin
#10
5.1.1 d) requires that top management promote the use of risk based thinking. Risk based thinking has to permeate throughout the quality business processes, in order to make sense. Remember that AS9100D also has requirements for product safety. This would be a classic example of gambling with product safety if the test report validations are far and few between.

But, if you forget the standard for a second, the BCA requirement, which I transposed talks about using supplier performance to establish the frequency of independent checks. That's a risk-based input. In my mind, I think, we should go beyond that and also use material criticality (if known) and volume of orders as well, in order to mitigate risks of accepting nonconforming products by solely relying on supplier's test reports.

If I were in the process of qualifying a new raw material supplier, I would also ensure that the independent validation of the supplier reports was done at a higher frequency than another supplier I have history of working together and, more importantly, confidence in.
 
Thread starter Similar threads Forum Replies Date
S Do we need to validate Software used in Drug discovery and development process? Qualification and Validation (including 21 CFR Part 11) 2
E When to Validate a Process - 21 CFR Part 820.75.(a) 21 CFR Part 820 - US FDA Quality System Regulations (QSR) 8
R How to bond PVC (Tygon) Tubing and Validate the Process ISO 13485:2016 - Medical Device Quality Management Systems 13
R Process Validation - Adhesive Bonding, what to validate and how? Qualification and Validation (including 21 CFR Part 11) 10
Ch00Ch00 Evaluate a process - Issue number Lean in Manufacturing and Service Industries 7
F Rules of process outsourcing in China China Medical Device Regulations 0
B Process / Procedure - Radiographic (X-Ray) Non-Film Document Control Systems, Procedures, Forms and Templates 0
P Certification process for registered device China Medical Device Regulations 11
J NCR- Failure of contract review process - NADCAP audit AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 6
Melissa Process Validation of Rotary Heat Sealer Speeds Design and Development of Products and Processes 4
C Validation of process for releasing the UDI EU Medical Device Regulations 4
Melissa Risk Management Process, How far do I need to go? ISO 14971 - Medical Device Risk Management 10
C Validation of process for production and servicing 5.7.1.5 API Spec Q1, 9th Edition Oil and Gas Industry Standards and Regulations 5
Z IA Construction Procurement Process Internal Auditing 3
H Risk Management Plan in agile process ISO 14971 - Medical Device Risk Management 11
DuncanGibbons Process flow & PFMEA for production planning and simulation activities? Process Maps, Process Mapping and Turtle Diagrams 7
N Help with understanding Process Controls Manufacturing and Related Processes 7
M VDA 6.3 – Workshop for Certified Process Auditor VDA Standards - Germany's Automotive Standards 1
C Process Consistency Manufacturing and Related Processes 5
I PFD (Process Flow Diagram) approach. Setup details as part of PFD? APQP and PPAP 5
K Business Process Flowchart Process Maps, Process Mapping and Turtle Diagrams 2
L Looking for Control Plan and FMEA Stamping process FMEA and Control Plans 2
J License renewal process in Iran Other Medical Device Regulations World-Wide 0
J Definition Outsourced process - Clear definition - 13485 Definitions, Acronyms, Abbreviations and Interpretations Listed Alphabetically 5
S IS0 13485 process flows ISO 13485:2016 - Medical Device Quality Management Systems 2
H Verification Process for the existing MDS Product IEC 62304 - Medical Device Software Life Cycle Processes 5
C Revalidation of Process Equipment for Equipment Transfered to New Facility. ISO 13485:2016 - Medical Device Quality Management Systems 5
Q Process map Evaluation and Analysis Method Process Maps, Process Mapping and Turtle Diagrams 5
S In process inspection Manufacturing and Related Processes 2
S Brexit 100% inspection during in process inspection Manufacturing and Related Processes 11
A Complaint review as part of the complaint handling process? ISO 13485:2016 - Medical Device Quality Management Systems 3
mustomutlu Process Validation Final Report Other Medical Device and Orthopedic Related Topics 2
Q Process Matrix_Audit Matrix Quality Management System (QMS) Manuals 4
Q Process description for outsourced processes ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 5
Q Process matrix examples of ISO 9001 & 14001 ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 2
J Need Help with FPY Data in Assembly Process Manufacturing and Related Processes 7
A When someone refuses to follow a process.... Misc. Quality Assurance and Business Systems Related Topics 27
E Software maintenance Process Software maintenance Process to IEC 6204? IEC 62304 - Medical Device Software Life Cycle Processes 3
R AS5553 Clause 3.1.7 f - "Implement a returns process....." AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 5
normhowe "The Problem with Quality Management: Process orientation, controllability and zero-defect processes as modern myths" Book, Video, Blog and Web Site Reviews and Recommendations 2
Judy Abbott General temperature used in the blasting process and laser process Manufacturing and Related Processes 2
B SOP for CNC turret punching machine for sheet metal process Manufacturing and Related Processes 0
A API Monogram audit review process Oil and Gas Industry Standards and Regulations 5
R AS9102 FAI Change in Material / Process Supplier AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 4
A Process mapping Process Maps, Process Mapping and Turtle Diagrams 1
R MDEL Process Canada Medical Device Regulations 4
optomist1 Rates Daily or Hourly Process Improvement Training Consultants and Consulting 2
S Manufacturing Process FDA FOIA Medical Device and FDA Regulations and Standards News 3
S Manufacturing Process FDA FOIA US Food and Drug Administration (FDA) 4
B Toyota PPAP Process - Three Questions APQP and PPAP 5

Similar threads

Top Bottom