SBS - The best value in QMS software

Process to Validate the Accuracy of Test Reports (AS9100)

A

alspread

#1
AS9100:D has re-instated the requirement to "implement a process to validate the accuracy of test reports" for material identified as a significant operational risk. AS9100:B had a similar requirement, but included the term "periodically" and most places set up some kind of independent test on some kind of frequency.
I am looking for any thoughts, insight, ideas that are being used out there for an effective way to, "validate the accuracy of test reports" for operational risky raw material.

Thoughts???

Thanks:confused:
 
Elsmar Forum Sponsor

Ninja

Looking for Reality
Staff member
Super Moderator
#2
Re: Validate the accuracy of test reports

Is that not simply incoming QA that you already do for critical parameters?

If a vendor tells me on the test report that this powder has SSA=7.8, and I measure and get 7.6, I have "validated the accuracy of the test report", no?

Perspective: BET SSA measurement error is in the neighborhood of +/- 0.5 at that range.

Sound like the standard is simply requiring you to do normal due diligence and call it "validating a test report"
 
A

alspread

#3
Re: Validate the accuracy of test reports

Thanks for the feedback. I guess I should have been clearer about the kind of material.
The first part of the clause requires evaluation of the data in the test reports (check the certificate information/details against the specification requirement). the second part of the clause requires validation of the accuracy of said test report.

In my case, raw material is bar stock, plate stock, aluminum, titanium, nickel alloys, etc.
 

Ninja

Looking for Reality
Staff member
Super Moderator
#4
Re: Validate the accuracy of test reports

So you got a bar of nickel alloy and a test report.

What properties are "critical" or "significant operational risk"...and what did you do in incoming QA last month when the bar showed up to make sure it was what you needed?

My guess (hope) is that you are already complying with the requirement and have been for some time.
 

Mike S.

Happy to be Alive
Trusted Information Resource
#5
Here's my take:

When the supplier sends you their raw material test report, compare it to the spec’s for the material and see if the actual results fall within the spec windows. You have then evaluated the data.

If you periodically get a 3rd party to test the raw material and have them send you their test report, you could compare their data to both the spec and the 2nd party supplier’s data, and thus (hopefully) "confirm that the product meets requirements" a second time and "validate the accuracy of test reports" from the supplier.
 

Sidney Vianna

Post Responsibly
Staff member
Admin
#6
I am looking for any thoughts, insight, ideas that are being used out there for an effective way to, "validate the accuracy of test reports" for operational risky raw material.

Thoughts???
We don't need to go too far to see the reason for this requirement. The sensible way to validate the accuracy of test reports is to periodically have a sample tested by another reliable lab and compare the results.

How often to perform such validation? Taking into account risk, it would depend on the level of assurance you have from the supplier and how safety-critical the material is.

Let's remember that Boeing Commercial Airplanes had reinstated the requirement in their X31764 document, after the requirement was dropped in AS9100 Rev. C.

It reads:
Validation of Raw Material Test Reports:

When Seller utilizes test reports to accept Seller purchased raw material, the following requirements apply:

Test reports shall be checked 100% against Seller's requirements and applicable specifications.

Validation test requirement: Seller shall periodically validate test reports for raw material accepted on the basis of test reports. That validation shall be accomplished by Seller or other independent party through periodic, scheduled tests of raw material samples. Schedules for frequency of tests will be established by Seller based on historical performance of the raw material supplier.

Seller shall retain test reports provided by the raw material supplier, as well as Seller's validation test results as quality records traceable to the conformance of Goods, as specified elsewhere in this Contract.
 
B

BoardGuy

#7
Here is the simple way to address this requirement without the expense of testing every piece of raw material received.

1) Purchase order must specific the specification to which the material must conform (with the revision listed) and that test reports must contain actual test results.
2) Receiving Inspector compares material certification actual results to specification requirements for the material. Inspector places check mark next to each conforming reading.
3) At completion of review receiving Inspector stamps and dates material test reports.

Now the check marks indicate that a specific item conforms to the specification requirement and the inspector stamp and date indicates who performed the inspection and accepted the material.

The second part of the process is then to select randomly (we use first receipt of material each year) a sample of the raw material to be independently tested to assure accuracy of received test reports from that supplier. We explain to the customer and auditors that we are verifying the truthfulness of the supplier certification.
 

Sidney Vianna

Post Responsibly
Staff member
Admin
#8
(we use first receipt of material each year)
That might not pass the risk based thinking litmus test...

From a risk based thinking perspective, one should use historical performance of the supplier, as well as the criticality of the product and the volume of material received.
 
B

BoardGuy

#9
That might not pass the risk based thinking litmus test...
Although 6.1 (RBT) specifies that the organization shall plan action to address risk there is:

No requirement for formal methods for risk management
No requirement to document risk management process
No requirement to retain documented information as evidence of determination of risks.
[FONT=&quot]
So per Clause 6.1 and [/FONT]
[FONT=&quot]Annex A.4 what would be the litmus test? The requirement is that “[/FONT][FONT=&quot]The organization shall implement a process to validate the accuracy of test reports”.[/FONT]
 

Sidney Vianna

Post Responsibly
Staff member
Admin
#10
5.1.1 d) requires that top management promote the use of risk based thinking. Risk based thinking has to permeate throughout the quality business processes, in order to make sense. Remember that AS9100D also has requirements for product safety. This would be a classic example of gambling with product safety if the test report validations are far and few between.

But, if you forget the standard for a second, the BCA requirement, which I transposed talks about using supplier performance to establish the frequency of independent checks. That's a risk-based input. In my mind, I think, we should go beyond that and also use material criticality (if known) and volume of orders as well, in order to mitigate risks of accepting nonconforming products by solely relying on supplier's test reports.

If I were in the process of qualifying a new raw material supplier, I would also ensure that the independent validation of the supplier reports was done at a higher frequency than another supplier I have history of working together and, more importantly, confidence in.
 
Thread starter Similar threads Forum Replies Date
S Do we need to validate Software used in Drug discovery and development process? Qualification and Validation (including 21 CFR Part 11) 2
E When to Validate a Process - 21 CFR Part 820.75.(a) 21 CFR Part 820 - US FDA Quality System Regulations (QSR) 8
R How to bond PVC (Tygon) Tubing and Validate the Process ISO 13485:2016 - Medical Device Quality Management Systems 13
R Process Validation - Adhesive Bonding, what to validate and how? Qualification and Validation (including 21 CFR Part 11) 10
C In-process inspection - Tooling and assembly lines for automotive companies AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 4
M Efficacy of an IT process after a cyber attack ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 2
N Sterilization Protocol Change in Validation Process and further impacts ISO 13485:2016 - Medical Device Quality Management Systems 1
N Riveting - special process Manufacturing and Related Processes 11
M Material incoming to the production process reflected in PFMEA FMEA and Control Plans 5
A API Spec Q1 Purchasing Process - Supplier Reevaluation based on Supplier Risks 5.6.1.4 Oil and Gas Industry Standards and Regulations 12
B Handling lower detection limits for SPC and process performance Statistical Analysis Tools, Techniques and SPC 1
S Approval Process for Disinfectant Sanitizers in Dubai Elsmar Xenforo Forum Software Instructions and Help 0
D Measurables for Plastic Injection molding process Manufacturing and Related Processes 1
S Cleaning process center change ISO 13485:2016 - Medical Device Quality Management Systems 4
Z Rapid audit template for plastic parts manufacturing process Manufacturing and Related Processes 12
R Inspection and Work order process Inspection, Prints (Drawings), Testing, Sampling and Related Topics 7
T ISO 13485:2016 Clauses related to process matrix ISO 13485:2016 - Medical Device Quality Management Systems 3
A How to reduce the process SPC monitoring Capability, Accuracy and Stability - Processes, Machines, etc. 3
John Predmore Configuration Management as a process instead of a procedure AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 6
R PCBA process validation Qualification and Validation (including 21 CFR Part 11) 2
U Internal Auditor not trained but done Audit for some process Nonconformance and Corrective Action 5
B Two excellent examples of process capability analysis from Quality Magazine Capability, Accuracy and Stability - Processes, Machines, etc. 5
D ECO (Engineering Change Order) process questions ISO 13485:2016 - Medical Device Quality Management Systems 7
S Sterilization validation after changing sterilization process provider Qualification and Validation (including 21 CFR Part 11) 3
Pau Calvo Quality Management process is mandatory in ISO9001? ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 10
Tagin Template or Checklist for Process Change Document Control Systems, Procedures, Forms and Templates 5
LostLouie Manufacturer divorced from Design process, is he justified in design process deficiencies? ISO 13485:2016 - Medical Device Quality Management Systems 9
J 1.11 Preliminary Identification of Special Product and Process Characteristics APQP and PPAP 4
D Question regarding customer feedback process ISO 13485:2016 - Medical Device Quality Management Systems 3
T What does AS9100 mean when it says you must establish a process to do X? AS9100, IAQG, NADCAP and Aerospace related Standards and Requirements 24
J Process FMEA Template with examples - Cold and Hot Forged components FMEA and Control Plans 4
D Questions regarding process validation ISO 13485:2016 - Medical Device Quality Management Systems 6
D Question regarding ECO process, specifically for Life Science products and defining form fit and function ISO 13485:2016 - Medical Device Quality Management Systems 1
P Managing How PPAP Requirements are Communicated in the Manufacturing Process and to Suppliers APQP and PPAP 5
I Control Plan (Product/Process specification/ Tolerance) acceptance FMEA and Control Plans 27
L Process changes and biocompatibility (ISO 10993-1) Other Medical Device Related Standards 1
A Validation of Forced Aeration Process ISO 13485:2016 - Medical Device Quality Management Systems 3
R Error Proofing Label process Manufacturing and Related Processes 4
B New Release of CQI-12 Coatings Process (Revision 3- Release date- 7/2020) Customer and Company Specific Requirements 2
D Layered Process Audits - FCA 9.2.2 - Exemption Clause? IATF 16949 - Automotive Quality Systems Standard 5
B ISO 11607-2 "Critical Parameter" vs. "Process Parameter" Other Medical Device Related Standards 6
Q Example Process orientation to the process leadership, management, goals (tasks of the top management) ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 10
S Process Inspection -Sub assembly process inspection sheet Lean in Manufacturing and Service Industries 3
T ISO 13485 8.3 - Non-Conforming Materials - on-line rework or part of process? ISO 13485:2016 - Medical Device Quality Management Systems 11
T Outsourced process in ISO 45001 Occupational Health & Safety Management Standards 3
L Manufacturing Process Audit Help IATF 16949 - Automotive Quality Systems Standard 6
T Formal Q Self Assessment - Problem with assigning Product and Process Customer and Company Specific Requirements 1
K Problems with process equipment ISO 13485:2016 - Medical Device Quality Management Systems 4
W Need for current design or process control FMEA and Control Plans 2
M Hiring Decisions - How much effort do you put into the hiring process these days? (7/2020) Misc. Quality Assurance and Business Systems Related Topics 6

Similar threads

Top Bottom