Leaving Footprints in the Data - Large Database Validation

M

Mnts2C

#1
Hello,

Currently working as an audit manager in a shipyard. We have a large database where deficiencies are entered from various sources, over 60,000 entries per year. Seems to be a normal, large database that allows a variety of analyses.

One issue under discussion is the value of entering data where something occurred and had no deficiencies. Roughly, the database records deficiencies as level 4 = no deficiency, level 3 = minor, level 2 = major, and level 1 = critical.

It takes effort to ensure the accuracy and validity of the database. One opinion is that the effort to validate level 4 entries is non-value added. Another opinion is that the level 4s provide a relation to deficiencies in similar areas. (ex: two level 2s for the year = better take action now. But two level 2s in relation to 48 no deficiencies = the process seems manageable.) Recording the level 4s can be referred to leaving footprints.

Was hoping some Covers would share some experience on the issue. Thoughts ??

Thanks in advance !!
 
Elsmar Forum Sponsor

Miner

Forum Moderator
Leader
Admin
#2
A lot depends on what you intend on doing with the data. What you currently have is sufficient for analyses (e.g., Pareto) of the audit deficiencies themselves. However, you limit other analyses that depend on the number of level 4 audits, such as the percentage of discrepancies.

In other words, you have evidence of things done wrong, but no evidence of things done right (i.e., effectiveness).
 

Ninja

Looking for Reality
Trusted Information Resource
#3
Another way to look at this is "negative record".

Being a company making stuff or doing stuff, I presume there is a record already of how many of each thing was done...either in the work logs, or Invoice line items, or completed job tickets, or something...

If 500,000 "jobs" were done, and 60,000 non-4 records were created, it may be good enough to assume that the lack of record for the other 440,000 are 4's.
Not a positive record of no defect...a "negative record" or no defect...and that approach while a bit ethereal may be the most value for what you're trying to analyze.

Positive records are more compelling...but positive records cost money to create.
 
M

Mnts2C

#4
Thank you both.

Ninja is highlighting one facet of the discussion where data, no matter if the data is negative or positive, there is a cost associated with the data.

Is the cost of negative data or footprints worth the effort or ROI?

Good input, thanks.
 

Ninja

Looking for Reality
Trusted Information Resource
#5
FWIW, the type of negative record (meaning "lack of data" being used to guide a decision) is free....
It may, however, be worth as much as it cost.

If you do nothing, you have your negative record which you can use to presume something. Doing nothing is free in this context.
{maybe not reliable...but free none-the-less}
 

Sidney Vianna

Post Responsibly
Leader
Admin
#6
Mnts2C said:
hoping some Covers would share some experience on the issue. Thoughts!!
If the organization truly embraces the preventive action approach and has the resources to timely analyze the events level 4 (near misses/incidents), it should benefit from this data collection and analysis. The loss causation pyramid model shows that.

But, if level 4 events are not being analyzed, then, I agree, it is a wasted effort.
 

Mark Meer

Trusted Information Resource
#7
I agree with previous replies: no analysis or purpose, no point.

It takes effort to ensure the accuracy and validity of the database. One opinion is that the effort to validate level 4 entries is non-value added.
That being said, IF you do have some marginal use for it (like the example you give), perhaps it is possible to decrease the requirements for entries of this level?

In other words, why does data validation take so much effort? For the actual deficiencies, presumably it is because there is a bunch of required data to be entered. ...but for level 4, perhaps most of this data is unnecessary (because you don't have to detail a deficiency, evaluate it, take actions, etc...).

If your system allows for data requirements for this level to be scaled back, you could potentially keep logging them, without the validation overhead.

MM
 
Thread starter Similar threads Forum Replies Date
P Certifying Staff leaving Part-145 organisation EASA and JAA Aviation Standards and Requirements 4
A Product Update and executing only affected System Tests, leaving out unaffected ones IEC 62304 - Medical Device Software Life Cycle Processes 5
A Rate of Staff Leaving the Organization vs. Staff Joining the Organization Benchmarking 4
hogheavenfarm Potential Employer Questions Reason for Leaving Career and Occupation Discussions 37
C Dial Bore Gage Contact Points leaving witness/burnish marks General Measurement Device and Calibration Topics 10
Howard Atkins Leaving Gdansk Imported Legacy Blogs 1
Wes Bucey Leaving a job WITHOUT burning bridges Career and Occupation Discussions 7
C Supervisor leaving team leaders frustrated, skips delegating work to them Career and Occupation Discussions 16
S Tell the Auditor the Management Representative (MR) is Leaving? IATF 16949 - Automotive Quality Systems Standard 29
Proud Liberal Leaving the Quality profession after 25 years Career and Occupation Discussions 38
L Carbon Footprints Tracking examples Sustainability, Green Initiatives and Ecology 2
H Is it a requirement for run charts to have inspection data or can it have just a pass/fail check mark Records and Data - Quality, Legal and Other Evidence 1
I Brazil clinical data/trial requirement Other Medical Device Regulations World-Wide 1
W Part 145 Maintenance Data Review EASA and JAA Aviation Standards and Requirements 1
E Electronic Data Management ISO 17025 related Discussions 1
D ISO 14001 Finding - Missing Safety Data Sheets ISO 14001:2015 Specific Discussions 2
P Comparing Two Test Variables Using Attribute Data Inspection, Prints (Drawings), Testing, Sampling and Related Topics 0
K Before-After Data Analysis Statistical Analysis Tools, Techniques and SPC 1
D Gage type and data base maintainence Using GAGEpack Software 2
Dazzur Sharing Suppliers Performance Data with Supplier. Supplier Quality Assurance and other Supplier Issues 6
M Conducting a clinical investigation with clinical data from India EU Medical Device Regulations 3
T Data types vs Mathematical operations Six Sigma 4
T Gage R&R study - Ordinal data Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 6
optomist1 Data Bias - Surveys Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 0
V Levels of actions and consequence to data integrity US Food and Drug Administration (FDA) 10
M ADME data- substances based MD EU Medical Device Regulations 0
B Can a software that receive data from a MD be classified as Class I?or is not a MD? EU Medical Device Regulations 5
T Process Potential estimation for binary data Capability, Accuracy and Stability - Processes, Machines, etc. 3
RoxaneB Data Storytelling Misc. Quality Assurance and Business Systems Related Topics 4
MaHoDie Summative Evaluation with Post-Market Data? Human Factors and Ergonomics in Engineering 2
J EU Data Act Medical Information Technology, Medical Software and Health Informatics 0
P Transferring medical data from a device (Sec 201(h)): regulatory implications US Medical Device Regulations 3
Z Change color or shape of individual data point in control chart Using Minitab Software 6
R FDA ECG Data Requirements Medical Information Technology, Medical Software and Health Informatics 3
T SQL Server 2019 - Master Data Services - Validation needed? ISO 13485:2016 - Medical Device Quality Management Systems 4
C Elaborating a control chart with skewed data Manufacturing and Related Processes 4
D Data normality versus capability Capability, Accuracy and Stability - Processes, Machines, etc. 11
I In-Process Inspection Raw Data ISO 13485:2016 - Medical Device Quality Management Systems 3
T Class III device and shelf life data requirements US Medical Device Regulations 7
S Discussion on OBL and OEM test data for submission as per new EUMDR EU Medical Device Regulations 0
C How to place software version for SaMD product in HIBC secondary data structure (UDI-PI)? Other US Medical Device Regulations 4
PQ Systems Better Data Visualization & Communication with Statistical Indices Using SQCpack Software 0
PQ Systems Data Entry Workflows with SQCpack Using SQCpack Software 2
PQ Systems Data Security in the Quality Industry Using GAGEpack Software 0
B Establishing a Data Analysis Procedure ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 6
Fjalar ISO 20417:2021: Technical Data (6.6.4 c) Other Medical Device Related Standards 0
Z PMS Data collection for SAMD SaaS from clients EU Medical Device Regulations 3
S How to upload data in bulk on EUDAMED? EU Medical Device Regulations 16
M Validation of Data verification tool per 21 CFR 820 Quality Assurance and Compliance Software Tools and Solutions 1
J Stage 2 audit initial cert, few data points ISO 13485:2016 - Medical Device Quality Management Systems 4

Similar threads

Top Bottom