The Elsmar Cove Wiki More Free Files The Elsmar Cove Forums Discussion Thread Index Post Attachments Listing Failure Modes Services and Solutions to Problems Elsmar cove Forums Main Page Elsmar Cove Home Page
Google
  Web Elsmar.com
*Please be aware that SOME RECENT forum threads may not yet be indexed by Google.

View Full Version : Another study that does not reach any conclusion, but helps creating an article


Sidney Vianna
17th December 2005, 05:27 PM
http://www.dukenews.duke.edu/2005/12/lenox.html


ISO 14001 Helps Buyers Push Suppliers to Clean Up Their Acts
Participation in the self-regulation program, however, should not be considered a signal of superior environmental performance, researchers say.
Friday, December 16, 2005
Durham, N.C. -- A self-regulation program intended to reduce pollution may encourage some companies to clean up their acts, but participation should not be considered a signal of superior environmental performance, according to a new study by a team of researchers at Dartmouth College, Duke University and the University of Wisconsin-Madison. The study looked at the International Organization for Standardization’s popular ISO 14001 standard for environmental management, which was first adopted as an industry standard in 1996 and allows firms to certify that they have a process in place for managing their environmental performance.
The study, conducted by Andrew King of the Tuck School of Business at Dartmouth, Michael Lenox of Duke’s Fuqua School of Business and Ann Terlaak of the School of Business at the University of Wisconsin-Madison, was published in the December issue of the “Academy of Management Journal.”
Facilities that obtain certification tended to have previously adopted environmental management systems that reduced pollution at an above-average rate, the researchers found. These facilities appeared to certify with ISO 14001 to communicate the existence of these management systems to their buyers.
But Lenox cautions against using ISO 14001 certification as a “good housekeeping seal of approval” for a company’s environmental performance.
“Our analysis provides evidence that firms with lower environment performance, not higher, have a greater propensity to certify, thereby raising doubt that certification serves as a signal of superior environmental performance,” he said.
“It’s a bit like looking at which home owners on your street are out in the driveway working under the hood of their cars,” King said. “Such maintenance may make the cars run better, but it also may indicate which cars are older or aren’t running well now.”
The study analyzed data on pollutants emitted by 7,899 manufacturing plants between 1995 and 2001, relying mainly on information from the U.S. Environmental Protection Agency’s Toxic Release Inventory and from Dun & Bradstreet’s facilities directory. The researchers also used industry data from the federal government’s Bureau of Economic Analysis and Census Bureau of Foreign Trade, as well as demographic information from the Internal Revenue Service and the Census Department. They controlled for industry type and facility size to make the manufacturers statistically comparable.
The analysis revealed that a manufacturer’s implementation of an environmental management system (EMS), a key requirement for ISO 14001 approval, is linked with significant improvement in environmental performance. However, the researchers could not prove that ISO 14001 certification itself leads to any greater performance. The performance of companies that adopted an EMS without seeking certification could not be distinguished from those that both adopted an EMS and gained certification.
The researchers found that ISO 14001 certification may actually indicate lower, not higher, environmental performance. The authors speculate that manufacturers with poor environmental track records tend to be more likely to adopt environmental management systems and seek certification precisely because their plants need to improve. Thus, pursuit of EMS certification may indicate a company is trying to shore up a weakness rather than demonstrate an area of strength.
The researchers urge public policy makers, industry groups and others to recognize a “fundamental paradox” when crafting future standards. ISO 14001 and other certified environmental management standards can either help firms acquire “beneficial practices” or help distinguish “the wheat from the chaff,” but not both.
“Our research suggests a counter-intuitive conjecture that the more the practices included in a management standard provide direct operational benefits, the less likely certification will provide a means of signaling superior performance,” the study said.
“Understanding the tradeoffs is particularly important as firms are using ISO 14001 and the ISO 9000 quality-management standard as templates to create standards in areas as diverse as labor management and Internet security,” Terlaak said.
Nevertheless, the researchers believe the standards certification process is still meaningful. If nothing else, they said, certification shows a company’s supply chain partners that it is making efforts to improve its environmental performance.
“It doesn’t necessarily say they’re cleaner on an absolute basis,” Lenox said. “But it does say that they at least have an environmental management system in place and that they are improving.”
The authors noted it may be too soon to gauge the full impact of ISO 14001, and it may take several years to see the full environmental improvements generated by the standard.
For more information, contact: Lynsi Steffen, Fuqua School of Business | (919) 660-4071 | lynsi.steffen@duke.edu (lynsi.steffen@duke.edu)

Paul Simpson
19th December 2005, 10:31 AM
Sidney posted the Duke University report. I have taken the liberty of taking out and responding to some statements and have sent a link to this post to the lady named at the end of the article

But Lenox cautions against using ISO 14001 certification as a “good housekeeping seal of approval” for a company’s environmental performance.
“Our analysis provides evidence that firms with lower environment performance, not higher, have a greater propensity to certify, thereby raising doubt that certification serves as a signal of superior environmental performance,”
A nice bold statement at the start of the article. I was awaiting with eager anticipation the data to support these claims. See below.
...he said.“It’s a bit like looking at which home owners on your street are out in the driveway working under the hood of their cars,” King said. “Such maintenance may make the cars run better, but it also may indicate which cars are older or aren’t running well now.” A nice homespun analogy but it doesn't bear scrutiny. My experience of companies that seek certification is they are either ahead of the game and want to show it or they are forced into it by their customers. I have little experience of organization's going for certification to pretend they are operating better than they are.
How does this article go from "a manufacturer’s implementation of an environmental management system (EMS), a key requirement for ISO 14001 approval, is linked with significant improvement in environmental performance" to "The researchers found that ISO 14001 certification may actually indicate lower, not higher, environmental performance." and then on to "Thus, pursuit of EMS certification may indicate a company is trying to shore up a weakness rather than demonstrate an area of strength." No data to support the shift in opinion - perhaps it is there, it would have been good to have it available alongside the article.
The researchers urge public policy makers, industry groups and others to recognize a “fundamental paradox” when crafting future standards. ISO 14001 and other certified environmental management standards can either help firms acquire “beneficial practices” or help distinguish “the wheat from the chaff,” but not both.Again where is the foundation for this? Perhaps buried in the report there is data to support this statment but certainly not in the summary. This "fundamental paradox" looks to me to be a lack of understanding of a framework standard such as 14k. It is about management systems and the organization will endeavour to seek out improvements or "beneficial practices" to satisfy the requirement for improvement. The standard should at the same time ensure legal complaince - thereby distinguishing “the wheat from the chaff.” There is no paradox. The two activites are two sides of the same coin.

“Our research suggests a counter-intuitive conjecture that the more the practices included in a management standard provide direct operational benefits, the less likely certification will provide a means of signaling superior performance,” the study said.Any chance of some data instead of sweeping statements?
“Understanding the tradeoffs is particularly important as firms are using ISO 14001 and the ISO 9000 quality-management standard as templates to create standards in areas as diverse as labor management and Internet security,” Terlaak said. It is unlikely that firms will be using standards specifically for these purposes. They may be using a similar PDCA type model and applying it for these purposes. This presupposes you accept ther is a trade off - again without the data to support these claims there is very little credence.

P.S. Any similarity between this post and JSW05's slating of statements without data is entirely coincidental. :lol:

Jim Wynne
19th December 2005, 11:16 AM
Sidney posted the Duke University report. I have taken the liberty of taking out and responding to some statements and have sent a link to this post to the lady named at the end of the article

The name at the end of the article probably belongs to a PR person; I sent a message to Prof. Michael Lenox at Duke, one of the authors of the paper in question, requesting a copy and permission to post it. Stay tuned.

P.S. Any similarity between this post and JSW05's slating of statements without data is entirely coincidental. :lol:

I'm glad to see that you've joined the Brotherhood of Data Talks and :horse: Walks, Paul--welcome aboard:agree1: .

cncmarine
19th December 2005, 12:01 PM
True ...not enough facts but some very good points.

"But Lenox cautions against using ISO 14001 certification as a “good housekeeping seal of approval” for a company’s environmental performance"


I'am sure we can I agree with the above statement.

Paul Simpson
19th December 2005, 12:22 PM
True ...not enough facts but some very good points.

"But Lenox cautions against using ISO 14001 certification as a “good housekeeping seal of approval” for a company’s environmental performance"


I'am sure we can I agree with the above statement.

While I am not exactly sure of the intent of the Lenow statement we should be able to use ISO certification as a demonstration of legal compliance. It is not a guarantee of continuing compliance as there are accidents and incidents everywhere, but nevertheless it should be a guarantee the organization is routinely compliant with legislation and regulation.

cncmarine
19th December 2005, 12:36 PM
Legal compliance to what ?????

Paul Simpson
19th December 2005, 12:41 PM
Legal compliance to what ?????
Legal compliance to any legislation and regulation that applies in your country, state, province. Most waste streams have some form of regulation applied to them.

qualeety
19th December 2005, 03:09 PM
Legal compliance to any legislation and regulation that applies in your country, state, province. Most waste streams have some form of regulation applied to them.

ISO 14001 certification does not mean legal compliance. :nope: ....it was never meant to be and no registar should make that claim. If one wants legal compliance, then on should do a legal compliance audit, not ISO 14001.

cncmarine
19th December 2005, 03:16 PM
100 % correct

Jim Wynne
19th December 2005, 03:43 PM
The name at the end of the article probably belongs to a PR person; I sent a message to Prof. Michael Lenox at Duke, one of the authors of the paper in question, requesting a copy and permission to post it. Stay tuned.

Professor Lenox sent me a copy of the paper and his permission to post it. He warns thusly:

This version is based on the last word version of the paper I have before it went to print and as such may still contain some grammatical errors that were picked up during the copy edit. Thanks for posting it to your discussion forum.

I also invited him to chime in here. The paper is attached.

tarheels4
19th December 2005, 03:45 PM
Right EMS audit is not a compliance audit, it is conformance to ISO 14001. But to test the committment to compliance as made in the environmental policy, the CB auditor should test the compliance system through sampling of environmental compliance.

Sidney Vianna
19th December 2005, 04:26 PM
Professor Lenox sent me a copy of the paper and his permission to post it. The paper is attached. Thanks. :agree1: This is a really good contribution.

vanputten
19th December 2005, 08:23 PM
Hello Qualeety, Cncmarine, and Tarheels4:

Would you please explain your comments on legal compliance, ISO 14001 3rd party audits not being compliance audits, etc. as they relate to the 4th paragraph of the Introduction, to 1.0 Scope, and 4.5.2 of ISO 14001:2004?

Thank you, Dirk

tarheels4
19th December 2005, 09:21 PM
Hello Qualeety, Cncmarine, and Tarheels4:

Would you please explain your comments on legal compliance, ISO 14001 3rd party audits not being compliance audits, etc. as they relate to the 4th paragraph of the Introduction, to 1.0 Scope, and 4.5.2 of ISO 14001:2004?

Thank you, Dirk
Sorry I don't have "the 4th paragraph of the Introduction, to 1.0 Scope" with me here at home, but Bud is with me. Only section 4.1 - 4.6 is the audit criteria anyway, and that is ingrained.

I can say that there is a difference in compliance and conformance. In EMS, compliance relates to legal requiremnts such as EPA. Conformance is to the standard. The CB be auditor is there to audit conformance. When there is a clear lack of a committment to compliance, as required in the policy there may be a major non-conformance.

In regard to 4.5.2, a CB auditor should verify that the compliance evaluation by the organization is effective, and covers the legal requirements of the organization.

Compliance issues identified by the CB auditor should be addressed through operation control or some other avenue rather than be written as a clear non-compliance, if possible. At least that is the experience I have had with the CBs.

Paul Simpson
20th December 2005, 09:32 AM
ISO 14001 certification does not mean legal compliance. :nope: ....it was never meant to be and no registar should make that claim. If one wants legal compliance, then on should do a legal compliance audit, not ISO 14001.
Throughout the standard - particularly the 2004 revision there are references to legislation and regulation. There is a new element added that requires the organization to have a procedure in place to demonstrate they meet legal requirements and there is requirement for the third party assessment body to verify that this is taking place. I know it is not the same as a legal compliance audit but the wording I used stands:
we should be able to use ISO certification as a demonstration of legal compliance

tarheels4
20th December 2005, 10:02 AM
No argument here, I think we are saying approximately the same thing.

vanputten
20th December 2005, 09:36 PM
Thank you Tarheels4.

Only 4.1 through 4.6 are auditable? Everything else in ISO 14001:2004 is not auditable; does not apply to 3rd party conformance audits?

Thank you,

Dirk

Paul Simpson
21st December 2005, 07:53 AM
Professor Lenox sent me a copy of the paper and his permission to post it.
It took a little while (I have been out of the academic sphere for a while) and have to own up to not being familiar with the statistical tests applied to the data but accept that it is fact. The effort was worth it. As a desktop study of links between ISO 14001 certification and a whole host of factors it was very interesting. I am not sure about some of the measures - the researchers have used a lot of binary (Black / White) answers to questions that are more shades of grey. With that proviso aside it provides a lot of data - although as the authors acknowledge - it creates a need for more research to understand why these correlations exist.

The press release attempts to use the "shock" headline “Our analysis provides evidence that firms with lower environment performance, not higher, have a greater propensity to certify, thereby raising doubt that certification serves as a signal of superior environmental performance,” and ends up detracting from the report.

But then of course the correlation between ISO 14001 certification and an EMS and between an EMS and improved environmental performance is not news!

tarheels4
21st December 2005, 09:36 AM
Thank you Tarheels4.

Only 4.1 through 4.6 are auditable? Everything else in ISO 14001:2004 is not auditable; does not apply to 3rd party conformance audits?

Thank you,

Dirk
That is correct Dirk. IMHO. But you might want to check with Sidney for confirmation.

:topic: I am not trying to be nosey. I am just curious about your ISO 14001:1996 certificate. It has a January 24, 2002 issue date. Did you get an extension from TUV? Because it also says the certificate is valid until May 15, 2006. That is well over three years.

vanputten
21st December 2005, 10:00 PM
Hello Tarheels4:

Our ISO 14001:1996 cert states it was revised on 2/3/2005 and is good until May 15, 2006. Tomorrow is the last day of our annual surveillance audit which is also an upgrade audit to ISO 14001:2004.

A year ago we went through a full system re-cert audit. Our registrar "revised" our cert on 2/3/2005. Their wording.

Regards,

Dirk

tarheels4
21st December 2005, 10:27 PM
Hello Tarheels4:

Our ISO 14001:1996 cert states it was revised on 2/3/2005 and is good until May 15, 2006. Tomorrow is the last day of our annual surveillance audit which is also an upgrade audit to ISO 14001:2004.

A year ago we went through a full system re-cert audit. Our registrar "revised" our cert on 2/3/2005. Their wording.

Regards,

Dirk
Good luck with the audit tommorrow.