Jim,
Your question is an interesting one.
I find all of the ISO documents useful, however when it comes to registration, I pay attention only to the ISO 9001:2000 document. I could care less about what the 9004:2000 document says you "should" do because our registration certificate says we are registered to ISO 9001:2000 not 9004:2000.
You are absolutely in compliance with ISO 9001:2000 5.5.1 . If anyone says differently, I would challenge them to show the EVIDENCE

that you do not comply, not a subjective opinion.
I can find no reference in the 9001:2000 standard that states "everyone is responsible for quality" or any reference to "team commitment" These terms have been thrown about time and again and while they look good on a poster, they have no reference in the ISO standard.
Now, considering ISO 9004:2000 uses the term "people throughout the organization" not "ALL people people throughout the organization" I would say you are on pretty solid ground there also (given that you have management throughout your organization), but subjectivity of the standard is it's weakest point because rarely does anyone challenge the registrar to prove their point (althought they should, I do routinely).
HOWEVER! Setting the standard aside for a moment, If your quality system does not include most of your workforce, you are probably missing an opportunity for continuous improvement.
Hope my "hard line" helped.
Regards,
Carl-