Absolutely NOT. It misses the whole point of a process approach. It would be like reading meeting minutes instead of particpating in the plannin meeting.
Auditing records will provide objective evidence that a system is NOT effective, because it will show evidence of failures in clear black and white. However, absence of evidence of failures does not guarantee absence of problems. It may just be that the failures were not adequately recorded... (Gee, I can't imagine anyone doing that...)
Further, a quality system, or business management system, is a complex organism and series of processes. A good audit has to evaluate effectiveness of skills, knowledge, interrelationships, process handoffs, etc. etc.
To determine effectiveness is much more complicated than to determine failure. That is why so many auditors can write up so negligible findings, but few auditors really get to the heart of the system. It takes someone with a management perspective, or someone who can see the big picture, to sysnthesize the effectiveness of a whole system.