Somashekar,
that is your view and I respect it. However I do not accept that conducting requires physical presence with the auditee. If you consult ISO 19011:2011 you will find that remote auditing is acceptible.
I would certainly not conduct an audit by email. If telephony is the only method it is acceptable but not recommended. However, web conferencing is the usual method; it is free (or very cheap), reliable and very flexible.
Remote auditing has been accepted by at least one reputable (and internationally recognised) accreditation body for use by a certification body.
It is widely used in the ICT world. The ability of a remote user to monitor the activity on another computer has been widely used by service organisations for many years to diagnose and correct problems. This technology can be used to audit - it is the equivalent of observing an operator working a machine. Webcams on tablets can be used for live video streaming. There are many other examples.
I hope that you may someday find it a valuable method.