Need, type, frequency and scope you can decide, but decision "no need at all" for all suppliers is not compliant to this requirement. I understand this is OK according to your auditor evaluation. Stay with that, but keep in mind, other auditor can evaluate it as nonconformity.