Talk to your IS person. Most computer systems can be made to generate reports providing the type of information that you are looking for. Be careful to validate the information to insure that it is as correct and valid as possible. If possible, make your measurements as objective as possible and have the backup detail available to support the summaries.
Having said that, be very careful how you use the information. Accurate, objective information makes an excellent TOOL to be used to identify opportunities for improvement. That same information can be very dangerous when used as a WEAPON to beat on supplies or internal departments.
I know from experience that a supplier's performance summary can be very misleading, so it must be used carefully, thoughfully, and with a true understanding of the circumstances surrounding it.
Be careful who you share information with until you really understand it. I've seen executives make unfortunate decisions based on information they did really not understand.