Yes, I agree to this point. I think your point is best described in the standard ISO31000/ IEC31010 5.3.2
Clause 6.1.1 of ISO/TS 9002:2016:
There is no requirement in ISO 9001 to use formal risk management (in accordance with ISO 31000
in determining and addressing risks and opportunities. An organization can choose the methods
that suit its needs.
There's no need to have subsequent columns to indicate who will be affected (IP) or what is the context for each risk/opportunity that you have identified. It should be the other way around. To better identify risks/opportunities, the needs/expectations of IPs and the issues should be understood first. Example: waking up late will only be considered risk if I clearly understand that my boss expects me to come early in the office (i.e. 4.2) and I know that there is heavy traffic along the way to the office (i.e. 4.1).