You probably have 2 options:
- read guidance such as the Blue Guide, the text of the Directives and associated guidance documents and try and work it out yourself
- hire a consultant to create a template for you that can be tailored to your company processed including items such as change control (ongoing compliance), purchasing and specifying (RoHS), Quality Assurance (compliance of ongoing manufactured products), identification of applicable standards.
Some more information can be found by clicking on the various Directives listed at
Harmonised Standards - Internal Market, Industry, Entrepreneurship and SMEs - European Commission
(Full disclosure - I'm a CE marking consultant....)
Charlie