Re: RoHS Directive 2011/65/EU Revision ? Medical Devices - 22nd July 2014
The answer depends on whether the (non EC) country of interest relies on the CE mark in its regulatory clearance process.
If it doesn't - I reckon that you can take away the CE mark without notice, provided that that action doesn't afect any significant aspect of the device. At most, document a letter to file with your reasoning for not notifying any one.
If it does - you'd probably need to re-clear on the merits of the device itself, without its (obsolete) CE marking.