Yep, take it off. The only piece I left on was the bit for the light switch, as I couldn't get the switch out, but I could remove the bezel round the switch which I did, and the rest of it could be made loose enough to wrap and trim around. Use a scapel.
The big leap of faith I had was the front ashtray cover, tugging on that gets you a bit nervous about it snapping off !!
I would suggest to do the door trims first as a practise as they are easy to pull off.