Steve both just pull off but please take a video as you pull so hard (for the gear knob) you hit yourself in the face! The gear stick surround is on 5 or 6 clips and you can ease up gently without putting too much force in. I found it easier to use your nails and prise up slowly from the outside.
I was considering painting mine black and the centre console as i dont like the silver was wondering how to get it off