The stock e-brake handle just "slides off." It is super tight and has 2-3 little prongs that grip it to the plastic e-brake boot. Just grab with both hands, and push towards radio real hard.
The easiest way for me was to remove the cupholder section of the center console, grab the rubber "boot" from the bottom and basically peel it up towards the handle so it's inside-out. From there you'll have access to the prongs Hank mentioned.