Depending what you want to do, you may not have to remove it, which is a very complex procedure.
The back panel does come off just by pulling, and you may be able to fish wire through the console, if needed.
Remember, the console is full of HVAC equipment. A/C coil, and a good sized blower. The air bag control module is also below the storage bin at the bottom of the center stack. Caution is the key.
