If you just wire it to a fuse, you will get constant power, so it will always be on. You need to either wire in a switch on the power wire, wire the power wire to the light switch on your column (very annoying and involved), or just deal with it.
Mines always on when my car is on, I prefer it...