Don't assign the SP button to an action. Let players press it only when they want to use SP.

I made this.