Alexa, Listen Carefully. Back Off!