It works for a few times, then it reverts to just Googling my voice command. Wtf?

Same thing happens to Listen to (Artist)(Album).

Both commands worked perfectly when I got my G Watch at launch. Now it's broken on G Watch and Moto 360. Any ideas?

And FYI I've already done the search on the phone and picked Google Music.