This is what I thought. I've asked this on serveral different forums, and I get different answers on each one. Some say it switches between 5/4 and 4/4, some say 3/4 5/4 and 4/4, but I've never been able to actually count it out.Nope, you're right, just listened to it several times. There's no 1, 2 or 3 distinct, repetitive ones, they're jumping around between every phrase. you're going to have to memorize the individual phrasing and not count it out unless you're going to memorize a sequence of 20 different time signatures. Good news is that the song is like 2 minutes (probably because the band couldn't hold it together for any longer without someone screwing it up in studio)
To my ear, I'd say it's all 4/4 with backbeat displacement to create the "wandering" effects.