Well, like English sports cars, Premier drums have some quirks, like slotted tension rods (need a special drum key for those). And you can't buy those at Guitar Center. Also, Premier hardware isn't compatible with anything else out there (that I know of). I own a '75 Premier Baron kit. Really nice drums .... but ..... I have 6 other acoustic kits as well. I like variety, so a Premier kit fits well, into my stable. But it's not the most popular of drum brands, here in the US.
Lack of endorsements, I think, more than anything. Ringo played Ludwig. And for a while, Ludwig was selling 150 kits a day. A lot of young men wanted to be like Ringo. Bonham played Ludwig. Charlie plays Gretsch. With so many "big" English drummers pounding US made drums .... heck, makes me wanna play Ludwig and Gretsch, too. And indeed, I own and play those, as well. And Yamaha .... and RMV.