I think to a certain degree you're right on that one. So when people say "Neil Peart is the greatest rock drummer of all time" that has a lot more plausibility than the idea that he is the greatest drummer
of all time. What if someone stuck the brain of Chad Wackerman in the body of Neil Peart and had him play in Rush? People might say that the drumming became more complex, but they might also say it didn't fit as well. And there are similiar things in jazz. For example, for example a lot of people say that Dave Weckl's swing feel is the weakest aspect of his playing.