Most of us need to be highly competent drummers, not elite ones. Devoting reasonable energy and attention to the instrument and taking pleasure in every moment makes a great deal more sense to me than treating the pursuit as a never-ending immersion in dissatisfaction.
For me, it has to be fun first. Period.
While I know the gig I'm playing might be a workout, it has to be a fun one above all else. Otherwise, I won't like it & thus making it "work".
I know I'll never be a pro-drummer at my age (that time has passed), so now it's all about the enjoyment of the instrument that I work hard to be proficient on.