This kind of thing will happen from time to time.
I put my stick bag and cymbals away as soon as I am finished playing at a party.
This usually works to detour would be drummers from playing my kit.
I don't know why people think that a guitar or a drum kit left alone is an invitation to play?
I kind of like old drums:)