A real djembe in a set is a no go. The very thin heads won't hold up.
I have used a djembe shaped object produced by Remo in the kit. I took the bottom part of a small cymbal(actually old style snare stand), so that the bottom was off the ground.
Eventually the older style fiber skyn head wasn't very good with sticks(or hands for that matter)though brushes were great, so I sold it to a coworker from Cameroon(who said it was subsequently stolen).
I think the newer style fiber skyn heads would work better, I've seen people playing them with sticks to great effect, and seems about the same as the black suede tom heads.
There is a Chinese drum called a flower pot drum that is shaped like a djembe and played with sticks, might work better.