There are several "must have" records for a jazz collection. A few that come immediately to mind are:
Miles Davis - Kind of Blue; Milestones is a favorite too
Oscar Peterson - Night Train
Art Blakey - Moanin'
Dave Brubeck Quartet - Time Out
John Coltrane - Blue Train (you mentioned already owning this one...good start.)
Plus anything with Clifford Brown and Max Roach and as well as anything by Thelonious Monk.
There are many many others too that I'm sure others will mention.
Also check out the other side of Drummerworld. There are many jazz drummers to check out and a lot of links in the gallery have sample songs as well as videos. Sometimes there are also discography recommendations.
Check out "The Legends" and "Jazz Pioneers". That should keep you busy for a while