I would definitely prefer playing to records. I think half the battle is finding ways to make metronome practice fun.
If possible, check out Spencer Strand’s “Test of Time” tracks. They are drum-less tracks at various tempos with random gaps in the music. The variety of music is good and I found them to be an excellent tempo exercise. They really helped improve my timing, especially on fills.