They are brand new. They are the ones that cam with the kit from Yamaha.
This could be one of the reasons you're not getting the sound you want. Factory-installed drum heads are usually not the best quality. If you have the money to spend, I'd highly recommend buying a set of professional-grade drum heads (Remo, Evans, Aquarian). Even if you only replace the top (batter) heads, I guarantee you'll hear a difference! They'll also be easier to tune. As far as which types of heads you should get, that's entirely up to you. There are a lot of options out there, and if you need help choosing, of course you can always find tons of info here on the drummerworld forum! I feel like a good general-purpose head setup would be as follows:
Bass drum: Clear single-ply batter with muffling ring (Remo Powerstroke 3, Evans EMAD), Black or Smooth White resonant w/ muffling ring (Powerstroke 3, Evans EQ3)
Toms: Coated or Clear 2-ply batter (Remo Emperor, Evans G2) Clear single-ply resonant (Remo Ambassador, Evans G1)
Snare: Coated single-ply batter (Remo Ambassador, Evans G1), Clear single-ply snare-side (Remo Ambassador Hazy, Evans Snare-Side 300)
You can control the overtones and sustain of each drum by using various types of muffling to suit your personal preference: Moongel, Drum Dots, gaffer tape, etc. Felt strips, pillows or towels can be used inside the bass drum.