In a lot of these responses "cheese" seems to be lyrically driven. It also seems to me that solos, arrangements, choreography, and even setting/context can be cheesy.
Let's be clear, too, that a significant part of this is subjective assessment - a lot of popular things are cheesy or become that way when they fail the test of time. I don't think most would argue that the masses are aesthetic champions, often things become cheesier once they become popularized and hence caricaturized in subsequent iterations.
Some of the most lucrative places for musicians to play, one might argue, are pretty cheesy - local bars, weddings, churches, corporate events, et cetera.
"Cheese" is probably distinct from being "objectively bad" (a loaded topic in itself), because the subjective concept of "taste" is central to the assessment, the violation of taste, perhaps in the manner outlined by previous posters, MAY make something "cheesy", but the specific WAY taste is violated is central here, I reckon. Many folks love music they fully acknowledge to be cheesy, sometimes BECAUSE it's cheesy. "Irony" then enters the chat...