That was honestly my first thought too, when I sawe your post, even before I saw this.
I’m still primarily a “real amp” guy, but I’ve played around with friends’ modeling setups a lot over the years and honestly some of the challenges to recording with modelers are awfulyl similar to recording with real amps. One of the big ones is what an amp sounds like “in the room” when you’re standing next to it and jamming, and what a mic “hears” when it’s 1/2" off the grill cover and maybe 1" to the side of a speaker cone, are VERY different things. Coming at it the other way, one of the big learning curves for me was learning to dial in a tone while listening at speaker level to make sure what I was getting out of the amp was really what I wanted to be hearing.
From the other standpoint, this could be as much “ear education” as anything else - a close mic’d amp sounds raspier on its own than the amp does when the speaker is 6’ below you and 10’ away.
That said, I had a friend track down a bunch of “amp in the room” IR packs somewhere, don’t remember if it was an existing pack or if he got someone to make him a few, that did a better job replicating the amp-in-the-room sound by creating an impulse based on a mic in a normal human listening position - that could be worth a try. But a lot of it is a recorded guitar just sounds different from an amp you’re standing in the same room as.