This is a very little molehill that people blow up into Himalayan sized mountain.
There is a small difference, but without scientific instrumental documentation of the difference between the same platforms in different calibers, it is a matter of perception.
If you think your moderator does not make a difference, take it off a shoot a bare barrel a couple of times.
I do recognize that there is a difference in sound production between dry firing and shooting a pellet. Even going to a heavier pellet can make a big difference in sou.d output.