Smaug
"zebra"If you want the sort of quiet where you could plink all afternoon without annoying the neighbors in a typical suburban neighborhood then you want a 22 cal.
...or .177. Even a typical 30 FPE .22 can cause serious damage in the neighborhood. Realistically, what are you needing to shoot in your back yard? Raccoons? .177 has you covered. (with head shots) .22, no matter what, and still has relatively affordable ammunition.
The guys who actually
need the airguns over .22 caliber are those out west, trying to make 100 yard shots on ground squirrels, or those determined to hunt big games with air rifles.