I have a number of PCPs as well as springers. Good marksmanship needs to be developed and practiced regardless of what you shoot. I disagree with many who say you need to hold a springer a certain way (artillery hold) to get them to shoot well. I never use that and my springers are exceedingly accurate as long as I am consistent the way I hold it and align the sights. Again, practice, practice. Fortunately for new shooters like you there are good shooting rifles in each category that won't break the bank. PCPs are easier to shoot, but as you say, you need all the support equipment that goes along with those. If you don't want to go that route, but just dip your toe in the airgun waters, buy a good quality springer, and not a cheap one. Any HW model is a good choice. For around $400 you can get an HW30 or HW50. If you want more power, then for $100 more get an HW95. A Diana 34 has a good reputation as well. These shoot pretty well out of the box, but later, you many want to improve their behavior or change power levels with a spring kit/tune. If you have any mechanical skills you can do it yourself. There are also plenty of Youtube videos describing how to do this. Don't get sucked into the magnum idea. A good accurate rifle shooting 12 to 20 fpe will do what you are intending.
Also, there are good used rifles on the market as well. Check the classifieds on this forum and what the dealers have availble. AOA has a good selection and they test each rifle before shipping to you. Happy shooting.