There is a guy selling refillable cylinders for the Komplete too for about $100.
I like SPA guns for less expensive ones. I have 5 but one does not currently work (gross manufacturing error but I wouldn't worry about that, they are generally reliable). They are all bullpups which are a little more expensive, pushing $500. A less expensive option that is similar except for length would be the Stoeger Ranger or Scout. I would get the Scout because it is not so long. I would get the 25 caliber. Groundhogs can push 10 lbs and I shot a raccoon about that weight with my P35-22 and it worked but I would use my 25 next time one shows up (and I did and it worked better). Airgun Revisions has Stoegers too, I saw a Scout for $319.
A hand pump is totally doable for pesting. You will need to pump hundreds of times to get it full initially but then you have about 50 shots which should last awhile. PCPs should hold air for years. If they do not, you can return them. Refills are also a lot less pump strokes than an initial fill. You will need to use some air to get it sighted in so you will probably do at least one refill but after that you should be set. My "better" hand pump is a cheap one from Amazon. No need to spend even $100.
I recommend JSB (or FX) 25.4 grain and H&N Baracudas to try. If you had to pick one, I would get FX 25.4s. 2 of my 3 25 caliber SPA barrels like them a lot.
My favorite "cheap" scopes are the Hawke Vantage line. A 3-9 is a good all around but for shots within 30 yards or so the 2-7 would be fine (that is what is on my Prod).