.25 cal pellets have about a 850 FPS max velocity before they start getting inaccurate. I shoot 25.4 grain JSB Exact King pellets around 820-840 FPS depending on air pressure in my BSA Lonestar .25. A moderator increases speed by about 20 FPS, so if you are slightly over max accurate velocity, removing a moderator can increase accuracy. Try reducing your velocity a bit below 850 FPS and see if that helps. If not, you probably have another issue to resolve. Some rifles may not like JSB pellets, although I find they are the best in my rifles.
Understand that altitude has an effect on maximum accurate speed. I shoot above 3000 feet elevation. At sea level you may have to reduce velocity a bit below what I am shooting at. I would reduce velocity to 800 FPS and increase from there until I found at what velocity accuracy suffers, then back off a bit.