I am usually wrong twice a day, so I am on thin ice here. In my small minded understanding it is due to the pellet losing forward momentum faster than it loses radial momentum. While stable at 0y and say 800 fps and 600 rpm (randomly picked value of 1:16 twist rate,) when the pellet gets to 55 yards the ratio between forward motion and rotation breaks down. Say you have 600 fps and 600 rpm (again numbers plucked from my imagination), the pellet can and will develop stability problems. Think of sped wobble in the front wheel when you ride your bike too fast.
Try a heavier pellet, or a longer pellet and tell us what happens then.
Rotational drag is close to nil, compared to the high drag in linear motion. I am wrong a lot more than I am right, though.
My gun does not like the lighter JSBs in .22. they shoot 1/4 inch at close range, but past 45 yard they can't stay on paper.
Your results may vary. It works in my mind, anyway.
On the other hand, it could be aliens, gnomes, or evil butterflys.
*shrug*