Mean radius is just a better measure than group size, for measuring precision. It is less sensitive to outliers. Really you do need more rounds to measure mean radius accurately but I find for my purposes 10 is practical.
It is a bit hard to tell what is going on with your situation. What does the total group of 30 look like if you overlay them? It's really hard to tell what is POA etc from your targets.
It's possible the "fliers" you are seeing are just outliers in the real group. If it's not that and they're outside the overlaid group, you have a rifle (or shooter) issue of some kind.
Bookmarks