The Deerstalkers range I used to go to in Dunedin was rubbish. You had to traipse through mud for 10 minutes to get there, then it was just a crappy cleared out area on the side of a hill with a lack of decent shooting platforms.
I've done a bit of plinking on DOC land up near Cromwell - had a 12 month rimfire permit so had a bit of fun shooting across a gully with the .22 when I had finished shooting bunnies. Nobody was around, and it was across onto the opposite face of a small, completely bare gully. Very safe.
Regardless of what it is called, a DOC "hunting permit" allows you to shoot rifles on specified blocks of public land. I doubt anyone would have a problem if you were plinking with the right permits and with a bit of common sense regarding safety.
Bookmarks