If you are starting out I'd suggest you go a light caliber, a 223 and a light gun like an AR15, but that is $2k. Otherwise a decent bolt action like a CZ at about $1200.
That caliber will be good to practice with, light to carry and fairly cheap to run. Plan on using 1000 rounds or about $800 in ammo practicing.