This is the site to go to. I'd recommend just reading and looking at things for a while, to be honest. If you want to buy a starter pocket knife, it would depend on how much money you're willing to spend, but you could start with a Swiss Army Knife, a Buck 110, a Spyderco Resilience, an Ontario RAT 1 or 2 all for about $30-$50, and you'd have a knife that would serve you well.
Most here will say not to jump into the deep end until you've had some time to learn. Maybe you'll catch the 'bug' and be like the rest of us addicts, maybe you'll decide it's not your thing. If the latter, having a decent knife when you need one will still be a good thing, and any of the knives I mentioned won't set you back too much and will serve you a lifetime. If the former, you won't really know what to appreciate about ridiculously expensive knives without starting with less expensive ones and doing some reading.
Welcome!