I'm looking to get some dollars in cash to give as a gift but I'm not sure how to get them. Could I walk into an exchange place and just say "$5000 USD please"? or how does it work?
No.
You can wire an exchange place money, and then they will give you $5000 USD. You can send them USDT or USDC as well.