Yes, I've been through that PM phase a few years back to the tune of about $100K. Bought a lot of coins from APMEX and JM Bullion online. They are very reliable and trustworthy, but their prices leave a bit to be desired if you buy in smaller quantities. They ship via UPS and FedEx insured, so there's no risk to you. The process is well-oiled. Reputable local bullion dealers can be a good source too.
If you're new to the game, you want to start with Gold bullion, in the form of the most fungible and lowest premium coins. Specifically 1 oz. Gold Eagles and Gold Buffalo coins, or Gold Maple Leafs. They come in different weights, but the 1 oz. coins are by far the most common and lowest premium to own. These coins have the lowest price over spot, the are recognized and transacted worldwide by all coin dealers, and any PM dealer or private collector will buy them immediately. With bullion the condition of the coin is not as important. This is not true of all coins.
Coins that are less recognizable or have some numismatic value must generally be sold to other collectors who will pay for the numismatic value - and their condition affects their value. Otherwise, coin dealers and other bulk buyers ignore semi-numismatic value when buying coins and just offer the spot bid price. That's why I would avoid coins with higher premiums over spot. (True numismatic [rare and vintage] coins are a completely different animal that I don't have the knowledge or experience to touch.)
[Side note: you will buy Gold at the 'ask' spot price (plus premium) and sell at the 'bid' spot price (with a small premium if you're lucky). As of right now, the difference between ask and bid price is $1820.50 vs. $1810.50. That's a pretty low spread IIRC.]
Although bars seem like a very efficient way to buy PM, Gold bars are much less trusted and easier to counterfeit than gold coins. The only gold bars that should be purchased are ones 'in assay' - i.e., in security-sealed and serialized packaging - from a recognized source. (Don't take them out of the package!) Loose gold bars are highly scrutinized and much harder to sell quickly.
Avoid all the marketing hype around the myriad different types of gold and silver coins. If you're just buying PM as an investment/store of value, stick with the simple bullion coins and you'll be much better off profit-wise in the long run.
One last thing, different states tax coin purchases differently. Knowing your state's laws can help you save money. For example, in CA purchases of gold bullion are taxable if they are under $1,500. So for me, I always spend more than $1,500 when I buy PM.
https://www.apmex.com/state-sales-taxes
Hopefully some of this info will help you get started. Good luck!