Just realized I don't see the reloading bench. Should I assume ammo creating isn't in the game?

No, it is not in game, though not needed thanks to the finding ammo perk making it super easy to get ammo.

Although there is syringer ammo used by a very specific (and I think in-craftable) weapon type called the "Syringer".

Small Spoiler

I believe the Syringer is sold in diamond city by the doctor

Mild Spoiler

There's another Syringer lying around somewhere else in the game ready to just be picked up if you find it.

I never actually got around to trying out the syringer. So I kind of regret paying for it when I eneded up picking up a (better) one for free.