System details
Omarchy 3.3.3
What's wrong?
Connecting to a headless server via ssh and starting Neovim, e.g. Ghostty supports clipboard by default using OSC 52. While Alacritty also supports OSC 52, it does not support how Neovim checks for that, see https://neovim.io/doc/user/provider.html#g%3Aclipboard and how to set vim.g.clipboard in Neovim config.
While Alacritty defaults to osc52 = "OnlyCopy", I've found you need to manually set osc52 = "CopyPaste" to get it to work.