If the bolt is missing then its leaking. seafoam your engine and you will see it smoking. when you replace the bolt, expect another one to fall out shortly after.
Is there anything special I should be looking for in a replacement bolt? I should be able to get a replacement at like ACE hardware right? Should I just replace them all?