Neutron star collisions can capture a fleet of cosmic ghosts for a short period of time