We have never observed infinity in nature. Whenever you have infinities in a theory, that's where the theory fails as a description of nature. And if space was born in the Big Bang, yet is infinite now, we are forced to believe that it's instantaneously, infinitely big. It seems absurd.