Well, I think he was biased in favor of the idea that the universe is eternal. He also was not a fan of quantum mechanics, which has since become an essential tool in physics.
I don't think his biases are unique to him, or to people who are atheists. We know of several examples in history where scientific ideas were attacked due to religious preconceptions about the world.
The hope is that we can keep the biases in check and not slow scientific progress unnecessarily 
Well...with a lot of people, Science has simply become the new God. Most of the more renowed Atheists that have been active in Acedmica, for the last three decades or so, have had an intense religious-like devotion to their cause. They are just as bad as any Christian Apologist, perhaps worse even, as the Christian Apologist makes his intentions obvious, where the Atheist is more apt to ensconce their agenda under the guise of "Intellectual Honesty."