Yes, you can be too cautious

from here (source image)

In a world of finite resources, using them all against one small threat is going to leave you vulnerable to bigger threats elsewhere.