Much like how
being a famous smuggler means you're doing something wrong, being a famous spy is equally counter productive because you're not going to be able to go where you want to go or do what you want to do without people noticing.
It turns out there are a wide variety of other scenarios where being famous also works against you. For example, if you're famous for going after bad guys you better believe they're going to go after you too. If you're famous for having a lot of money you'll also be a target, or if you're famous for having access to something valuable, etc.
All in all, if you want to get things done it's generally better to go unnoticed and blend in than it is to stand out and draw attention to yourself by being famous.
Of course this is only true for people. Companies like Facebook and Google are very famous for spying on users and it doesn't seem to matter.