For me, I thought I had the best job in the world.
There is definitely a sense that when you, as a CIA ops officer... are handling assets, they are delivering to you their trust and their well-being. And you feel very protective of them, even if they're not very nice people.
Any time you're a poster child for the CIA, there are a lot of people that are - either have ideological or they are mentally unbalanced - that are going to try to find you and perhaps cause you harm.
So many times, genuine health workers and genuine NGO folks are really just trying to help other humans in whatever capacity they can. But they are perceived as being CIA, and therefore, it blocks their effectiveness.