If you fortify them in cities, they act like a Security Bureau. So yes, they perform passive counter espionage on the tile they are on. When you build a Sec Bureau, however, the effect does NOT stack.
I place them in all my major cities. However, if you are very tech heavy and most other civs are behind, putting a spy in all cities will help prevent someone from stealing a tech.