I have them turned on for two or three selected apps and turn them off for everything else until they are needed. The apps that use location services will appear in the settings and you can turn them off or on individually.

Common sense and deodorant are a lot alike. People who need it the most don't use it.