I’ve thought about this before, especially when the crew is visiting pre-warp / pre-universal translator societies. At least when it’s someone like the Klingons you can really stretch and try to justify it with something like, “maybe there are a lot of different languages lumped under Klingon, so everyone is using translators all the time anyway.”