
The apps need permission to the microphone for that and in background it would drain the battery and constantly show the microphone is accessed unless you are using an old android version. It is likely easy though to eavesdrop when the app is opened and using microphone is an expected functionality, and to pick up keywords and the sounds emitted from other sources to better know location and social graphs without GPS access.
It is good to use linux. But this has an impact on everyone to some degree. You may use Linux, but does your family, friends, your doctor, your teacher or boss, and whoever else who has some of your personal data?