This question is a follow-up to a recently-asked question: What are the French “language buffer” words (aka “filler words”)?
Speaking from my own experience, after spending an adequate amount of time with French, I've started to naturally incorporate fillers into my speech when I'm in an informal setting.
However, I also know that in an academic setting (regardless of the language), it's often taught that one should avoid fillers. For example, in public speaking courses, professors constantly harp on students who say "um", sometimes if they say it just a handful of times in a speech.
With that taken into consideration, I recognize that there are different registers of speech, and not everything is a formal speech in a classroom or in front of a public audience. Fillers are an inevitable and accepted aspect of language in certain settings.
My question then is this: should learners of French push themselves (to a point) to use more filler words (I get that this could easily become excessive) in order to sound more like a native speaker or should this be left to happen naturally?