There are no rules.
(réf.) Pour ne plus confondre les verbes qui se construisent avec À et ceux qui se construisent avec DE, il n’y a pas de secret: il faut les apprendre par cœur!
Sometimes either preposition is correct; this is true for the verb "continuer", for instance.

The particular preposition that a given verb calls for must be learned through the practice of reading, a practice the learner should constrain themselves into as soon as possible (gradual increase of the difficulty) and keep to as steadfastly as possible.
Rule for verb that indicate motion
- from somewhere: DE
revenir de, partir de, arriver de,
- to somewhere: À
revenir à, partir à, arriver à, aller à, se rendre à,
- place where sb/sth is: À
être à (Brest, la montagne, l'école), vivre à,
There are certain principles that you will extract from a good dictionnary, such as the TLFi (de, à). However, it is much better to learn by doing as much reading as you can (it is much more interesting and learning becomes much less painful).