The is a list in an annex on [Wiktionary](https://fr.wiktionary.org/wiki/Annexe:Curiosit%C3%A9s_linguistiques_en_fran%C3%A7ais#Mots_sans_rime).

Other than the words already mentionned, there's *huître*, *chanvre*, *sceptre*, *scepulcre*, ...

But there is no "famous word" like "orange", that is known for not rhyming.