Context is a school where a teacher had a rough life (she's an orphan) and one of her students has also lived through difficult times. She says: “We were both damaged goods”. I know the phrase perfectly well but struggle to find a proper French equivalent.
“tous deux abîmés par la vie”
“tous deux des rebuts”