In the following paragraph, "l'imparfait" is used. But then, "le conditionnel présent" is used.
(From the book Dans le café de la jeunesse perdue of Patrick Modiano, p. 29-30) J'ai serré [...] J'étais [...] Je me tenais [...] Cela me suffisait [....] Je me sentais [...] Le [café] était pour moi un refuge contre tout ce que je prévoyais de la grisaille de la vie. Il y aurait une part de moi-même — la meillure — que je serais contraint, un jour, de laisser là-bas.
At first, I was very confused about the bold part, it didn't sound right to me. Now, I think that it is used like this because it is supposed to refer to the "prévoyais" part.
So, I would translate the last sentence like this: [That] there would be a part of me - the best part - which I would be, one day, forced to leave there.
But I'm still not sure if I understand how exactly it is connected to the second-to-last sentence.