Stop rebasing.
This should only happen if absolutely necessary to fix major merge mistakes.
Rebasing changes history and I've seen more problems prevented from removing it as a CI strategy.
Every CI strategy I've seen relying on rebasing had a better alternative in SDLC. You just need to level up your project management, period.