I just found out that Reaper has this option.
They have an option called "Monitor track media when recording"
Their manual says "If you do this when punching in, say, a guitar or vocals, regular Monitor Input will cause you to hear both the existing and the new material right up to the punch, and during the punch.