To resolved the issue you need to add Extruder end g-code into your Machine settings in Cura to force it to change extruders over the wipe tower:
G0 X {prime_tower_position_x} Y {prime_tower_position_y}
Thanks to D1Spartan for sharing his Cura setting. This specific one is at 28:37
