We need to take the direction of the conversion into account when deciding if we should apply rate scaling.