audioadapter: emit Latency param changed when follower changed

When the follower port Emits a latency param changed, our reported
latency also changes so we need to emit the changed notify.

spa/plugins/audioconvert/audioadapter.c

@@ -795,7 +795,6 @@ static void follower_port_info(void *data,
 			if (idx == IDX_Latency) {
 				res = recalc_latency(this, direction, port_id);
 				spa_log_debug(this->log, "latency: %d", res);
-				continue;
 			}
 
 			this->info.change_mask |= SPA_NODE_CHANGE_MASK_PARAMS;