USB: ftdi_sio: use port_probe / port_remove thereby fixing access to the latency_timer