IB/ipath: don't modify QP if changes fail