driver core: do not wait unnecessarily in driver_unregister()