This is not the case, the card will be unbound at the ASoC level when any of the components are removed and then probed again when they reappear.