Conditional and unconditional asymptotic stability of time dependent sets