Why Being Forgotten Can Hurt More Than Being Left