Delete contact record, but keep patient record

I have converted a few contacts to patients thinking this would remove them as a contact and switch them completely to a patient and therefore making them only present in the patients database. But they remained in the contact list as well. I tried to delete them as a contact but this deleted the patient as well. I also tried to only keep them as a contact and delete the patient, but this deleted the contact as well.

Is there a way to remove someone from the contact list, but keeping them (and all their info) as a patient?