The answer is no. The segment and it’s data will be deleted but the contacts will still be intact. The contacts would still be in your “Manage Contacts” overview page. If a contact also appears on another segment it will still be remain in that segment. You would only being the segment, not the contacts.
Remember if you delete a segment, all of its data will be erased and you will not be able to reverse this action.