Regular signing identities are not persisted on ledger, which allows for directly replacements.
How to Revoke Signing Identity Certificates
Navigate to CA on the Left panel of your dashboard , select your CA, under Identities tab Select the identity of the peer to be Enrolled and execute Enroll/Reenroll as shown in the image below.