See Define a Guest

In order to use a name over again for a new guest, you have to undefine the old one.

You need to remove it's storage system as well.

virsh undefine VM_ID