Yes, you can edit or delete popup after save and exit.

Simply login to Shopify admin >> click on apps >> click on popups tab.

Then you will see all popups list in form of popup name you can see edit and delete the icon from here you can edit or delete icon.