Steps to delete a label :
Step 1 : On back end go to app' dashboard >> Product Label >> Click My Lables on the left menu to see all labels on your shop.
On the My Labels page you can delete permanantly a label from the application by clicking trash button. Your label would be immediately removed from storefront.(see image below)
Done!