To delete a guide, click on Content in the orange menu bar, and then Guides:
You should see a list of all of your guides. To delete one, click on the little "x" to the right of the guide:
A box will pop up asking you to confirm that you want to delete the guide. Make sure to check whether any of the content on your guide is reused elsewhere; if you delete it, that content will be deleted everywhere.
