You can delete selected diagram element (for elements – see Multiselection above):

Select Delete on the Item menu

   - or -        

Right-click the mouse and select Edit from the pop-up window.