In the list shown in My Account - Expenses, you can select the expense record you want to delete by checking the check box on the left and then click the Delete button (the red X) on top. It is very much like deleting an email in any popular web based email.