Hmmm... No, you can't export by category. But you can go to My Account - Views and Reports and pick the Report by Expense Types and you'll see a pie chart of your expenses by types. I am guessing this is what you wanted to do using the export feature and Excel.
The export functionality is very basic. The idea is just to let users export their data as it is.